2023-11-17T06:08:11.626 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-17T06:08:11.626 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339 -- /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/orig.config.yaml 2023-11-17T06:08:11.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T06:08:11.790 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339 branch: wip-57087-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} email: vshankar@redhat.com first_in_suite: false job_id: '7461339' kernel: flavor: default kdb: true sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-57087-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57087-3 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 owner: scheduled_vshankar@teuthology priority: 20 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1441 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 sleep_before_teardown: 0 suite: fs suite_branch: wip-57087-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-17_05:53:21 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587 2023-11-17T06:08:11.790 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa; will attempt to use it 2023-11-17T06:08:11.791 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks 2023-11-17T06:08:11.792 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-17T06:08:11.793 INFO:teuthology.task.internal:Checking packages... 2023-11-17T06:08:11.818 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '895e5adad9a763a0f13587c485b17f1ad3f04528' 2023-11-17T06:08:11.818 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-17T06:08:11.818 INFO:teuthology.packaging:ref: None 2023-11-17T06:08:11.818 INFO:teuthology.packaging:tag: None 2023-11-17T06:08:11.818 INFO:teuthology.packaging:branch: wip-57087-3 2023-11-17T06:08:11.819 INFO:teuthology.packaging:sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:08:11.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-57087-3 2023-11-17T06:08:12.008 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:08:12.008 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-17T06:08:12.016 INFO:teuthology.task.internal:no buildpackages task found 2023-11-17T06:08:12.016 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-17T06:08:12.025 INFO:teuthology.task.internal:Saving configuration 2023-11-17T06:08:12.054 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-17T06:08:12.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:08:12.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:01:36.373854', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-17T06:08:12.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:01:36.372375', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-17T06:08:12.271 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-17T06:08:12.279 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-17T06:08:12.279 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-17T06:08:12.279 INFO:teuthology.run_tasks:Running task console_log... 2023-11-17T06:08:12.434 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a1b599e50>, signals=[15]) 2023-11-17T06:08:12.529 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-17T06:08:12.542 INFO:teuthology.task.internal:Opening connections... 2023-11-17T06:08:12.542 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:08:12.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:08:12.610 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:08:12.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:08:12.672 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-17T06:08:12.703 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-11-17T06:08:12.738 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-11-17T06:08:12.739 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T06:08:12.789 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04" 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal 2023-11-17T06:08:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal 2023-11-17T06:08:12.791 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-11-17T06:08:12.826 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-11-17T06:08:12.834 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-11-17T06:08:12.834 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-11-17T06:08:12.882 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="20.04" 2023-11-17T06:08:12.883 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T06:08:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T06:08:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T06:08:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T06:08:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=focal 2023-11-17T06:08:12.884 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=focal 2023-11-17T06:08:12.884 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-11-17T06:08:12.917 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-17T06:08:12.930 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-17T06:08:12.943 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-17T06:08:12.943 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2023-11-17T06:08:12.949 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-11-17T06:08:13.002 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-17T06:08:13.019 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-17T06:08:13.019 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2023-11-17T06:08:13.036 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-11-17T06:08:13.113 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-17T06:08:13.252 INFO:teuthology.run_tasks:Running task kernel... 2023-11-17T06:08:13.346 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'} 2023-11-17T06:08:13.347 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, timeout 300 2023-11-17T06:08:13.347 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-17T06:08:13.348 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-17T06:08:13.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:08:13.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:08:13.361 DEBUG:teuthology.task.kernel:sha1 for mon.a is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.362 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-17T06:08:13.366 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-11-17T06:08:13.367 DEBUG:teuthology.task.kernel:sha1 for mon.b is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.367 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-17T06:08:13.367 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-11-17T06:08:13.375 INFO:teuthology.orchestra.run.smithi119.stdout:5.4.0-124-generic 2023-11-17T06:08:13.376 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.376 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-17T06:08:13.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.422 INFO:teuthology.orchestra.run.smithi100.stdout:5.4.0-124-generic 2023-11-17T06:08:13.423 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.423 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-17T06:08:13.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:08:13.579 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-17T06:08:13.579 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-17T06:08:13.608 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-17T06:08:13.647 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-17T06:08:13.648 DEBUG:teuthology.orchestra.run.smithi100:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-17T06:08:13.669 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-17T06:08:13.729 INFO:teuthology.orchestra.run.smithi119.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-17T06:08:13.730 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-17T06:08:13.763 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-17T06:08:13.788 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-17T06:08:13.793 INFO:teuthology.orchestra.run.smithi100.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-17T06:08:13.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-17T06:08:13.878 DEBUG:teuthology.orchestra.run.smithi100:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-17T06:08:13.904 DEBUG:teuthology.orchestra.run.smithi100:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-17T06:09:02.043 INFO:teuthology.orchestra.run.smithi100.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-17T06:09:31.136 INFO:teuthology.orchestra.run.smithi100.stderr: * [new branch] main -> origin/main 2023-11-17T06:09:31.261 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190312 -> 20190312 2023-11-17T06:09:31.261 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190416 -> 20190416 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190514 -> 20190514 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190618 -> 20190618 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190717 -> 20190717 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190815 -> 20190815 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20190923 -> 20190923 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20191022 -> 20191022 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20191215 -> 20191215 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200122 -> 20200122 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200316 -> 20200316 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200421 -> 20200421 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200519 -> 20200519 2023-11-17T06:09:31.262 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200619 -> 20200619 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200721 -> 20200721 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200817 -> 20200817 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20200918 -> 20200918 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20201022 -> 20201022 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20201118 -> 20201118 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20201218 -> 20201218 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210208 -> 20210208 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210315 -> 20210315 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210511 -> 20210511 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210716 -> 20210716 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210818 -> 20210818 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20210919 -> 20210919 2023-11-17T06:09:31.263 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20211027 -> 20211027 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20211216 -> 20211216 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220209 -> 20220209 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220310 -> 20220310 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220411 -> 20220411 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220509 -> 20220509 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220610 -> 20220610 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220708 -> 20220708 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220815 -> 20220815 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20220913 -> 20220913 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20221012 -> 20221012 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20221109 -> 20221109 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20221214 -> 20221214 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230117 -> 20230117 2023-11-17T06:09:31.264 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230210 -> 20230210 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230310 -> 20230310 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230404 -> 20230404 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230515 -> 20230515 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230625 -> 20230625 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230804 -> 20230804 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20230919 -> 20230919 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20231030 -> 20231030 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr: * [new tag] 20231111 -> 20231111 2023-11-17T06:09:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:Updating files: 52% (1699/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 66% (2173/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2654/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new branch] main -> origin/main 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190312 -> 20190312 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190416 -> 20190416 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190514 -> 20190514 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190618 -> 20190618 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190717 -> 20190717 2023-11-17T06:09:31.266 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190815 -> 20190815 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190923 -> 20190923 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191022 -> 20191022 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191215 -> 20191215 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200122 -> 20200122 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200316 -> 20200316 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200421 -> 20200421 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200519 -> 20200519 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200619 -> 20200619 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200721 -> 20200721 2023-11-17T06:09:31.267 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200817 -> 20200817 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200918 -> 20200918 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201022 -> 20201022 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201118 -> 20201118 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201218 -> 20201218 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210208 -> 20210208 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210315 -> 20210315 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210511 -> 20210511 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210716 -> 20210716 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210818 -> 20210818 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210919 -> 20210919 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211027 -> 20211027 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211216 -> 20211216 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220209 -> 20220209 2023-11-17T06:09:31.268 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220310 -> 20220310 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220411 -> 20220411 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220509 -> 20220509 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220610 -> 20220610 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220708 -> 20220708 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220815 -> 20220815 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220913 -> 20220913 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221012 -> 20221012 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221109 -> 20221109 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221214 -> 20221214 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230117 -> 20230117 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230210 -> 20230210 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230310 -> 20230310 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230404 -> 20230404 2023-11-17T06:09:31.269 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230515 -> 20230515 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230625 -> 20230625 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230804 -> 20230804 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230919 -> 20230919 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231030 -> 20231030 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231111 -> 20231111 2023-11-17T06:09:31.270 INFO:teuthology.orchestra.run.smithi119.stderr:Updating files: 51% (1685/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 66% (2149/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2654/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-17T06:09:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:HEAD is now at 6723a8d9 Merge branch 'robot/pr-5-1700153542' into 'main' 2023-11-17T06:09:31.271 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-17T06:09:31.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:09:31.274 INFO:teuthology.orchestra.run.smithi119.stdout:HEAD is now at 6723a8d9 Merge branch 'robot/pr-5-1700153542' into 'main' 2023-11-17T06:09:31.274 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-17T06:09:31.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:09:31.502 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:09:31.503 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-17T06:09:31.506 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2023-11-17T06:09:31.509 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:09:31.509 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-17T06:09:31.512 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-11-17T06:09:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17 06:09:33 URL:https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38918764/38918764] -> "/tmp/linux-image.deb" [1] 2023-11-17T06:09:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2023-11-17 06:09:33-- 2023-11-17T06:09:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 2.1s 2023-11-17T06:09:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 37M in 2.0s (18.9 MB/s) 2023-11-17T06:09:33.683 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-17T06:09:33.683 DEBUG:teuthology.orchestra.run.smithi119:> sudo dpkg -i /tmp/linux-image.deb 2023-11-17T06:09:33.998 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-17T06:09:35.798 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-17T06:09:35.806 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-17T06:09:36.003 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:09:37.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17 06:09:36 URL:https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38918764/38918764] -> "/tmp/linux-image.deb" [1] 2023-11-17T06:09:37.035 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2023-11-17 06:09:36-- 2023-11-17T06:09:37.035 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 5.5s 2023-11-17T06:09:37.035 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 37M in 5.2s (7.12 MB/s) 2023-11-17T06:09:37.036 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-17T06:09:37.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo dpkg -i /tmp/linux-image.deb 2023-11-17T06:09:38.027 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-17T06:09:50.145 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-17T06:09:50.219 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-17T06:09:50.702 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:09:53.674 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:09:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:09:53.804 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:09:53.936 INFO:teuthology.orchestra.run.smithi119.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:09.149 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:10:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:10:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-11-17T06:10:09.469 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:09.869 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:10:09.882 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:10:09.995 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:10:10.006 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:10:10.015 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-11-17T06:10:10.385 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:10.424 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:10.831 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:10:10.845 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:10:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-11-17T06:10:11.771 DEBUG:teuthology.orchestra.run.smithi100:> dpkg-deb -c /tmp/linux-image.deb 2023-11-17T06:10:11.780 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-17T06:10:11.780 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-17T06:10:11.782 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:11.797 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:11.797 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:11.820 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-17T06:10:11.821 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-17T06:10:11.822 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-17T06:10:11.823 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-17T06:10:11.823 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-17T06:10:11.823 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-17T06:10:11.823 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-17T06:10:11.823 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-17T06:10:11.824 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-17T06:10:11.824 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-17T06:10:11.826 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-17T06:10:11.827 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-17T06:10:11.827 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-17T06:10:11.827 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-17T06:10:12.211 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-17T06:10:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-17T06:10:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-17T06:10:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-17T06:10:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-17T06:10:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-17T06:10:12.217 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-17T06:10:12.218 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-17T06:10:12.219 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-17T06:10:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-17T06:10:12.221 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-17T06:10:12.222 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-17T06:10:12.223 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-17T06:10:12.224 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-17T06:10:12.225 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-17T06:10:12.226 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-17T06:10:12.227 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-17T06:10:12.228 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-17T06:10:12.229 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-17T06:10:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-17T06:10:12.231 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-17T06:10:12.232 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-17T06:10:12.233 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-17T06:10:12.234 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-17T06:10:12.235 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-17T06:10:12.236 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-17T06:10:12.237 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-17T06:10:12.238 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-17T06:10:12.239 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-17T06:10:12.240 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-17T06:10:12.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-17T06:10:12.241 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-17T06:10:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-17T06:10:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-17T06:10:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-17T06:10:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-17T06:10:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-17T06:10:12.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-17T06:10:12.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-17T06:10:12.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-17T06:10:12.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-17T06:10:12.246 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-17T06:10:12.248 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-17T06:10:12.249 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-17T06:10:12.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-17T06:10:12.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-17T06:10:12.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-17T06:10:12.250 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-17T06:10:12.251 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-17T06:10:12.252 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-17T06:10:12.253 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-17T06:10:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-17T06:10:12.255 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-17T06:10:12.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-17T06:10:12.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-17T06:10:12.256 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-17T06:10:12.291 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-17T06:10:12.292 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-17T06:10:12.293 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-17T06:10:12.294 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-17T06:10:12.295 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-17T06:10:12.296 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-17T06:10:12.297 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-17T06:10:12.298 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-17T06:10:12.298 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-17T06:10:12.298 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-17T06:10:12.298 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-17T06:10:12.300 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-17T06:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-17T06:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-17T06:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-17T06:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-17T06:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-17T06:10:12.326 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-17T06:10:12.326 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-17T06:10:12.326 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-17T06:10:12.326 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-17T06:10:12.326 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-17T06:10:12.327 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-17T06:10:12.328 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-17T06:10:12.328 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-17T06:10:12.328 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-17T06:10:12.328 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-17T06:10:12.328 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-17T06:10:12.329 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-17T06:10:12.329 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-17T06:10:12.356 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-17T06:10:12.356 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-17T06:10:12.356 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-17T06:10:12.357 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-17T06:10:12.358 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-17T06:10:12.359 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-17T06:10:12.360 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-17T06:10:12.390 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-17T06:10:12.391 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-17T06:10:12.392 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-17T06:10:12.393 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-17T06:10:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-17T06:10:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-17T06:10:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-17T06:10:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-17T06:10:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-17T06:10:12.395 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-17T06:10:12.396 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-17T06:10:12.396 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-17T06:10:12.396 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-17T06:10:12.396 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-17T06:10:12.397 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-17T06:10:12.398 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-17T06:10:12.398 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-17T06:10:12.398 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-17T06:10:12.398 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-17T06:10:12.398 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-17T06:10:12.399 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-17T06:10:12.399 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-17T06:10:12.399 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-17T06:10:12.399 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-17T06:10:12.399 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-17T06:10:12.400 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-17T06:10:12.401 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-17T06:10:12.402 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-17T06:10:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-17T06:10:12.405 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-17T06:10:12.405 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-17T06:10:12.405 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-17T06:10:12.405 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-17T06:10:12.406 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-17T06:10:12.406 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-17T06:10:12.406 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-17T06:10:12.407 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-17T06:10:12.407 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-17T06:10:12.408 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-17T06:10:12.408 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-17T06:10:12.408 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-17T06:10:12.409 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-17T06:10:12.409 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-17T06:10:12.410 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-17T06:10:12.410 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-17T06:10:12.411 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-17T06:10:12.412 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-17T06:10:12.413 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-17T06:10:12.414 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-17T06:10:12.415 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-17T06:10:12.416 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-17T06:10:12.417 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-17T06:10:12.418 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-17T06:10:12.419 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-17T06:10:12.420 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-17T06:10:12.421 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-17T06:10:12.422 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-17T06:10:12.423 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-17T06:10:12.424 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-17T06:10:12.425 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-17T06:10:12.426 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-17T06:10:12.427 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-17T06:10:12.428 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-17T06:10:12.428 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-17T06:10:12.429 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-17T06:10:12.430 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-17T06:10:12.430 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-17T06:10:12.431 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-17T06:10:12.432 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-17T06:10:12.433 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-17T06:10:12.433 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-17T06:10:12.434 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-17T06:10:12.435 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-17T06:10:12.436 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-17T06:10:12.437 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-17T06:10:12.438 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-17T06:10:12.438 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-17T06:10:12.439 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-17T06:10:12.440 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-17T06:10:12.441 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-17T06:10:12.442 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-17T06:10:12.442 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-17T06:10:12.443 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-17T06:10:12.444 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-17T06:10:12.445 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-17T06:10:12.446 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-17T06:10:12.447 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-17T06:10:12.447 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-17T06:10:12.448 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-17T06:10:12.448 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-17T06:10:12.449 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-17T06:10:12.450 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-17T06:10:12.450 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-17T06:10:12.451 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-17T06:10:12.452 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-17T06:10:12.452 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-17T06:10:12.452 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-17T06:10:12.452 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-17T06:10:12.452 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-17T06:10:12.453 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-17T06:10:12.454 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-17T06:10:12.454 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-17T06:10:12.454 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-17T06:10:12.454 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-17T06:10:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-17T06:10:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-17T06:10:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-17T06:10:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-17T06:10:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-17T06:10:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-17T06:10:12.457 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-17T06:10:12.457 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-17T06:10:12.457 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-17T06:10:12.457 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-17T06:10:12.457 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-17T06:10:12.458 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-17T06:10:12.458 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-17T06:10:12.458 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-17T06:10:12.458 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-17T06:10:12.458 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-17T06:10:12.459 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-17T06:10:12.460 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-17T06:10:12.460 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-17T06:10:12.460 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-17T06:10:12.460 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-17T06:10:12.460 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-17T06:10:12.461 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-17T06:10:12.462 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-17T06:10:12.462 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-17T06:10:12.462 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-17T06:10:12.462 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-17T06:10:12.462 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-17T06:10:12.463 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-17T06:10:12.463 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-17T06:10:12.463 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-17T06:10:12.463 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-17T06:10:12.463 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-17T06:10:12.464 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-17T06:10:12.464 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-17T06:10:12.464 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-17T06:10:12.464 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-17T06:10:12.464 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-17T06:10:12.465 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-17T06:10:12.466 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-17T06:10:12.466 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-17T06:10:12.466 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-17T06:10:12.466 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-17T06:10:12.467 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-17T06:10:12.468 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-17T06:10:12.468 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-17T06:10:12.468 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-17T06:10:12.468 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-17T06:10:12.468 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-17T06:10:12.469 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-17T06:10:12.470 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-17T06:10:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-17T06:10:12.472 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-17T06:10:12.473 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-17T06:10:12.473 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-17T06:10:12.473 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-17T06:10:12.473 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-17T06:10:12.473 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-17T06:10:12.474 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-17T06:10:12.475 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-17T06:10:12.476 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-17T06:10:12.477 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-17T06:10:12.478 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-17T06:10:12.479 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-17T06:10:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-17T06:10:12.481 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-17T06:10:12.481 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-17T06:10:12.481 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-17T06:10:12.481 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-17T06:10:12.481 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-17T06:10:12.482 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-17T06:10:12.483 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-17T06:10:12.484 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-17T06:10:12.485 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-17T06:10:12.486 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-17T06:10:12.487 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-17T06:10:12.488 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-17T06:10:12.489 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-17T06:10:12.490 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-17T06:10:12.491 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-17T06:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-17T06:10:12.493 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-17T06:10:12.495 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-17T06:10:12.496 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-17T06:10:12.496 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-17T06:10:12.496 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-17T06:10:12.496 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-17T06:10:12.496 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-17T06:10:12.497 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-17T06:10:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-17T06:10:12.530 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-17T06:10:12.531 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-17T06:10:12.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-17T06:10:12.533 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-17T06:10:12.546 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-17T06:10:12.547 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-17T06:10:12.548 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-17T06:10:12.549 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-17T06:10:12.550 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-17T06:10:12.550 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-17T06:10:12.550 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-17T06:10:12.550 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-17T06:10:12.550 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-17T06:10:12.553 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-17T06:10:12.553 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-17T06:10:12.553 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-17T06:10:12.553 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-17T06:10:12.553 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-17T06:10:12.554 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-17T06:10:12.554 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-17T06:10:12.588 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-17T06:10:12.589 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-17T06:10:12.590 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-17T06:10:12.590 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-17T06:10:12.590 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-17T06:10:12.590 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-17T06:10:12.593 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-17T06:10:12.594 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-17T06:10:12.594 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-17T06:10:12.594 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-17T06:10:12.594 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-17T06:10:12.594 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-17T06:10:12.612 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-17T06:10:12.613 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-17T06:10:12.614 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-17T06:10:12.614 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-17T06:10:12.614 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-17T06:10:12.614 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-17T06:10:12.614 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-17T06:10:12.616 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-17T06:10:12.616 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-17T06:10:12.616 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-17T06:10:12.616 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-17T06:10:12.617 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-17T06:10:12.618 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-17T06:10:12.618 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-17T06:10:12.618 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-17T06:10:12.618 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-17T06:10:12.644 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-17T06:10:12.645 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-17T06:10:12.646 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-17T06:10:12.647 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-17T06:10:12.647 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-17T06:10:12.647 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-17T06:10:12.647 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-17T06:10:12.648 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-17T06:10:12.648 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-17T06:10:12.654 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-17T06:10:12.655 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-17T06:10:12.656 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-17T06:10:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-17T06:10:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-17T06:10:12.683 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-17T06:10:12.684 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-17T06:10:12.685 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-17T06:10:12.686 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-17T06:10:12.688 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-17T06:10:12.689 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-17T06:10:12.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-17T06:10:12.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-17T06:10:12.690 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-17T06:10:12.694 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-17T06:10:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-17T06:10:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-17T06:10:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-17T06:10:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-17T06:10:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-17T06:10:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-17T06:10:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-17T06:10:12.716 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-17T06:10:12.717 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-17T06:10:12.718 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-17T06:10:12.719 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-17T06:10:12.720 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-17T06:10:12.721 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-17T06:10:12.843 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-17T06:10:12.843 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-17T06:10:12.843 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-17T06:10:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-17T06:10:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-17T06:10:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-17T06:10:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-17T06:10:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-17T06:10:12.845 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-17T06:10:12.846 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-17T06:10:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-17T06:10:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-17T06:10:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-17T06:10:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-17T06:10:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-17T06:10:12.848 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-17T06:10:12.848 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-17T06:10:12.848 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-17T06:10:12.849 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-17T06:10:12.850 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-17T06:10:12.850 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-17T06:10:12.850 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-17T06:10:12.850 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-17T06:10:12.850 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-17T06:10:12.851 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-17T06:10:12.852 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-17T06:10:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-17T06:10:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-17T06:10:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-17T06:10:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-17T06:10:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-17T06:10:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-17T06:10:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-17T06:10:12.856 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-17T06:10:12.857 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-17T06:10:12.858 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-17T06:10:12.858 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-17T06:10:12.865 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-17T06:10:12.865 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-17T06:10:12.866 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-17T06:10:12.870 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-17T06:10:12.870 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-17T06:10:12.870 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-17T06:10:12.870 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-17T06:10:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-17T06:10:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-17T06:10:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-17T06:10:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-17T06:10:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-17T06:10:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-17T06:10:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-17T06:10:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-17T06:10:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-17T06:10:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-17T06:10:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-17T06:10:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-17T06:10:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-17T06:10:12.895 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-17T06:10:12.895 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-17T06:10:12.895 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-17T06:10:12.895 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-17T06:10:12.896 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-17T06:10:12.897 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-17T06:10:12.898 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-17T06:10:12.899 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-17T06:10:12.900 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-17T06:10:12.901 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-17T06:10:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-17T06:10:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-17T06:10:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-17T06:10:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-17T06:10:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-17T06:10:12.903 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-17T06:10:12.904 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-17T06:10:12.905 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-17T06:10:12.906 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-17T06:10:12.906 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-17T06:10:12.939 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-17T06:10:12.940 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-17T06:10:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-17T06:10:12.942 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-17T06:10:12.943 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-17T06:10:12.944 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-17T06:10:12.944 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-17T06:10:12.944 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-17T06:10:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-17T06:10:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-17T06:10:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-17T06:10:12.979 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-17T06:10:12.980 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-17T06:10:12.981 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-17T06:10:12.982 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-17T06:10:12.983 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-17T06:10:12.984 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-17T06:10:12.985 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-17T06:10:12.986 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-17T06:10:12.986 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-17T06:10:12.986 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-17T06:10:13.010 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-17T06:10:13.010 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-17T06:10:13.010 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-17T06:10:13.010 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-17T06:10:13.011 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-17T06:10:13.012 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-17T06:10:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-17T06:10:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-17T06:10:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-17T06:10:13.013 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-17T06:10:13.022 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-17T06:10:13.023 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-17T06:10:13.024 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-17T06:10:13.025 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-17T06:10:13.026 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-17T06:10:13.027 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-17T06:10:13.028 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-17T06:10:13.029 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-17T06:10:13.030 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-17T06:10:13.030 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-17T06:10:13.030 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-17T06:10:13.030 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-17T06:10:13.050 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-17T06:10:13.050 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-17T06:10:13.050 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-17T06:10:13.050 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-17T06:10:13.051 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-17T06:10:13.052 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-17T06:10:13.053 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-17T06:10:13.054 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-17T06:10:13.054 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-17T06:10:13.054 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-17T06:10:13.054 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-17T06:10:13.078 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-17T06:10:13.078 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-17T06:10:13.078 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-17T06:10:13.078 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-17T06:10:13.078 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-17T06:10:13.079 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-17T06:10:13.080 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-17T06:10:13.081 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-17T06:10:13.082 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-17T06:10:13.083 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-17T06:10:13.084 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-17T06:10:13.085 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-17T06:10:13.086 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-17T06:10:13.086 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-17T06:10:13.086 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-17T06:10:13.106 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-17T06:10:13.106 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-17T06:10:13.106 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-17T06:10:13.106 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-17T06:10:13.106 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-17T06:10:13.107 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-17T06:10:13.108 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-17T06:10:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-17T06:10:13.110 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-17T06:10:13.111 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-17T06:10:13.112 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-17T06:10:13.113 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-17T06:10:13.114 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-17T06:10:13.114 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-17T06:10:13.114 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-17T06:10:13.114 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-17T06:10:13.114 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-17T06:10:13.126 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-17T06:10:13.127 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-17T06:10:13.128 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-17T06:10:13.129 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-17T06:10:13.129 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-17T06:10:13.129 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-17T06:10:13.129 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-17T06:10:13.129 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-17T06:10:13.162 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-17T06:10:13.163 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-17T06:10:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-17T06:10:13.165 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-17T06:10:13.166 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-17T06:10:13.167 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-17T06:10:13.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-17T06:10:13.265 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-17T06:10:13.266 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-17T06:10:13.267 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-17T06:10:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-17T06:10:13.269 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-17T06:10:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-17T06:10:13.271 INFO:teuthology.orchestra.run.smithi100.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:10:13.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 175 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-17T06:10:13.271 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-17T06:10:13.278 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.298 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.298 DEBUG:teuthology.orchestra.run.smithi100:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-17T06:10:13.300 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-11-17T06:10:13.300 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-deb -c /tmp/linux-image.deb 2023-11-17T06:10:13.308 INFO:teuthology.orchestra.run.smithi100.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:13.308 INFO:teuthology.orchestra.run.smithi100.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:13.308 INFO:teuthology.orchestra.run.smithi100.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:13.308 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-17T06:10:13.308 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.309 DEBUG:teuthology.orchestra.run.smithi100:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-17T06:10:13.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-17T06:10:13.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-17T06:10:13.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.311 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi100.front.sepia.ceph.com to complete... 2023-11-17T06:10:13.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:13.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-17T06:10:13.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-17T06:10:13.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-17T06:10:13.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-17T06:10:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-17T06:10:13.351 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-17T06:10:13.352 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-17T06:10:13.381 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-17T06:10:13.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-17T06:10:13.382 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-17T06:10:13.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-17T06:10:13.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-17T06:10:13.944 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:10:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:10:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-11-17T06:10:14.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-17T06:10:14.042 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-17T06:10:14.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-17T06:10:14.074 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-17T06:10:14.075 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-17T06:10:14.076 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-17T06:10:14.077 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-17T06:10:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-17T06:10:14.079 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-17T06:10:14.080 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-17T06:10:14.081 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-17T06:10:14.082 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-17T06:10:14.082 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-17T06:10:14.082 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-17T06:10:14.082 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-17T06:10:14.082 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-17T06:10:14.105 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-17T06:10:14.106 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-17T06:10:14.106 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-17T06:10:14.106 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-17T06:10:14.106 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-17T06:10:14.106 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-17T06:10:14.122 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-17T06:10:14.122 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-17T06:10:14.122 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-17T06:10:14.122 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-17T06:10:14.123 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-17T06:10:14.124 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-17T06:10:14.125 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-17T06:10:14.126 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-17T06:10:14.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-17T06:10:14.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-17T06:10:14.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-17T06:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-17T06:10:14.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-17T06:10:14.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-17T06:10:14.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-17T06:10:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-17T06:10:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-17T06:10:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-17T06:10:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-17T06:10:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-17T06:10:14.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-17T06:10:14.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-17T06:10:14.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-17T06:10:14.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-17T06:10:14.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-17T06:10:14.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-17T06:10:14.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-17T06:10:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-17T06:10:14.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-17T06:10:14.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-17T06:10:14.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-17T06:10:14.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-17T06:10:14.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-17T06:10:14.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-17T06:10:14.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-17T06:10:14.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-17T06:10:14.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-17T06:10:14.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-17T06:10:14.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-17T06:10:14.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-17T06:10:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-17T06:10:14.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-17T06:10:14.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-17T06:10:14.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-17T06:10:14.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-17T06:10:14.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-17T06:10:14.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-17T06:10:14.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-17T06:10:14.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-17T06:10:14.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-17T06:10:14.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-17T06:10:14.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-17T06:10:14.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-17T06:10:14.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-17T06:10:14.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-17T06:10:14.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-17T06:10:14.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-17T06:10:14.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-17T06:10:14.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-17T06:10:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-17T06:10:14.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-17T06:10:14.226 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-17T06:10:14.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-17T06:10:14.226 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-17T06:10:14.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-17T06:10:14.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-17T06:10:14.242 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-17T06:10:14.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-17T06:10:14.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-17T06:10:14.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-17T06:10:14.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-17T06:10:14.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-17T06:10:14.247 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-17T06:10:14.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-17T06:10:14.249 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-17T06:10:14.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-17T06:10:14.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-17T06:10:14.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-17T06:10:14.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-17T06:10:14.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-17T06:10:14.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-17T06:10:14.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-17T06:10:14.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-17T06:10:14.278 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-17T06:10:14.279 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-17T06:10:14.280 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-17T06:10:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-17T06:10:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-17T06:10:14.283 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-17T06:10:14.284 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-17T06:10:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-17T06:10:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-17T06:10:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-17T06:10:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-17T06:10:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-17T06:10:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-17T06:10:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-17T06:10:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-17T06:10:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-17T06:10:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-17T06:10:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-17T06:10:14.307 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-17T06:10:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-17T06:10:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-17T06:10:14.310 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-17T06:10:14.310 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-17T06:10:14.310 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-17T06:10:14.310 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-17T06:10:14.326 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-17T06:10:14.327 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-17T06:10:14.328 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-17T06:10:14.329 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-17T06:10:14.330 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-17T06:10:14.330 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-17T06:10:14.330 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-17T06:10:14.330 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-17T06:10:14.342 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-17T06:10:14.343 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-17T06:10:14.344 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-17T06:10:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-17T06:10:14.346 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-17T06:10:14.347 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-17T06:10:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-17T06:10:14.358 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-17T06:10:14.358 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-17T06:10:14.358 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-17T06:10:14.358 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-17T06:10:14.358 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-17T06:10:14.359 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-17T06:10:14.360 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-17T06:10:14.361 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-17T06:10:14.362 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-17T06:10:14.363 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-17T06:10:14.364 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-17T06:10:14.365 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-17T06:10:14.366 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-17T06:10:14.366 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-17T06:10:14.366 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-17T06:10:14.366 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-17T06:10:14.366 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-17T06:10:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-17T06:10:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-17T06:10:14.384 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-17T06:10:14.385 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-17T06:10:14.386 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-17T06:10:14.387 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-17T06:10:14.388 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-17T06:10:14.389 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-17T06:10:14.390 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-17T06:10:14.390 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-17T06:10:14.390 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-17T06:10:14.390 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-17T06:10:14.414 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-17T06:10:14.414 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-17T06:10:14.414 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-17T06:10:14.414 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-17T06:10:14.414 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-17T06:10:14.415 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-17T06:10:14.416 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-17T06:10:14.417 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-17T06:10:14.418 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-17T06:10:14.419 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-17T06:10:14.420 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-17T06:10:14.421 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-17T06:10:14.422 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-17T06:10:14.422 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-17T06:10:14.422 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-17T06:10:14.422 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-17T06:10:14.422 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-17T06:10:14.430 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-17T06:10:14.431 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-17T06:10:14.432 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-17T06:10:14.433 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-17T06:10:14.434 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-17T06:10:14.435 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-17T06:10:14.436 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-17T06:10:14.437 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-17T06:10:14.438 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-17T06:10:14.438 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-17T06:10:14.438 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-17T06:10:14.438 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-17T06:10:14.455 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-17T06:10:14.456 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-17T06:10:14.457 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-17T06:10:14.458 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-17T06:10:14.459 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-17T06:10:14.460 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-17T06:10:14.461 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-17T06:10:14.462 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-17T06:10:14.462 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-17T06:10:14.462 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-17T06:10:14.462 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-17T06:10:14.462 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-17T06:10:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-17T06:10:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-17T06:10:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-17T06:10:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-17T06:10:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-17T06:10:14.483 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-17T06:10:14.484 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-17T06:10:14.485 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-17T06:10:14.486 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-17T06:10:14.487 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-17T06:10:14.488 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-17T06:10:14.489 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-17T06:10:14.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-17T06:10:14.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-17T06:10:14.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-17T06:10:14.490 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-17T06:10:14.498 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-17T06:10:14.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-17T06:10:14.500 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-17T06:10:14.501 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-17T06:10:14.502 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-17T06:10:14.503 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-17T06:10:14.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-17T06:10:14.505 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-17T06:10:14.506 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-17T06:10:14.506 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-17T06:10:14.506 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-17T06:10:14.506 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-17T06:10:14.506 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-17T06:10:14.530 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-17T06:10:14.531 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-17T06:10:14.532 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-17T06:10:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-17T06:10:14.534 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-17T06:10:14.535 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-17T06:10:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-17T06:10:14.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-17T06:10:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-17T06:10:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-17T06:10:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-17T06:10:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-17T06:10:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-17T06:10:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-17T06:10:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-17T06:10:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-17T06:10:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-17T06:10:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-17T06:10:14.559 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-17T06:10:14.560 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-17T06:10:14.561 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-17T06:10:14.562 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-17T06:10:14.563 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-17T06:10:14.564 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-17T06:10:14.565 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-17T06:10:14.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-17T06:10:14.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-17T06:10:14.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-17T06:10:14.566 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-17T06:10:14.586 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-17T06:10:14.587 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-17T06:10:14.588 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-17T06:10:14.588 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-17T06:10:14.588 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-17T06:10:14.588 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-17T06:10:14.588 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-17T06:10:14.589 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-17T06:10:14.590 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-17T06:10:14.591 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-17T06:10:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-17T06:10:14.593 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-17T06:10:14.594 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-17T06:10:14.594 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-17T06:10:14.594 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-17T06:10:14.594 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-17T06:10:14.594 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-17T06:10:14.622 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-17T06:10:14.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-17T06:10:14.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-17T06:10:14.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-17T06:10:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-17T06:10:14.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-17T06:10:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-17T06:10:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-17T06:10:14.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-17T06:10:14.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-17T06:10:14.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-17T06:10:14.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-17T06:10:14.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-17T06:10:14.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-17T06:10:14.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-17T06:10:14.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-17T06:10:14.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-17T06:10:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-17T06:10:14.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-17T06:10:14.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-17T06:10:14.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-17T06:10:14.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-17T06:10:14.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-17T06:10:14.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-17T06:10:14.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-17T06:10:14.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-17T06:10:14.657 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-17T06:10:14.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-17T06:10:14.658 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-17T06:10:14.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-17T06:10:14.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-17T06:10:14.682 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-17T06:10:14.682 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-17T06:10:14.682 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-17T06:10:14.682 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-17T06:10:14.682 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-17T06:10:14.683 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-17T06:10:14.684 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 175 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-17T06:10:14.685 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-17T06:10:14.686 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:14.686 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:14.686 DEBUG:teuthology.orchestra.run.smithi119:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-17T06:10:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:10:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:10:14.707 INFO:teuthology.orchestra.run.smithi119.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:14.708 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:14.708 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:10:14.708 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-17T06:10:14.708 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:14.709 DEBUG:teuthology.orchestra.run.smithi119:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-17T06:10:14.718 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-11-17T06:10:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-11-17T06:10:15.446 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:10:15.456 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:10:15.479 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-11-17T06:10:15.775 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:15.790 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:10:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:10:16.208 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:10:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-11-17T06:10:46.446 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-17T06:10:46.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:10:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:10:48.054 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-17T06:10:48.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:10:48.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:11:04.955 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-17T06:11:06.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-17T06:11:13.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:11:13.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:11:15.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:11:15.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:11:17.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-11-17T06:11:18.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-17T06:11:29.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:11:29.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:11:30.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:11:30.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:11:33.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-11-17T06:11:48.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:12:13.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:12:13.777 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-11-17T06:12:13.799 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-11-17T06:12:14.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:12:14.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-17T06:12:14.471 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-11-17T06:12:14.533 INFO:teuthology.orchestra.run.smithi119.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:14.533 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:14.533 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-17T06:12:14.533 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-17T06:12:14.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:12:14.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-17T06:12:14.535 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-11-17T06:12:14.596 INFO:teuthology.orchestra.run.smithi100.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:14.596 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:14.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-17T06:12:14.596 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-17T06:12:15.533 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-17T06:12:15.534 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-17T06:12:15.598 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-17T06:12:15.598 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-17T06:12:15.639 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-11-17T06:12:15.707 DEBUG:teuthology.parallel:result is None 2023-11-17T06:12:15.718 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2023-11-17T06:12:15.755 DEBUG:teuthology.parallel:result is None 2023-11-17T06:12:15.755 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-17T06:12:15.764 INFO:teuthology.task.internal:Creating test directory... 2023-11-17T06:12:15.764 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-17T06:12:15.771 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-17T06:12:15.798 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-17T06:12:15.805 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-17T06:12:15.815 INFO:teuthology.task.internal:Creating archive directory... 2023-11-17T06:12:15.815 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-17T06:12:15.835 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-17T06:12:15.904 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-17T06:12:15.912 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-17T06:12:15.912 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-17T06:12:15.922 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:12:15.976 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:12:15.986 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:12:16.007 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:12:16.011 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-17T06:12:16.018 INFO:teuthology.task.internal:Configuring sudo... 2023-11-17T06:12:16.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-17T06:12:16.031 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-17T06:12:16.091 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-17T06:12:16.110 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-17T06:12:16.110 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-17T06:12:16.121 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-17T06:12:16.154 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-17T06:12:16.199 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-17T06:12:16.272 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:12:16.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-17T06:12:16.363 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-17T06:12:16.389 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-17T06:12:16.452 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:12:16.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-17T06:12:16.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2023-11-17T06:12:16.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-11-17T06:12:16.704 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-17T06:12:16.713 INFO:teuthology.task.internal:Starting timer... 2023-11-17T06:12:16.713 INFO:teuthology.run_tasks:Running task pcp... 2023-11-17T06:12:16.727 INFO:teuthology.run_tasks:Running task selinux... 2023-11-17T06:12:16.743 DEBUG:teuthology.task.selinux:Excluding smithi100: OS 'ubuntu' does not support SELinux 2023-11-17T06:12:16.743 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2023-11-17T06:12:16.778 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-17T06:12:16.779 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-17T06:12:16.779 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-17T06:12:16.779 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-17T06:12:16.792 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-17T06:12:16.844 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-17T06:12:17.121 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-17T06:12:17.195 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-17T06:12:17.196 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-17T06:22:38.455 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-11-17T06:22:38.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:22:38.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:22:38.562 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-11-17T06:22:38.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-11-17T06:22:38.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:22:38.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:22:38.902 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-11-17T06:22:39.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-11-17T06:22:39.123 INFO:teuthology.run_tasks:Running task clock... 2023-11-17T06:22:39.134 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-17T06:22:39.134 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-17T06:22:39.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:22:39.141 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-17T06:22:39.142 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:22:39.210 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-17T06:22:39.210 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Command line: ntpd -gq 2023-11-17T06:22:39.212 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: proto: precision = 0.043 usec (-24) 2023-11-17T06:22:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:22:39.212 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:22:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:22:39.213 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen and drop on 0 v6wildcard [::]:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen normally on 2 lo 127.0.0.1:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen normally on 3 enp3s0f1 172.21.15.100:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen normally on 4 lo [::1]:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d733%5]:123 2023-11-17T06:22:39.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:39 ntpd[23447]: Listening on routing socket on fd #22 for interface updates 2023-11-17T06:22:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-17T06:22:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Command line: ntpd -gq 2023-11-17T06:22:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: proto: precision = 0.042 usec (-24) 2023-11-17T06:22:39.246 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:22:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:22:39.248 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen and drop on 0 v6wildcard [::]:123 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen normally on 2 lo 127.0.0.1:123 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen normally on 4 lo [::1]:123 2023-11-17T06:22:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2023-11-17T06:22:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:39 ntpd[23445]: Listening on routing socket on fd #22 for interface updates 2023-11-17T06:22:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:40 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:41 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:41 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:42.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:42 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:42.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:42 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:43.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:43.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:43.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:43.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:43.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:43.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:43 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:43.245 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:43.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:43.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:43.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:43.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:43.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:43 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:44.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:44.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:44 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:44 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:45.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:45.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:45 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:45.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:45.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:45.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:45.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:45.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:45.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:45 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:46 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.246 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:46.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:46.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:46.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:46.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:46.247 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:46.248 INFO:teuthology.orchestra.run.smithi119.stdout:17 Nov 06:22:46 ntpd[23445]: ntpd: time slew +0.001020 s 2023-11-17T06:22:46.248 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew +0.001020s 2023-11-17T06:22:46.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-17T06:22:46.248 INFO:teuthology.orchestra.run.smithi119.stderr:17 Nov 06:22:46 ntpd[23445]: can't open /var/log/ntpstats/loopstats.20231117: Permission denied 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:46.386 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:47 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:48.212 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:22:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:22:48.214 INFO:teuthology.orchestra.run.smithi100.stdout:17 Nov 06:22:48 ntpd[23447]: ntpd: time slew -0.000960 s 2023-11-17T06:22:48.214 INFO:teuthology.orchestra.run.smithi100.stdout:ntpd: time slew -0.000960s 2023-11-17T06:22:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-17T06:22:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:17 Nov 06:22:48 ntpd[23447]: can't open /var/log/ntpstats/loopstats.20231117: Permission denied 2023-11-17T06:22:48.365 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:22:48.365 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2023-11-17T06:22:48.366 INFO:teuthology.orchestra.run.smithi100.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:48.366 INFO:teuthology.orchestra.run.smithi100.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:48.366 INFO:teuthology.orchestra.run.smithi100.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:48.366 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:22:48.367 INFO:teuthology.run_tasks:Running task install... 2023-11-17T06:22:48.376 DEBUG:teuthology.task.install:project ceph 2023-11-17T06:22:48.377 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}} 2023-11-17T06:22:48.377 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'} 2023-11-17T06:22:48.377 INFO:teuthology.task.install:Using flavor: default 2023-11-17T06:22:48.384 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-17T06:22:48.384 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-17T06:22:48.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-key list | grep Ceph 2023-11-17T06:22:48.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2023-11-17T06:22:48.617 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-17T06:22:48.637 INFO:teuthology.orchestra.run.smithi100.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-17T06:22:48.755 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-17T06:22:48.755 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2023-11-17T06:22:48.758 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-17T06:22:48.758 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-17T06:22:48.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:22:48.787 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-17T06:22:48.787 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph.com (release key) 2023-11-17T06:22:48.790 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-17T06:22:48.790 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-17T06:22:48.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:22:48.941 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default/ 2023-11-17T06:22:48.941 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:22:48.980 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default/ 2023-11-17T06:22:48.980 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:22:49.110 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:22:49.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-17T06:22:49.128 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:22:49.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-17T06:22:49.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2023-11-17T06:22:49.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-11-17T06:22:49.525 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal InRelease 2023-11-17T06:22:49.572 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-17T06:22:49.572 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-17T06:22:49.584 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-17T06:22:49.584 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal InRelease 2023-11-17T06:22:49.596 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release.gpg 2023-11-17T06:22:49.621 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-11-17T06:22:49.621 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-17T06:22:49.653 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-17T06:22:49.660 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release.gpg 2023-11-17T06:22:49.705 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main i386 Packages [3,402 B] 2023-11-17T06:22:49.720 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-11-17T06:22:49.786 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main i386 Packages [3,402 B] 2023-11-17T06:22:49.933 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-17T06:22:49.953 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-17T06:22:49.974 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-17T06:22:49.979 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-17T06:22:51.059 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 28.5 kB in 2s (18.4 kB/s) 2023-11-17T06:22:52.268 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-11-17T06:22:52.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1focal cephadm=18.0.0-6612-g895e5ada-1focal ceph-mds=18.0.0-6612-g895e5ada-1focal ceph-mgr=18.0.0-6612-g895e5ada-1focal ceph-common=18.0.0-6612-g895e5ada-1focal ceph-fuse=18.0.0-6612-g895e5ada-1focal ceph-test=18.0.0-6612-g895e5ada-1focal ceph-volume=18.0.0-6612-g895e5ada-1focal radosgw=18.0.0-6612-g895e5ada-1focal python3-rados=18.0.0-6612-g895e5ada-1focal python3-rgw=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal python3-rbd=18.0.0-6612-g895e5ada-1focal libcephfs2=18.0.0-6612-g895e5ada-1focal libcephfs-dev=18.0.0-6612-g895e5ada-1focal librados2=18.0.0-6612-g895e5ada-1focal librbd1=18.0.0-6612-g895e5ada-1focal rbd-fuse=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal cephfs-shell=18.0.0-6612-g895e5ada-1focal cephfs-top=18.0.0-6612-g895e5ada-1focal cephfs-mirror=18.0.0-6612-g895e5ada-1focal 2023-11-17T06:22:52.428 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-11-17T06:22:52.629 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-11-17T06:22:52.630 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-11-17T06:22:52.826 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:22:52.827 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:22:52.828 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:22:52.828 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-11-17T06:22:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-17T06:22:52.828 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-17T06:22:52.829 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:22:52.830 INFO:teuthology.orchestra.run.smithi100.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-17T06:22:52.831 INFO:teuthology.orchestra.run.smithi100.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-17T06:22:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-17T06:22:52.832 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2023-11-17T06:22:52.832 INFO:teuthology.orchestra.run.smithi100.stdout: btrfs-tools 2023-11-17T06:22:53.050 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-11-17T06:23:23.074 INFO:teuthology.orchestra.run.smithi100.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-17T06:23:23.074 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-17T06:23:23.074 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-17T06:23:23.074 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-17T06:23:23.074 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-17T06:23:23.075 INFO:teuthology.orchestra.run.smithi100.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-17T06:23:23.075 INFO:teuthology.orchestra.run.smithi100.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-17T06:23:23.077 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-17T06:23:23.078 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 142 kB in 10s (13.6 kB/s) 2023-11-17T06:23:23.078 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-11-17T06:23:23.078 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1focal cephadm=18.0.0-6612-g895e5ada-1focal ceph-mds=18.0.0-6612-g895e5ada-1focal ceph-mgr=18.0.0-6612-g895e5ada-1focal ceph-common=18.0.0-6612-g895e5ada-1focal ceph-fuse=18.0.0-6612-g895e5ada-1focal ceph-test=18.0.0-6612-g895e5ada-1focal ceph-volume=18.0.0-6612-g895e5ada-1focal radosgw=18.0.0-6612-g895e5ada-1focal python3-rados=18.0.0-6612-g895e5ada-1focal python3-rgw=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal python3-rbd=18.0.0-6612-g895e5ada-1focal libcephfs2=18.0.0-6612-g895e5ada-1focal libcephfs-dev=18.0.0-6612-g895e5ada-1focal librados2=18.0.0-6612-g895e5ada-1focal librbd1=18.0.0-6612-g895e5ada-1focal rbd-fuse=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal cephfs-shell=18.0.0-6612-g895e5ada-1focal cephfs-top=18.0.0-6612-g895e5ada-1focal cephfs-mirror=18.0.0-6612-g895e5ada-1focal 2023-11-17T06:23:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-17T06:23:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 librbd1 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 211 MB of archives. 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-17T06:23:23.106 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-17T06:23:23.107 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1focal [3,602 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1focal [4,063 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1focal [753 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1focal [387 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1focal [31.9 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1focal [200 kB] 2023-11-17T06:23:23.108 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1focal [61.1 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1focal [364 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1focal [6,940 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1focal [113 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1focal [474 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1focal [25.8 MB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1focal [11.0 MB] 2023-11-17T06:23:23.109 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-17T06:23:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-17T06:23:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-17T06:23:23.112 INFO:teuthology.orchestra.run.smithi100.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-17T06:23:23.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-17T06:23:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1focal [234 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1focal [145 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1focal [1,584 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1focal [9,402 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1focal [31.6 MB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-17T06:23:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-17T06:23:23.116 INFO:teuthology.orchestra.run.smithi100.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1focal [13.6 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1focal [864 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1focal [2,285 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1focal [282 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1focal [136 kB] 2023-11-17T06:23:23.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1focal [1,840 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1focal [7,903 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1focal [13.8 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1focal [51.1 MB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1focal [118 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1focal [267 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1focal [32.9 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1focal [22.7 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1focal [37.3 kB] 2023-11-17T06:23:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1focal [14.1 MB] 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1focal [106 kB] 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 211 MB in 9s (23.5 MB/s) 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:23:23.119 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cmd2. 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-17T06:23:23.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../010-librbd1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs2. 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rados. 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cephfs. 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-prettytable. 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rbd. 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-17T06:23:23.124 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librgw2. 2023-11-17T06:23:23.125 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../022-librgw2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rgw. 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liboath0. 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-17T06:23:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libradosstriper1. 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-common. 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-base. 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-17T06:23:23.127 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-natsort. 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-logutils. 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-17T06:23:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-mako. 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-17T06:23:23.129 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:23:23.209 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-11-17T06:23:23.376 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-17T06:23:23.406 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-17T06:23:23.412 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-11-17T06:23:23.413 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-11-17T06:23:23.459 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:23:23.605 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:23:23.605 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-17T06:23:23.606 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-17T06:23:23.607 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:23.608 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-17T06:23:23.609 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-17T06:23:23.610 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2023-11-17T06:23:23.610 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2023-11-17T06:23:23.814 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-11-17T06:23:23.814 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-17T06:23:23.814 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-17T06:23:23.814 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-17T06:23:23.815 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-17T06:23:23.815 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-17T06:23:23.815 INFO:teuthology.orchestra.run.smithi119.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-17T06:23:23.815 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-17T06:23:23.816 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:23.817 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:23.818 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-17T06:23:23.818 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2023-11-17T06:23:23.818 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 librbd1 2023-11-17T06:23:23.820 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-17T06:23:23.838 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-17T06:23:23.878 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:23:23.907 INFO:teuthology.orchestra.run.smithi119.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-17T06:23:23.907 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 211 MB of archives. 2023-11-17T06:23:23.907 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-11-17T06:23:23.907 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-17T06:23:23.927 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-17T06:23:23.934 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-17T06:23:23.962 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-17T06:23:23.991 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-17T06:23:23.994 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-17T06:23:24.007 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-17T06:23:24.054 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-17T06:23:24.058 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-17T06:23:24.066 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-17T06:23:24.069 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-17T06:23:24.069 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-17T06:23:24.070 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-17T06:23:24.071 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-17T06:23:24.074 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1focal [3,602 kB] 2023-11-17T06:23:24.075 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-17T06:23:24.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-17T06:23:24.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-17T06:23:24.089 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-17T06:23:24.090 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-17T06:23:24.091 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-17T06:23:24.092 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-17T06:23:24.093 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-17T06:23:24.093 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-17T06:23:24.106 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-17T06:23:24.107 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-17T06:23:24.114 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-17T06:23:24.156 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-17T06:23:24.158 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-17T06:23:24.158 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-17T06:23:24.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-17T06:23:24.160 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-17T06:23:24.162 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-17T06:23:24.163 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-17T06:23:24.173 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-17T06:23:24.174 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-17T06:23:24.175 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-17T06:23:24.231 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webob. 2023-11-17T06:23:24.251 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-17T06:23:24.281 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-17T06:23:24.297 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-17T06:23:24.302 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-17T06:23:24.304 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-17T06:23:24.323 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-17T06:23:24.324 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-17T06:23:24.325 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-17T06:23:24.326 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-17T06:23:24.327 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-17T06:23:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-17T06:23:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-17T06:23:24.330 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-17T06:23:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-17T06:23:24.348 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-17T06:23:24.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-17T06:23:24.357 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-17T06:23:24.359 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-17T06:23:24.360 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-17T06:23:24.363 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-17T06:23:24.366 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-17T06:23:24.366 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-17T06:23:24.387 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-17T06:23:24.390 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-17T06:23:24.393 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1focal [4,063 kB] 2023-11-17T06:23:24.393 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-17T06:23:24.445 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-17T06:23:24.446 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-17T06:23:24.446 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-17T06:23:24.447 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-17T06:23:24.447 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-17T06:23:24.448 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-17T06:23:24.462 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-17T06:23:24.462 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-17T06:23:24.463 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-17T06:23:24.463 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-17T06:23:24.479 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-17T06:23:24.482 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-17T06:23:24.483 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-17T06:23:24.487 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-17T06:23:24.488 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-17T06:23:24.521 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1focal [753 kB] 2023-11-17T06:23:24.543 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1focal [387 kB] 2023-11-17T06:23:24.555 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1focal [31.9 kB] 2023-11-17T06:23:24.556 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1focal [200 kB] 2023-11-17T06:23:24.563 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1focal [61.1 kB] 2023-11-17T06:23:24.565 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1focal [364 kB] 2023-11-17T06:23:24.577 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1focal [6,940 kB] 2023-11-17T06:23:24.692 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-17T06:23:24.712 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-17T06:23:24.750 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:23:24.809 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1focal [113 kB] 2023-11-17T06:23:24.810 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1focal [474 kB] 2023-11-17T06:23:24.824 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1focal [25.8 MB] 2023-11-17T06:23:25.120 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bs4. 2023-11-17T06:23:25.138 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-17T06:23:25.187 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-17T06:23:25.589 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-waitress. 2023-11-17T06:23:25.610 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-17T06:23:25.646 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:23:25.693 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1focal [11.0 MB] 2023-11-17T06:23:26.049 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1focal [234 kB] 2023-11-17T06:23:26.052 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1focal [145 kB] 2023-11-17T06:23:26.056 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1focal [1,584 kB] 2023-11-17T06:23:26.109 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1focal [9,402 kB] 2023-11-17T06:23:26.422 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1focal [31.6 MB] 2023-11-17T06:23:26.718 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-tempita. 2023-11-17T06:23:26.736 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-17T06:23:26.776 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-17T06:23:27.137 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-paste. 2023-11-17T06:23:27.159 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-17T06:23:27.203 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:23:27.466 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1focal [13.6 kB] 2023-11-17T06:23:27.467 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1focal [864 kB] 2023-11-17T06:23:27.481 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1focal [2,285 kB] 2023-11-17T06:23:27.557 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1focal [282 kB] 2023-11-17T06:23:27.565 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1focal [136 kB] 2023-11-17T06:23:27.570 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1focal [1,840 kB] 2023-11-17T06:23:27.574 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-17T06:23:27.595 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-17T06:23:27.631 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1focal [7,903 kB] 2023-11-17T06:23:27.657 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:23:27.894 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1focal [13.8 kB] 2023-11-17T06:23:27.894 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1focal [51.1 MB] 2023-11-17T06:23:28.030 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-17T06:23:28.046 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-17T06:23:28.084 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:23:28.473 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webtest. 2023-11-17T06:23:28.497 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-17T06:23:28.544 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-17T06:23:28.957 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pecan. 2023-11-17T06:23:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-17T06:23:29.015 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:23:29.412 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-17T06:23:29.430 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-17T06:23:29.470 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:23:29.585 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1focal [118 kB] 2023-11-17T06:23:29.586 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1focal [267 kB] 2023-11-17T06:23:29.588 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1focal [32.9 kB] 2023-11-17T06:23:29.589 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1focal [22.7 kB] 2023-11-17T06:23:29.589 INFO:teuthology.orchestra.run.smithi119.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1focal [37.3 kB] 2023-11-17T06:23:29.590 INFO:teuthology.orchestra.run.smithi119.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1focal [14.1 MB] 2023-11-17T06:23:29.831 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-17T06:23:29.851 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:29.889 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:30.048 INFO:teuthology.orchestra.run.smithi119.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1focal [106 kB] 2023-11-17T06:23:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-17T06:23:30.373 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:30.411 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:30.755 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cryptography. 2023-11-17T06:23:30.773 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-17T06:23:30.813 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:23:30.986 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 211 MB in 6s (34.0 MB/s) 2023-11-17T06:23:31.156 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-17T06:23:31.229 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-17T06:23:31.232 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-17T06:23:31.259 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-openssl. 2023-11-17T06:23:31.277 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-17T06:23:31.277 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-17T06:23:31.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-17T06:23:31.671 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-17T06:23:31.693 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-17T06:23:31.712 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr. 2023-11-17T06:23:31.734 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:31.737 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:23:31.778 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:32.091 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2023-11-17T06:23:32.110 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-17T06:23:32.148 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:23:32.323 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mon. 2023-11-17T06:23:32.337 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:32.381 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:32.560 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-17T06:23:32.580 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-17T06:23:32.660 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:23:33.047 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-17T06:23:33.068 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-17T06:23:33.147 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:23:33.558 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-17T06:23:33.579 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-17T06:23:33.616 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:23:33.693 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-osd. 2023-11-17T06:23:33.713 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:33.776 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:34.095 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-17T06:23:34.115 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:34.176 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:34.731 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-17T06:23:34.752 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:34.814 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:35.251 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-17T06:23:35.269 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:23:35.309 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:23:35.704 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-17T06:23:35.716 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-17T06:23:35.762 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:23:36.165 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-librbd1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:36.281 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:23:36.546 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph. 2023-11-17T06:23:36.570 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../053-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:36.614 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:37.332 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:37.366 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-fuse. 2023-11-17T06:23:37.385 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:37.423 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:37.461 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:23:37.902 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mds. 2023-11-17T06:23:37.922 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:37.959 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:38.258 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2023-11-17T06:23:38.276 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:38.315 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:38.563 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephadm. 2023-11-17T06:23:38.582 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../056-cephadm_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:38.692 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2023-11-17T06:23:38.709 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:38.751 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:38.999 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-17T06:23:39.019 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-17T06:23:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-17T06:23:39.112 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-17T06:23:39.132 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:39.452 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jinja2. 2023-11-17T06:23:39.464 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2023-11-17T06:23:39.472 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-17T06:23:39.481 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:39.518 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-17T06:23:39.522 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:39.913 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-17T06:23:39.916 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-17T06:23:39.930 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:39.936 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:39.970 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:39.974 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:40.386 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2023-11-17T06:23:40.404 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-17T06:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-17T06:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-17T06:23:40.444 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-17T06:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:23:40.764 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2023-11-17T06:23:40.783 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:40.822 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:40.842 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jwt. 2023-11-17T06:23:40.863 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-17T06:23:40.908 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:23:41.200 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-17T06:23:41.217 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-17T06:23:41.253 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-17T06:23:41.257 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:23:41.273 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-11-17T06:23:41.302 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-17T06:23:41.605 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-underscore. 2023-11-17T06:23:41.626 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-17T06:23:41.669 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-17T06:23:41.671 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:23:41.682 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-17T06:23:41.719 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:23:41.983 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-17T06:23:42.003 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-17T06:23:42.040 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:23:42.064 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-17T06:23:42.081 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-17T06:23:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:23:42.418 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-routes. 2023-11-17T06:23:42.439 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-11-17T06:23:42.476 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-17T06:23:42.533 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2023-11-17T06:23:42.546 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-librgw2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:42.591 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:42.888 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-17T06:23:42.908 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:42.945 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:43.525 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-decorator. 2023-11-17T06:23:43.545 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-17T06:23:43.577 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2023-11-17T06:23:43.583 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:23:43.595 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:43.635 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:43.902 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-17T06:23:43.917 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-17T06:23:43.952 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:23:44.022 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0. 2023-11-17T06:23:44.041 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-17T06:23:44.071 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-17T06:23:44.315 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-scipy. 2023-11-17T06:23:44.328 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-17T06:23:44.373 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-17T06:23:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2023-11-17T06:23:44.441 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:44.482 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:45.061 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2023-11-17T06:23:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:45.118 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:45.850 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-17T06:23:45.870 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-17T06:23:45.908 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:23:46.512 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-joblib. 2023-11-17T06:23:46.532 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-11-17T06:23:46.611 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-17T06:23:47.048 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn. 2023-11-17T06:23:47.070 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-17T06:23:47.114 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:23:47.791 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2023-11-17T06:23:47.811 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:23:47.887 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:47.915 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-17T06:23:47.936 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:23:47.973 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:23:49.210 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cachetools. 2023-11-17T06:23:49.228 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-11-17T06:23:49.245 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-17T06:23:49.264 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-17T06:23:49.293 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-17T06:23:49.348 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:23:49.679 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-17T06:23:49.702 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-17T06:23:49.745 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:23:49.756 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2023-11-17T06:23:49.774 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-17T06:23:49.814 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-17T06:23:50.173 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-17T06:23:50.195 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-17T06:23:50.218 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2023-11-17T06:23:50.238 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-17T06:23:50.240 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:23:50.276 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-17T06:23:50.595 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-17T06:23:50.617 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-17T06:23:50.643 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rsa. 2023-11-17T06:23:50.653 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:23:50.662 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-11-17T06:23:50.700 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-17T06:23:50.948 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2023-11-17T06:23:50.969 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-17T06:23:51.031 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:23:51.088 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-google-auth. 2023-11-17T06:23:51.108 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-11-17T06:23:51.178 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-17T06:23:51.376 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-17T06:23:51.396 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-17T06:23:51.459 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:23:51.565 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-blinker. 2023-11-17T06:23:51.580 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-17T06:23:51.623 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:23:51.845 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-17T06:23:51.865 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-17T06:23:51.903 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:23:51.993 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-17T06:23:52.012 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-17T06:23:52.051 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:23:52.206 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2023-11-17T06:23:52.219 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-17T06:23:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-17T06:23:52.565 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-17T06:24:01.122 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-17T06:24:01.122 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:24:01.122 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-websocket. 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:01.123 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:01.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package jq. 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package socat. 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package xmlstarlet. 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-test. 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.171 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-17T06:24:01.171 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-17T06:24:01.171 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:24:01.171 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bs4. 2023-11-17T06:24:01.171 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-17T06:24:01.172 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-17T06:24:01.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cryptography. 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-17T06:24:01.174 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:01.175 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.444 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-volume. 2023-11-17T06:24:01.466 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:01.510 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:01.948 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-17T06:24:01.969 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:02.417 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-colorama. 2023-11-17T06:24:02.430 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-17T06:24:02.475 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-17T06:24:02.786 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-shell. 2023-11-17T06:24:02.801 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:02.844 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:03.165 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-top. 2023-11-17T06:24:03.187 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:03.230 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:03.550 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-17T06:24:03.571 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:03.608 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:03.728 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2023-11-17T06:24:03.749 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:03.786 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.164 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2023-11-17T06:24:04.182 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:04.221 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.229 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-17T06:24:04.250 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:04.295 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.667 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2023-11-17T06:24:04.688 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:04.724 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.740 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package nvme-cli. 2023-11-17T06:24:04.761 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-17T06:24:04.838 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:24:05.187 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-17T06:24:05.207 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-17T06:24:05.253 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:24:05.333 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2023-11-17T06:24:05.353 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-cephadm_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:05.402 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:05.682 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-17T06:24:05.702 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:05.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-17T06:24:05.726 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-17T06:24:05.739 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-17T06:24:06.200 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2023-11-17T06:24:06.220 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-17T06:24:06.258 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-17T06:24:06.652 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-17T06:24:06.672 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:06.709 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:07.105 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-17T06:24:07.127 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-17T06:24:07.171 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:24:07.532 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jwt. 2023-11-17T06:24:07.552 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-17T06:24:07.790 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:24:08.130 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-17T06:24:08.147 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-11-17T06:24:08.160 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-17T06:24:08.182 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-17T06:24:08.184 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-17T06:24:08.226 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-17T06:24:08.488 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-underscore. 2023-11-17T06:24:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-17T06:24:08.554 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:24:08.596 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-17T06:24:08.615 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-17T06:24:08.654 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:24:08.898 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-17T06:24:08.919 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-17T06:24:08.964 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:24:09.040 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-attr. 2023-11-17T06:24:09.061 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-11-17T06:24:09.106 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-17T06:24:09.334 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2023-11-17T06:24:09.356 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-11-17T06:24:09.392 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-17T06:24:09.495 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webencodings. 2023-11-17T06:24:09.518 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-17T06:24:09.552 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:24:09.796 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-17T06:24:09.817 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:09.862 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-html5lib. 2023-11-17T06:24:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-11-17T06:24:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-17T06:24:10.351 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-17T06:24:10.368 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-17T06:24:10.441 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:24:10.469 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-decorator. 2023-11-17T06:24:10.492 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-17T06:24:10.535 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:24:10.905 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-17T06:24:10.923 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-17T06:24:10.953 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-packaging. 2023-11-17T06:24:10.963 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:24:10.974 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-11-17T06:24:11.019 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-17T06:24:11.333 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-scipy. 2023-11-17T06:24:11.354 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-17T06:24:11.398 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastescript. 2023-11-17T06:24:11.399 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-17T06:24:11.419 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-11-17T06:24:11.456 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-17T06:24:11.843 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pluggy. 2023-11-17T06:24:11.862 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-11-17T06:24:11.900 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-17T06:24:12.245 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-psutil. 2023-11-17T06:24:12.264 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-17T06:24:12.324 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:24:12.740 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-py. 2023-11-17T06:24:12.759 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-17T06:24:12.797 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:24:12.949 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-17T06:24:12.969 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-17T06:24:13.014 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:13.318 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-17T06:24:13.340 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-17T06:24:13.384 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:24:13.602 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2023-11-17T06:24:13.623 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-11-17T06:24:13.660 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-17T06:24:13.737 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pytest. 2023-11-17T06:24:13.766 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-11-17T06:24:13.802 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-17T06:24:14.073 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2023-11-17T06:24:14.092 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-17T06:24:14.163 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:14.207 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplejson. 2023-11-17T06:24:14.226 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-17T06:24:14.289 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:24:14.654 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-17T06:24:14.672 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-17T06:24:14.717 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:24:14.980 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-17T06:24:14.998 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:15.038 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:15.496 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package radosgw. 2023-11-17T06:24:15.518 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../116-radosgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:15.562 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:16.308 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2023-11-17T06:24:16.328 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-11-17T06:24:16.399 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-17T06:24:16.744 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-17T06:24:16.764 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-17T06:24:16.835 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:24:17.024 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package rbd-fuse. 2023-11-17T06:24:17.047 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:17.089 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:17.255 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-17T06:24:17.277 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-17T06:24:17.313 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:24:17.460 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-17T06:24:17.699 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2023-11-17T06:24:17.717 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-11-17T06:24:17.757 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-17T06:24:17.861 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:24:18.021 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:24:18.147 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:24:18.160 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2023-11-17T06:24:18.180 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-11-17T06:24:18.218 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-17T06:24:18.407 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:18.588 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-blinker. 2023-11-17T06:24:18.606 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-17T06:24:18.646 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:24:19.016 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-17T06:24:19.037 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-17T06:24:19.074 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:24:19.121 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user cephadm....done 2023-11-17T06:24:19.297 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:19.447 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:24:19.573 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-17T06:24:19.593 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-17T06:24:19.630 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:24:19.883 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-17T06:24:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2023-11-17T06:24:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-17T06:24:20.083 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:24:20.242 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:20.368 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-17T06:24:20.487 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-17T06:24:20.494 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:24:20.508 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-17T06:24:20.586 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:24:20.904 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-17T06:24:21.259 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-17T06:24:21.281 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:21.325 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:21.414 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:24:21.711 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-17T06:24:21.732 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-11-17T06:24:21.774 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-17T06:24:21.777 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:24:22.147 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-17T06:24:22.150 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-17T06:24:22.165 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:22.230 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:22.534 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:24:22.542 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2023-11-17T06:24:22.560 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:22.599 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:24:22.911 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2023-11-17T06:24:22.931 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-11-17T06:24:22.977 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-17T06:24:23.303 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:23.356 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2023-11-17T06:24:23.373 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-17T06:24:23.413 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:23.690 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:23.801 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2023-11-17T06:24:23.813 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-17T06:24:23.822 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:23.892 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:24.181 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:24:24.541 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:24:24.892 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:24:25.018 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:24:25.455 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-17T06:24:25.807 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:24:26.158 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:24:26.575 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:24:26.926 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-17T06:24:27.336 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-17T06:24:27.697 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-17T06:24:28.065 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:24:28.191 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:24:28.263 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2023-11-17T06:24:28.282 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:28.321 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:28.358 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:24:28.701 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:24:28.750 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-17T06:24:28.769 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:28.808 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:29.186 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:24:29.196 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2023-11-17T06:24:29.217 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-17T06:24:29.253 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-17T06:24:29.548 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2023-11-17T06:24:29.562 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:24:29.568 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:29.606 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:29.942 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2023-11-17T06:24:29.960 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:30.000 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:30.016 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:24:30.278 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-17T06:24:30.300 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:30.368 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:30.476 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-17T06:24:30.627 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:30.957 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-17T06:24:30.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:31.014 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:31.028 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:31.171 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-17T06:24:31.468 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2023-11-17T06:24:31.487 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-17T06:24:31.559 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:24:31.606 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:24:31.765 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:31.891 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-17T06:24:31.918 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-17T06:24:31.939 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-17T06:24:32.025 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:24:32.242 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:24:32.470 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-17T06:24:32.490 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:32.528 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:32.653 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:32.779 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:24:32.938 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:24:33.365 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:24:33.726 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-17T06:24:34.092 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:24:34.218 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:24:34.536 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-17T06:24:34.557 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-17T06:24:34.561 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-17T06:24:34.602 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-17T06:24:34.920 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:24:35.016 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-17T06:24:35.037 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-17T06:24:35.082 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:24:35.296 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:24:35.419 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-attr. 2023-11-17T06:24:35.439 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-11-17T06:24:35.468 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-17T06:24:35.653 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-17T06:24:35.846 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webencodings. 2023-11-17T06:24:35.866 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-17T06:24:35.912 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:24:35.999 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:24:36.125 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:24:36.249 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-html5lib. 2023-11-17T06:24:36.266 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-11-17T06:24:36.306 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-17T06:24:36.517 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:24:36.668 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-17T06:24:36.689 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-17T06:24:36.734 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:24:36.952 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:24:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:24:37.229 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-17T06:24:37.229 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-packaging. 2023-11-17T06:24:37.248 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-11-17T06:24:37.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-17T06:24:37.639 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:24:37.648 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2023-11-17T06:24:37.671 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-11-17T06:24:37.714 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-17T06:24:38.007 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-17T06:24:38.119 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2023-11-17T06:24:38.139 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-11-17T06:24:38.176 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-17T06:24:38.963 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2023-11-17T06:24:38.986 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-17T06:24:39.049 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:24:39.424 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2023-11-17T06:24:39.442 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-17T06:24:39.506 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:24:39.837 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:39.915 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-17T06:24:39.934 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-17T06:24:39.971 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-17T06:24:39.984 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:24:40.354 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2023-11-17T06:24:40.368 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-11-17T06:24:40.412 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-17T06:24:40.439 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-17T06:24:40.791 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2023-11-17T06:24:40.810 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-17T06:24:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:24:40.874 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:24:41.202 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-17T06:24:41.223 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-17T06:24:41.268 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:24:41.283 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:41.442 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-17T06:24:41.844 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:24:42.047 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2023-11-17T06:24:42.060 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../116-radosgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:42.105 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:42.237 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-17T06:24:42.714 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:24:43.123 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:43.567 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2023-11-17T06:24:43.584 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:43.624 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:44.012 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-17T06:24:44.412 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:24:44.421 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:24:44.546 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-17T06:24:44.580 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:24:44.672 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:44.731 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:24:44.831 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-17T06:24:44.991 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:45.199 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:24:45.325 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-17T06:24:45.684 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:24:45.706 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2023-11-17T06:24:45.922 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:46.048 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:24:46.053 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-17T06:24:46.470 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:24:46.492 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-17T06:24:46.834 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:46.914 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:46.960 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-17T06:24:47.136 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:24:47.184 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:24:47.310 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:47.455 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:47.530 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-17T06:24:47.587 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:47.730 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-17T06:24:48.065 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:24:48.089 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:48.241 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-17T06:24:48.408 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-17T06:24:48.650 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:48.759 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-17T06:24:48.910 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:49.077 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:49.136 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:24:52.284 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:24:52.284 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.284 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:52.284 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.285 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.286 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.286 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.286 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.407 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.565 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:24:52.917 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:24:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:Adding group ceph....done 2023-11-17T06:24:53.343 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:24:53.560 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user ceph....done 2023-11-17T06:24:53.719 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-17T06:24:53.767 INFO:teuthology.orchestra.run.smithi100.stdout:Setting system user ceph properties....done 2023-11-17T06:24:53.806 INFO:teuthology.orchestra.run.smithi100.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-17T06:24:54.025 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-17T06:24:54.137 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-17T06:24:54.521 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-17T06:24:54.587 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-17T06:24:54.889 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:24:55.040 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:24:55.177 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:24:55.484 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:55.545 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:24:55.768 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:24:55.768 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:24:56.021 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:24:56.389 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:24:56.602 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:56.770 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:56.832 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:24:57.267 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-17T06:24:57.393 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:57.486 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:24:57.487 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:24:57.860 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:58.012 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-17T06:24:58.288 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:58.439 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:24:58.565 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:58.733 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-17T06:24:58.808 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-17T06:24:59.135 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:24:59.536 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:59.662 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:24:59.683 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:25:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:25:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:25:00.189 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:25:00.557 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-17T06:25:00.858 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:00.916 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:25:01.042 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:25:01.158 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:25:01.159 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:25:01.393 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-17T06:25:01.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:02.121 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:25:02.483 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-17T06:25:02.875 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:25:02.883 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:25:02.884 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:25:03.001 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:25:03.402 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:25:03.722 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:03.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:25:03.847 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:03.955 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:25:04.023 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:04.114 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-17T06:25:04.354 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:25:04.355 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:25:04.533 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:25:04.884 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-17T06:25:05.192 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:05.343 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:05.469 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:05.654 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:06.099 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:25:06.250 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:25:06.714 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:25:06.751 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:25:06.840 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-17T06:25:07.317 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-17T06:25:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:25:08.120 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:08.279 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-17T06:25:08.697 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:25:12.317 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-17T06:25:12.571 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:25:12.816 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:25:12.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-17T06:25:12.931 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-17T06:25:12.952 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-11-17T06:25:13.157 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-11-17T06:25:13.157 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-11-17T06:25:13.315 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:25:13.349 INFO:teuthology.orchestra.run.smithi100.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:25:13.350 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:25:13.351 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-11-17T06:25:13.352 INFO:teuthology.orchestra.run.smithi100.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-17T06:25:13.352 INFO:teuthology.orchestra.run.smithi100.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-17T06:25:13.352 INFO:teuthology.orchestra.run.smithi100.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-17T06:25:13.352 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-17T06:25:13.352 INFO:teuthology.orchestra.run.smithi100.stdout: usb-modeswitch-data wpasupplicant 2023-11-17T06:25:13.353 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-11-17T06:25:13.353 INFO:teuthology.orchestra.run.smithi100.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-17T06:25:13.353 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-17T06:25:13.353 INFO:teuthology.orchestra.run.smithi100.stdout: libengine-pkcs11-openssl 2023-11-17T06:25:13.452 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-11-17T06:25:13.453 INFO:teuthology.orchestra.run.smithi100.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-17T06:25:13.453 INFO:teuthology.orchestra.run.smithi100.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-17T06:25:13.453 INFO:teuthology.orchestra.run.smithi100.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-17T06:25:13.453 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-17T06:25:13.453 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-17T06:25:13.454 INFO:teuthology.orchestra.run.smithi100.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-17T06:25:13.454 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-11-17T06:25:13.455 INFO:teuthology.orchestra.run.smithi100.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-17T06:25:13.759 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.600 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:25:20.601 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.601 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.601 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.601 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-17T06:25:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-17T06:25:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:25:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:25:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi100.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 25.3 MB of archives. 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-17T06:25:20.613 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-17T06:25:20.613 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-17T06:25:20.613 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-17T06:25:20.613 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-17T06:25:20.614 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-17T06:25:20.614 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-17T06:25:20.615 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-17T06:25:20.648 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2023-11-17T06:25:20.684 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-17T06:25:20.891 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-17T06:25:20.931 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-17T06:25:21.095 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-17T06:25:21.178 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-17T06:25:21.178 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-17T06:25:21.295 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-17T06:25:21.448 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-17T06:25:21.965 INFO:teuthology.orchestra.run.smithi100.stdout:Preconfiguring packages ... 2023-11-17T06:25:22.204 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 25.3 MB in 8s (3,193 kB/s) 2023-11-17T06:25:22.422 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:22.544 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:25:22.548 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:25:22.686 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:25:22.686 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:25:22.731 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:25:23.516 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:23.666 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:24.363 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:25:24.364 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:25:24.395 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-17T06:25:25.185 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:25.739 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-17T06:25:26.401 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:25:26.404 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:25:26.532 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:25:26.628 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:26.909 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:25:26.909 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:25:27.000 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:25:27.188 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:25:27.611 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:25:27.813 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:28.096 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:25:28.096 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:25:28.145 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:25:28.148 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:25:28.296 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:25:28.847 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:25:28.906 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:29.010 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:25:29.534 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:25:29.664 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-17T06:25:29.714 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:25:29.715 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:25:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-17T06:25:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-17T06:25:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:25:30.600 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:30.721 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package dump. 2023-11-17T06:25:30.739 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-17T06:25:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking dump (0.4b46-6) ... 2023-11-17T06:25:30.784 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:30.935 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:31.150 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package indent. 2023-11-17T06:25:31.168 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:25:31.202 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:25:31.202 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:25:31.207 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:25:31.553 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-17T06:25:31.589 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-17T06:25:31.652 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:25:32.048 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-17T06:25:32.069 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-17T06:25:32.095 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:32.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:25:32.246 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:32.397 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:32.442 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-17T06:25:32.463 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:25:32.508 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:25:32.548 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:32.911 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-17T06:25:32.933 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:25:32.978 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:25:33.001 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:25:33.161 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:25:33.331 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-17T06:25:33.353 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:25:33.397 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:25:33.704 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:25:33.808 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-17T06:25:33.827 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:25:33.866 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:25:34.270 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-17T06:25:34.290 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-17T06:25:34.361 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:25:34.756 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-17T06:25:34.777 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:25:34.822 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:25:35.309 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-17T06:26:30.283 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-17T06:26:30.287 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:26:30.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-17T06:26:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package modemmanager. 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package wpasupplicant. 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-17T06:26:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package network-manager. 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ppp. 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package pptp-linux. 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-17T06:26:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-common. 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-12. 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql. 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client. 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:26:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:Adding user postgres to group ssl-cert 2023-11-17T06:26:30.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Removing obsolete dictionary files: 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up dump (0.4b46-6) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:26:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:26:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:26:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:26:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:30.348 INFO:teuthology.orchestra.run.smithi100.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi100.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi100.stdout:This user must also own the server process. 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi100.stdout:The database cluster will be initialized with locale "en_US". 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout:The default text search configuration will be set to "english". 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout:Data page checksums are disabled. 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi100.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi100.stdout:creating subdirectories ... ok 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi100.stdout:selecting dynamic shared memory implementation ... posix 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default max_connections ... 100 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default shared_buffers ... 128MB 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default time zone ... Etc/UTC 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:creating configuration files ... ok 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:running bootstrap script ... ok 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:performing post-bootstrap initialization ... ok 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:syncing data to disk ... ok 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:Success. You can now start the database server using: 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout: pg_ctlcluster 12 main start 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi100.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:which means they are currently configured by ifupdown: 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:- enp3s0f1 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout:remove their configuration from /etc/network/interfaces. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-17T06:26:30.356 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:26:30.357 DEBUG:teuthology.parallel:result is None 2023-11-17T06:26:30.421 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-11-17T06:26:30.623 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-11-17T06:26:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-17T06:26:30.818 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-17T06:26:30.819 INFO:teuthology.orchestra.run.smithi119.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-17T06:26:30.820 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-17T06:26:30.820 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch-data wpasupplicant 2023-11-17T06:26:30.821 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-11-17T06:26:30.821 INFO:teuthology.orchestra.run.smithi119.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-17T06:26:30.821 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-17T06:26:30.821 INFO:teuthology.orchestra.run.smithi119.stdout: libengine-pkcs11-openssl 2023-11-17T06:26:30.921 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-11-17T06:26:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-17T06:26:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-17T06:26:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-17T06:26:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-17T06:26:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-17T06:26:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-17T06:26:30.922 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2023-11-17T06:26:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-17T06:26:31.016 INFO:teuthology.orchestra.run.smithi119.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-17T06:26:31.016 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 25.3 MB of archives. 2023-11-17T06:26:31.016 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-17T06:26:31.016 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-17T06:26:31.172 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-17T06:26:31.175 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-17T06:26:31.177 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-17T06:26:31.182 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-17T06:26:31.183 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-17T06:26:31.201 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-17T06:26:31.202 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-17T06:26:31.205 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-17T06:26:31.206 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-17T06:26:31.206 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-17T06:26:31.210 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-17T06:26:31.212 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-17T06:26:31.215 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-17T06:26:31.216 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-17T06:26:31.230 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-17T06:26:31.231 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-17T06:26:31.237 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-17T06:26:31.239 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-17T06:26:31.248 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-17T06:26:31.248 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-17T06:26:31.265 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-17T06:26:31.265 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-17T06:26:31.275 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-17T06:26:31.291 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-17T06:26:31.311 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-17T06:26:31.318 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-17T06:26:31.318 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-17T06:26:31.319 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-17T06:26:31.320 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-17T06:26:31.333 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-17T06:26:31.335 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-17T06:26:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-17T06:26:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-17T06:26:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-17T06:26:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-17T06:26:31.538 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-17T06:26:32.079 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2023-11-17T06:26:32.319 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 25.3 MB in 1s (41.7 MB/s) 2023-11-17T06:26:32.662 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:32.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:32.847 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:34.506 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:36.506 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:36.509 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:36.707 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:37.184 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:37.355 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:37.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:38.270 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:38.273 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:38.431 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:38.969 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:39.102 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:39.677 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b46-6) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.321 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-17T06:26:44.342 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-17T06:26:44.387 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:26:44.765 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-17T06:26:44.784 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:44.823 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:45.251 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-17T06:26:45.270 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:45.310 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:45.713 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-17T06:26:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:45.779 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.148 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-17T06:26:46.171 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:46.215 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.501 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-17T06:26:46.519 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:46.559 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:47.496 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-17T06:26:47.515 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-17T06:26:47.579 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:26:48.041 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2023-11-17T06:26:48.055 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:48.123 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:48.813 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2023-11-17T06:26:48.828 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-17T06:26:48.871 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:49.494 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2023-11-17T06:26:49.513 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:50.392 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-17T06:26:54.256 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-common. 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-17T06:26:54.257 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-12. 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:54.319 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:55.956 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql. 2023-11-17T06:26:55.969 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.015 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-17T06:26:56.301 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client. 2023-11-17T06:26:56.322 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.384 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:26:56.661 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-17T06:26:56.684 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.754 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:26:57.047 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-17T06:26:57.066 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-17T06:26:57.104 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-17T06:26:57.579 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-17T06:26:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-17T06:26:57.661 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:26:57.996 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:58.214 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:58.708 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:58.876 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:59.002 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:59.472 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:26:59.472 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:27:00.356 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:02.506 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-17T06:27:02.652 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:27:02.778 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:27:02.904 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-17T06:27:04.176 INFO:teuthology.orchestra.run.smithi119.stdout:Adding user postgres to group ssl-cert 2023-11-17T06:27:04.584 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:04.584 INFO:teuthology.orchestra.run.smithi119.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-17T06:27:05.071 INFO:teuthology.orchestra.run.smithi119.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-17T06:27:05.071 INFO:teuthology.orchestra.run.smithi119.stdout:Removing obsolete dictionary files: 2023-11-17T06:27:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-17T06:27:07.039 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:27:07.190 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-17T06:27:07.316 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:07.446 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:27:08.738 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-17T06:27:09.165 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b46-6) ... 2023-11-17T06:27:09.323 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-17T06:27:09.392 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:09.517 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:27:09.677 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:27:09.803 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:27:09.987 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:27:10.138 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:10.640 INFO:teuthology.orchestra.run.smithi119.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-17T06:27:10.682 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-17T06:27:10.754 INFO:teuthology.orchestra.run.smithi119.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-17T06:27:10.754 INFO:teuthology.orchestra.run.smithi119.stdout:This user must also own the server process. 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:The database cluster will be initialized with locale "en_US". 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:The default text search configuration will be set to "english". 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:Data page checksums are disabled. 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-17T06:27:10.758 INFO:teuthology.orchestra.run.smithi119.stdout:creating subdirectories ... ok 2023-11-17T06:27:10.758 INFO:teuthology.orchestra.run.smithi119.stdout:selecting dynamic shared memory implementation ... posix 2023-11-17T06:27:10.794 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default max_connections ... 100 2023-11-17T06:27:10.840 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default shared_buffers ... 128MB 2023-11-17T06:27:10.863 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default time zone ... Etc/UTC 2023-11-17T06:27:10.864 INFO:teuthology.orchestra.run.smithi119.stdout:creating configuration files ... ok 2023-11-17T06:27:11.050 INFO:teuthology.orchestra.run.smithi119.stdout:running bootstrap script ... ok 2023-11-17T06:27:11.681 INFO:teuthology.orchestra.run.smithi119.stdout:performing post-bootstrap initialization ... ok 2023-11-17T06:27:12.312 INFO:teuthology.orchestra.run.smithi119.stdout:syncing data to disk ... ok 2023-11-17T06:27:12.312 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:12.312 INFO:teuthology.orchestra.run.smithi119.stdout:Success. You can now start the database server using: 2023-11-17T06:27:12.313 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:12.313 INFO:teuthology.orchestra.run.smithi119.stdout: pg_ctlcluster 12 main start 2023-11-17T06:27:12.313 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:12.880 INFO:teuthology.orchestra.run.smithi119.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-17T06:27:12.880 INFO:teuthology.orchestra.run.smithi119.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-17T06:27:13.105 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-17T06:27:16.788 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:16.914 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:17.048 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-17T06:27:17.250 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:17.376 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:27:17.510 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2023-11-17T06:27:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:19.368 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-17T06:27:19.901 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-17T06:27:20.870 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-17T06:27:21.829 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:21.964 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-17T06:27:22.124 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:22.300 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:27:22.426 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-17T06:27:22.552 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:22.711 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:22.837 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:24.098 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-17T06:27:24.208 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-17T06:27:24.392 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:27:24.552 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:27:25.078 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:27:38.749 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-17T06:27:38.891 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-17T06:27:40.139 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:27:40.145 DEBUG:teuthology.parallel:result is None 2023-11-17T06:27:40.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:27:40.546 DEBUG:teuthology.orchestra.run.smithi100:> dpkg-query -W -f '${Version}' ceph 2023-11-17T06:27:40.584 INFO:teuthology.orchestra.run.smithi100.stdout:18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:40.584 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:40.584 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1focal is installed. 2023-11-17T06:27:40.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:27:41.001 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2023-11-17T06:27:41.039 INFO:teuthology.orchestra.run.smithi119.stdout:18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:41.039 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:41.039 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1focal is installed. 2023-11-17T06:27:41.039 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-17T06:27:41.040 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:41.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-17T06:27:41.077 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:41.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-17T06:27:41.116 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-17T06:27:41.116 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:41.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2023-11-17T06:27:41.150 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-17T06:27:41.225 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:41.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-11-17T06:27:41.260 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-17T06:27:41.334 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-17T06:27:41.334 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:41.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-17T06:27:41.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-17T06:27:41.445 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:41.445 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-17T06:27:41.479 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-17T06:27:41.554 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-17T06:27:41.554 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:41.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2023-11-17T06:27:41.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-17T06:27:41.661 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:41.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-11-17T06:27:41.698 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-17T06:27:41.778 INFO:teuthology.run_tasks:Running task ceph... 2023-11-17T06:27:41.847 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-17T06:27:41.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2023-11-17T06:27:41.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2023-11-17T06:27:41.890 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-17T06:27:41.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-17T06:27:41.936 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-17T06:27:41.968 INFO:tasks.ceph:Creating extra log directories... 2023-11-17T06:27:41.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-17T06:27:42.012 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-17T06:27:42.078 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-17T06:27:42.078 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-17T06:27:42.078 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-17T06:27:42.078 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:42.078 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-17T06:27:42.105 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-17T06:27:42.227 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:42.227 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-17T06:27:42.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-17T06:27:42.386 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-17T06:27:42.386 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-17T06:27:42.386 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339', 'branch': 'wip-57087-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7461339', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-57087-3'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-57087-3', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 20, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1441, 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-57087-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-17_05:53:21', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587'} 2023-11-17T06:27:42.387 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-17T06:27:42.394 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-17T06:27:42.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2023-11-17T06:27:42.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2023-11-17T06:27:42.500 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:42.500 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2023-11-17T06:27:42.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-17T06:27:42.551 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2023-11-17T06:27:42.612 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-11-17 06:20:05.953109208 +0000 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-11-17 06:20:05.497119746 +0000 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-11-17 06:20:05.497119746 +0000 2023-11-17T06:27:42.613 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-11-17T06:27:42.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-17T06:27:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-11-17T06:27:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-11-17T06:27:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000682612 s, 750 kB/s 2023-11-17T06:27:42.688 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-17T06:27:42.753 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2023-11-17T06:27:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-17T06:27:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:42.813 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-11-17T06:27:42.813 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:42.814 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-11-17 06:20:06.729091277 +0000 2023-11-17T06:27:42.814 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-11-17 06:20:06.245102461 +0000 2023-11-17T06:27:42.814 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-11-17 06:20:06.245102461 +0000 2023-11-17T06:27:42.814 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-11-17T06:27:42.814 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-17T06:27:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-11-17T06:27:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-11-17T06:27:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000696258 s, 735 kB/s 2023-11-17T06:27:42.887 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-17T06:27:42.957 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-11-17 06:20:07.517073069 +0000 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-11-17 06:20:07.037084160 +0000 2023-11-17T06:27:43.017 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-11-17 06:20:07.037084160 +0000 2023-11-17T06:27:43.018 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-11-17T06:27:43.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-17T06:27:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-11-17T06:27:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-11-17T06:27:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000647581 s, 791 kB/s 2023-11-17T06:27:43.092 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-17T06:27:43.163 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2023-11-17T06:27:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-11-17 06:20:08.289055230 +0000 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-11-17 06:20:07.809066321 +0000 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-11-17 06:20:07.809066321 +0000 2023-11-17T06:27:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-11-17T06:27:43.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-17T06:27:43.299 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-11-17T06:27:43.300 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-11-17T06:27:43.300 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000511414 s, 1.0 MB/s 2023-11-17T06:27:43.302 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-17T06:27:43.369 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:43.369 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:43.369 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-11-17T06:27:43.386 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-17T06:27:43.386 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-11-17 06:20:21.617787565 +0000 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-11-17 06:20:21.137798804 +0000 2023-11-17T06:27:43.446 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-11-17 06:20:21.137798804 +0000 2023-11-17T06:27:43.447 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-11-17T06:27:43.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-17T06:27:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-11-17T06:27:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-11-17T06:27:43.521 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000660905 s, 775 kB/s 2023-11-17T06:27:43.523 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-17T06:27:43.590 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-11-17T06:27:43.650 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-11-17 06:20:22.437768367 +0000 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-11-17 06:20:21.921780448 +0000 2023-11-17T06:27:43.651 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-11-17 06:20:21.921780448 +0000 2023-11-17T06:27:43.652 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-11-17T06:27:43.652 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-17T06:27:43.727 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-11-17T06:27:43.728 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-11-17T06:27:43.728 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000678907 s, 754 kB/s 2023-11-17T06:27:43.730 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-17T06:27:43.799 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-11-17 06:20:23.213750201 +0000 2023-11-17T06:27:43.862 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-11-17 06:20:22.737761344 +0000 2023-11-17T06:27:43.863 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-11-17 06:20:22.737761344 +0000 2023-11-17T06:27:43.863 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-11-17T06:27:43.863 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-17T06:27:43.935 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-11-17T06:27:43.936 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-11-17T06:27:43.936 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000683601 s, 749 kB/s 2023-11-17T06:27:43.938 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-17T06:27:44.004 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-11-17T06:27:44.069 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-17T06:27:44.069 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-11-17 06:20:24.001731753 +0000 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-11-17 06:20:23.493743646 +0000 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-11-17 06:20:23.493743646 +0000 2023-11-17T06:27:44.070 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2023-11-17T06:27:44.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-17T06:27:44.150 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-11-17T06:27:44.150 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-11-17T06:27:44.150 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000633222 s, 809 kB/s 2023-11-17T06:27:44.153 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-17T06:27:44.222 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:44.223 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-17T06:27:44.223 INFO:tasks.ceph:Generating config... 2023-11-17T06:27:44.224 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-17T06:27:44.224 INFO:tasks.ceph:[client] debug client = 20 2023-11-17T06:27:44.224 INFO:tasks.ceph:[client] debug ms = 1 2023-11-17T06:27:44.224 INFO:tasks.ceph:[client] pid file = 2023-11-17T06:27:44.224 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-17T06:27:44.225 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-17T06:27:44.225 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-17T06:27:44.226 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-17T06:27:44.226 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-17T06:27:44.226 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-17T06:27:44.226 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-17T06:27:44.226 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-17T06:27:44.226 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-17T06:27:44.227 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-17T06:27:44.227 INFO:tasks.ceph:Setting up mon.a... 2023-11-17T06:27:44.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-17T06:27:44.297 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2023-11-17T06:27:44.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-17T06:27:44.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:44.438 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2023-11-17T06:27:44.439 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-17T06:27:44.440 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:44.440 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-17T06:27:44.499 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:44.618 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = pacific 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2023-11-17T06:27:44.617962+0000 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-11-17T06:27:44.617962+0000 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 16 (pacific) 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2023-11-17T06:27:44.619 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2023-11-17T06:27:44.620 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2023-11-17T06:27:44.620 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-17T06:27:44.622 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-17T06:27:44.642 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 85721606-40d2-46b5-8d45-5c90fa8b3283... 2023-11-17T06:27:44.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:27:44.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2023-11-17T06:27:44.764 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:27:44.765 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:27:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:27:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2023-11-17T06:27:44.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.769 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:44.771 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2023-11-17T06:27:44.772 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:27:44.774 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2023-11-17T06:27:44.775 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:27:44.776 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:27:44.777 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-11-17T06:27:44.777 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-11-17T06:27:44.777 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:27:44.777 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.778 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-11-17T06:27:44.779 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-11-17T06:27:44.780 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-11-17T06:27:44.781 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-11-17T06:27:44.782 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-11-17T06:27:44.783 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.784 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-11-17T06:27:44.785 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.786 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-11-17T06:27:44.787 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-11-17T06:27:44.788 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-11-17T06:27:44.789 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-11-17T06:27:44.790 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:27:44.790 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:27:44.790 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:27:44.801 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-17T06:27:44.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-17T06:27:44.925 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-17T06:27:44.925 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:44.925 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-17T06:27:44.944 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:44.944 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-17T06:27:45.002 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:27:45.003 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:45.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-17T06:27:45.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:45.113 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:27:45.113 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:45.172 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:27:45.172 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:45.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-17T06:27:45.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:45.234 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:27:45.234 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:45.292 INFO:tasks.ceph:Setting up mon nodes... 2023-11-17T06:27:45.293 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-17T06:27:45.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-17T06:27:45.395 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-17T06:27:45.402 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-17T06:27:45.501 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-17T06:27:45.527 INFO:tasks.ceph:Setting up mds nodes... 2023-11-17T06:27:45.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-17T06:27:45.630 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-17T06:27:45.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-17T06:27:45.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-17T06:27:45.816 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-17T06:27:45.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-17T06:27:45.857 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-17T06:27:45.959 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-17T06:27:45.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-17T06:27:46.000 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-17T06:27:46.137 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-17T06:27:46.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-17T06:27:46.177 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-17T06:27:46.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-17T06:27:46.245 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-17T06:27:46.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-17T06:27:46.349 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-17T06:27:46.372 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-17T06:27:46.448 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-17T06:27:46.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-17T06:27:46.542 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-17T06:27:46.571 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-17T06:27:46.572 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-17T06:27:46.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:46.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:46.605 INFO:tasks.ceph:role: osd.0 2023-11-17T06:27:46.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:27:46.605 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-17T06:27:47.187 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:47.188 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:47.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-11-17T06:27:47.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:47.291 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:47.318 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:47.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:47.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:47.396 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:47.396 INFO:tasks.ceph:role: osd.1 2023-11-17T06:27:47.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:27:47.396 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-17T06:27:47.907 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:47.908 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:47.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-11-17T06:27:47.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:47.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:48.021 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:48.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:48.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:48.103 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:48.104 INFO:tasks.ceph:role: osd.2 2023-11-17T06:27:48.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:27:48.104 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-17T06:27:48.650 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:48.650 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:48.650 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:48.650 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:48.651 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:48.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-11-17T06:27:48.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:48.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:48.765 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:48.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:48.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:48.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:48.851 INFO:tasks.ceph:role: osd.3 2023-11-17T06:27:48.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:27:48.851 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:49.440 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:49.441 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:49.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-11-17T06:27:49.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:49.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:49.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:49.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.731+0000 7f73cddaf700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-17T06:27:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.735+0000 7f73cddaf700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-17T06:27:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.735+0000 7f73cddaf700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.735+0000 7f73cddaf700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.735+0000 7f73cddaf700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:49.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:49.747+0000 7f73cddaf700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-17T06:27:53.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:53.105 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:53.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.231+0000 7fbc1e2a0700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-17T06:27:53.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.235+0000 7fbc1e2a0700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-17T06:27:53.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.235+0000 7fbc1e2a0700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:53.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.235+0000 7fbc1e2a0700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:53.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.235+0000 7fbc1e2a0700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:53.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:53.235+0000 7fbc1e2a0700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-17T06:27:56.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:56.351 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.479+0000 7f07b3acb700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-17T06:27:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.479+0000 7f07b3acb700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-17T06:27:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.479+0000 7f07b3acb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.479+0000 7f07b3acb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.479+0000 7f07b3acb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:56.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:56.483+0000 7f07b3acb700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-17T06:27:59.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:59.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:59.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.687+0000 7fa5edd7e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-17T06:27:59.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.687+0000 7fa5edd7e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-17T06:27:59.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.687+0000 7fa5edd7e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:27:59.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.687+0000 7fa5edd7e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:27:59.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.687+0000 7fa5edd7e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:27:59.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:27:59.691+0000 7fa5edd7e700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-17T06:28:02.737 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-17T06:28:02.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:02.811 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:02.811 INFO:tasks.ceph:role: osd.4 2023-11-17T06:28:02.811 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:28:02.811 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-17T06:28:03.391 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:03.391 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:03.391 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:03.391 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2023-11-17T06:28:03.391 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:03.392 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:03.392 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:03.392 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:03.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-11-17T06:28:03.396 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:03.505 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:03.525 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:03.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:03.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:03.607 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:03.607 INFO:tasks.ceph:role: osd.5 2023-11-17T06:28:03.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:28:03.607 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:04.130 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:04.131 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:04.131 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:04.131 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:04.131 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:04.134 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-11-17T06:28:04.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:04.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:04.246 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:04.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:04.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:04.328 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:04.328 INFO:tasks.ceph:role: osd.6 2023-11-17T06:28:04.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:28:04.328 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-17T06:28:04.884 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:04.884 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:04.884 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:04.884 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2023-11-17T06:28:04.884 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:04.885 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:04.885 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:04.885 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:04.885 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:04.885 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:04.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-11-17T06:28:04.889 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:04.984 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:05.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:05.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:05.085 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:05.086 INFO:tasks.ceph:role: osd.7 2023-11-17T06:28:05.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:28:05.086 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-17T06:28:05.683 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:05.684 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:05.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-11-17T06:28:05.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:05.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:05.853 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:05.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:05.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.010+0000 7f21bfb8a700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-17T06:28:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.018+0000 7f21bfb8a700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-17T06:28:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.018+0000 7f21bfb8a700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.018+0000 7f21bfb8a700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.018+0000 7f21bfb8a700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:06.033 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:06.030+0000 7f21bfb8a700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-17T06:28:09.360 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:09.392 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:09.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.510+0000 7f06ef128700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-17T06:28:09.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.514+0000 7f06ef128700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-17T06:28:09.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.514+0000 7f06ef128700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:09.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.514+0000 7f06ef128700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:09.517 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.514+0000 7f06ef128700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:09.519 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:09.514+0000 7f06ef128700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-17T06:28:12.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:28:12.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:28:12.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:12.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:12.789 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-17T06:28:18.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-17T06:28:18.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.330 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:12.786+0000 7fab8bdec700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-17T06:28:18.331 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:18.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:18.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.494+0000 7f8399d56700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-17T06:28:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.494+0000 7f8399d56700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-17T06:28:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.494+0000 7f8399d56700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.494+0000 7f8399d56700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.494+0000 7f8399d56700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:18.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:18.498+0000 7f8399d56700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-17T06:28:21.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:24.851 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-17T06:28:24.851 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:24.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-17T06:28:24.886 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:24.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-17T06:28:24.965 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:24.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-17T06:28:25.038 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-17T06:28:25.116 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-17T06:28:25.191 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-17T06:28:25.267 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-17T06:28:25.347 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.347 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-17T06:28:25.383 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.383 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-17T06:28:25.457 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-17T06:28:25.537 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-17T06:28:25.617 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-17T06:28:25.694 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.694 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-17T06:28:25.769 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.769 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-17T06:28:25.845 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.845 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-17T06:28:25.866 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:25.866 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-17T06:28:25.927 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.927 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-17T06:28:25.945 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:25.946 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-17T06:28:26.008 INFO:tasks.ceph:Adding keys to all mons... 2023-11-17T06:28:26.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-17T06:28:26.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-17T06:28:26.060 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2023-11-17T06:28:26.060 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDhB1dlcRSEFxAAAtRLlxpM4Emc9DlCloQsvQ== 2023-11-17T06:28:26.060 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-11-17T06:28:26.060 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDhB1dlmkyCJRAAkDXrP2IoDGm3XvQ/6eb8Ow== 2023-11-17T06:28:26.060 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDhB1dlufygMBAAc4pOyxWkpXtOojf9j+KkwA== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDlB1dl2KnTKxAAVFD1/U/P8B5gvIcDK7cqHg== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDpB1dlc/ojDhAA75vWQQx0bXMJ0JTwKF9RYQ== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDsB1dljHvgHBAApnbET3kZSZQNJW43EbHXLA== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDvB1dlDrEuKRAAWVgQx1nJ8sOn03fWeqnrXA== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDhB1dlkVvnHRAAH/hkgwLSzd5JWfMX8d/KWg== 2023-11-17T06:28:26.061 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDhB1dlxYAlORAA8E9V+z8T+ObpgqcjvvnToA== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dlWqAqCBAAmD09Me6nGTNur/++tuhdjA== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD2B1dllif6ABAAaOcdEWOmRjrT0YQj3PUPVA== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD5B1dl+ya/HhAAD9JFmda3Fhrk8TLfL13Kpg== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD8B1dlomoILxAAFB2PT/PZaJhFR7ZIfxS1Yw== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQACCFdl+4C1HRAAeS6GoQJUQtnYfgJSciU65w== 2023-11-17T06:28:26.062 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dlK4OcDhAAo54plW+azztfHzX/6tuPbQ== 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dl6s/CFBAA0zzKDjsKFZW5Lw4e08ZHAg== 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dlCMC6GhAAV8vmuY1ejBzwue95h4697g== 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2023-11-17T06:28:26.063 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dlKkZYIBAAAynOc6K5cU08xg0UleSa8A== 2023-11-17T06:28:26.083 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhB1dlcRSEFxAAAtRLlxpM4Emc9DlCloQsvQ== 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhB1dlmkyCJRAAkDXrP2IoDGm3XvQ/6eb8Ow== 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhB1dlufygMBAAc4pOyxWkpXtOojf9j+KkwA== 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDlB1dl2KnTKxAAVFD1/U/P8B5gvIcDK7cqHg== 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDpB1dlc/ojDhAA75vWQQx0bXMJ0JTwKF9RYQ== 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2023-11-17T06:28:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDsB1dljHvgHBAApnbET3kZSZQNJW43EbHXLA== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDvB1dlDrEuKRAAWVgQx1nJ8sOn03fWeqnrXA== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhB1dlkVvnHRAAH/hkgwLSzd5JWfMX8d/KWg== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhB1dlxYAlORAA8E9V+z8T+ObpgqcjvvnToA== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDiB1dlWqAqCBAAmD09Me6nGTNur/++tuhdjA== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD2B1dllif6ABAAaOcdEWOmRjrT0YQj3PUPVA== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD5B1dl+ya/HhAAD9JFmda3Fhrk8TLfL13Kpg== 2023-11-17T06:28:26.085 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD8B1dlomoILxAAFB2PT/PZaJhFR7ZIfxS1Yw== 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQACCFdl+4C1HRAAeS6GoQJUQtnYfgJSciU65w== 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDiB1dlK4OcDhAAo54plW+azztfHzX/6tuPbQ== 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDiB1dl6s/CFBAA0zzKDjsKFZW5Lw4e08ZHAg== 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDiB1dlCMC6GhAAV8vmuY1ejBzwue95h4697g== 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2023-11-17T06:28:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDiB1dlKkZYIBAAAynOc6K5cU08xg0UleSa8A== 2023-11-17T06:28:26.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:26.112 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:26.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.227 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.682 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:26.765 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:26.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:26.855 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:26.953 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:27.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.056 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.147 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.229 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:27.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.596 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.686 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:27.768 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-17T06:28:27.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-17T06:28:27.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:27.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-17T06:28:27.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-17T06:28:28.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:28.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-17T06:28:28.222 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-17T06:28:28.305 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:28.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-17T06:28:28.490 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:28.497 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:28.548 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-17T06:28:28.549 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-17T06:28:28.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-17T06:28:28.560 INFO:tasks.ceph.mon.a:Started 2023-11-17T06:28:28.560 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-17T06:28:28.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-17T06:28:28.603 INFO:tasks.ceph.mon.b:Started 2023-11-17T06:28:28.603 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-17T06:28:28.603 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-17T06:28:28.609 INFO:tasks.ceph.mon.c:Started 2023-11-17T06:28:28.609 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-17T06:28:28.609 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-17T06:28:28.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-17T06:28:28.617 INFO:tasks.ceph.mgr.y:Started 2023-11-17T06:28:28.617 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-17T06:28:28.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-17T06:28:28.623 INFO:tasks.ceph.mgr.x:Started 2023-11-17T06:28:28.623 INFO:tasks.ceph:Setting crush tunables to default 2023-11-17T06:28:28.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2023-11-17T06:28:28.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 Processor -- start 2023-11-17T06:28:28.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 -- start start 2023-11-17T06:28:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00c9810 con 0x7f70d00cf7e0 2023-11-17T06:28:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00cd3c0 con 0x7f70d00c2390 2023-11-17T06:28:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d5cda700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00cd980 con 0x7f70d0161590 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:42782/0 (socket says 172.21.15.100:42782) 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 learned_addr learned my addr 172.21.15.100:0/892280383 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 msgr2=0x7f70d00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 msgr2=0x7f70d00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 --2- 172.21.15.100:0/892280383 >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-17T06:28:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.766+0000 7f70d4cd8700 1 --2- 172.21.15.100:0/892280383 >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-17T06:28:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70d4cd8700 1 --2- 172.21.15.100:0/892280383 >> v2:172.21.15.119:3300/0 conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70c77fe700 1 -- 172.21.15.100:0/892280383 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730408175 0 0) 0x7f70d00c9810 con 0x7f70d00cf7e0 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70c77fe700 1 -- 172.21.15.100:0/892280383 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b80035d0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 >> v1:172.21.15.119:6789/0 conn(0x7f70d00c2390 legacy=0x7f70d00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 >> v1:172.21.15.100:6789/0 conn(0x7f70d00cf7e0 legacy=0x7f70d00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70d4cd8700 1 -- 172.21.15.100:0/892280383 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00cd6a0 con 0x7f70d0161590 2023-11-17T06:28:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70d4cd8700 1 --2- 172.21.15.100:0/892280383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d0161590 0x7f70d00ce4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0091a0 tx=0x7f70cc009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2312ba96b8e59a47 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70c77fe700 1 -- 172.21.15.100:0/892280383 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00c070 con 0x7f70d0161590 2023-11-17T06:28:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70c77fe700 1 -- 172.21.15.100:0/892280383 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00e6a0 con 0x7f70d0161590 2023-11-17T06:28:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.970+0000 7f70c77fe700 1 -- 172.21.15.100:0/892280383 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00ea30 con 0x7f70d0161590 2023-11-17T06:28:28.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 -- 172.21.15.100:0/892280383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d0161590 msgr2=0x7f70d00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:28.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 --2- 172.21.15.100:0/892280383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d0161590 0x7f70d00ce4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0091a0 tx=0x7f70cc009c70 comp rx=0 tx=0).stop 2023-11-17T06:28:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 -- 172.21.15.100:0/892280383 shutdown_connections 2023-11-17T06:28:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 --2- 172.21.15.100:0/892280383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d0161590 0x7f70d00ce4b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 -- 172.21.15.100:0/892280383 >> 172.21.15.100:0/892280383 conn(0x7f70d006a690 msgr2=0x7f70d006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 -- 172.21.15.100:0/892280383 shutdown_connections 2023-11-17T06:28:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.974+0000 7f70d5cda700 1 -- 172.21.15.100:0/892280383 wait complete. 2023-11-17T06:28:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 Processor -- start 2023-11-17T06:28:28.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 -- start start 2023-11-17T06:28:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70d00c2390 0x7f70d0160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 0x7f70d015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0160310 con 0x7f70d0161590 2023-11-17T06:28:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015f690 con 0x7f70d00cf7e0 2023-11-17T06:28:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d5cda700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015f970 con 0x7f70d00c2390 2023-11-17T06:28:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d54d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 0x7f70d015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70c7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d4cd8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70d00c2390 0x7f70d0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70c7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:42818/0 (socket says 172.21.15.100:42818) 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70d54d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 0x7f70d015c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35542/0 (socket says 172.21.15.100:35542) 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.978+0000 7f70c7fff700 1 -- 172.21.15.100:0/3761082932 learned_addr learned my addr 172.21.15.100:0/3761082932 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 -- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70d00c2390 msgr2=0x7f70d0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70d00c2390 0x7f70d0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 -- 172.21.15.100:0/3761082932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 msgr2=0x7f70d015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 0x7f70d015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 -- 172.21.15.100:0/3761082932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0095f0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c7fff700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c500 tx=0x7f70c000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00052d0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0005430 con 0x7f70d00cf7e0 2023-11-17T06:28:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00055a0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d015fc50 con 0x7f70d00cf7e0 2023-11-17T06:28:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d0160c70 con 0x7f70d00cf7e0 2023-11-17T06:28:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.982+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70c0003be0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.986+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0067e10 con 0x7f70d00cf7e0 2023-11-17T06:28:28.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.986+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f70c00118d0 con 0x7f70d00cf7e0 2023-11-17T06:28:28.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:28.990+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f70c0017070 con 0x7f70d00cf7e0 2023-11-17T06:28:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.058+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f70d0160450 con 0x7f70d00cf7e0 2023-11-17T06:28:29.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.070+0000 7f70c57fa700 1 -- 172.21.15.100:0/3761082932 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f70d0160450 con 0x7f70d00cf7e0 2023-11-17T06:28:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.070+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 msgr2=0x7f70d014aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.070+0000 7f70d5cda700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c500 tx=0x7f70c000c810 comp rx=0 tx=0).stop 2023-11-17T06:28:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 shutdown_connections 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70d0161590 0x7f70d015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d00cf7e0 0x7f70d014aec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 --2- 172.21.15.100:0/3761082932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70d00c2390 0x7f70d0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 >> 172.21.15.100:0/3761082932 conn(0x7f70d006a690 msgr2=0x7f70d00ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 shutdown_connections 2023-11-17T06:28:29.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:29.074+0000 7f70d5cda700 1 -- 172.21.15.100:0/3761082932 wait complete. 2023-11-17T06:28:29.080 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2023-11-17T06:28:29.099 INFO:tasks.ceph:check_enable_crimson: False 2023-11-17T06:28:29.099 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-17T06:28:29.100 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:29.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-17T06:28:29.133 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:29.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-17T06:28:29.205 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:29.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-17T06:28:29.225 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:29.218+0000 7f2e55a2d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-17T06:28:29.232 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:29.226+0000 7f6287b832c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-17T06:28:29.257 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:28:29.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-17T06:28:29.333 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:29.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-17T06:28:29.366 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:29.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-17T06:28:29.440 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:29.441 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-17T06:28:29.517 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:28:29.517 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-17T06:28:29.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new c6f700d1-b862-4a65-bf0c-e669adaadd53 0 2023-11-17T06:28:29.793 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.790+0000 7fcbe28d6700 1 Processor -- start 2023-11-17T06:28:29.794 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.790+0000 7fcbe28d6700 1 -- start start 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 0x7fcbdc0d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0d1f20 con 0x7fcbdc0b1540 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0cc150 con 0x7fcbdc0b2020 2023-11-17T06:28:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc06b520 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe10d3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe18d4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 0x7fcbdc0d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41630/0 (socket says 172.21.15.119:41630) 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe10d3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:39158/0 (socket says 172.21.15.119:39158) 2023-11-17T06:28:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 -- 172.21.15.119:0/429697779 learned_addr learned my addr 172.21.15.119:0/429697779 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 -- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 msgr2=0x7fcbdc0c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 -- 172.21.15.119:0/429697779 >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 msgr2=0x7fcbdc0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/429697779 >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 0x7fcbdc0d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 -- 172.21.15.119:0/429697779 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc06b800 con 0x7fcbdc0b2020 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe18d4700 1 --2- 172.21.15.119:0/429697779 >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 0x7fcbdc0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc165230 tx=0x7fcbd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e611c8a59d1152 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe08d2700 1 -- 172.21.15.119:0/429697779 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400e070 con 0x7fcbdc0b2020 2023-11-17T06:28:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe08d2700 1 -- 172.21.15.119:0/429697779 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400b910 con 0x7fcbdc0b2020 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe08d2700 1 -- 172.21.15.119:0/429697779 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400bcc0 con 0x7fcbdc0b2020 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 -- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0b2020 msgr2=0x7fcbdc0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.794+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc165230 tx=0x7fcbd400b330 comp rx=0 tx=0).stop 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 -- 172.21.15.119:0/429697779 shutdown_connections 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0c44d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/429697779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/429697779 >> v2:172.21.15.100:3300/0 conn(0x7fcbdc0b1540 0x7fcbdc0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.803 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 -- 172.21.15.119:0/429697779 >> 172.21.15.119:0/429697779 conn(0x7fcbdc09a2a0 msgr2=0x7fcbdc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 -- 172.21.15.119:0/429697779 shutdown_connections 2023-11-17T06:28:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 -- 172.21.15.119:0/429697779 wait complete. 2023-11-17T06:28:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 Processor -- start 2023-11-17T06:28:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.798+0000 7fcbe28d6700 1 -- start start 2023-11-17T06:28:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 0x7fcbdc15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc163300 con 0x7fcbdc0b2020 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b0980 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b0170 con 0x7fcbdc0b1540 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe18d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 0x7fcbdc15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe18d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 0x7fcbdc15f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:39166/0 (socket says 172.21.15.119:39166) 2023-11-17T06:28:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe18d4700 1 -- 172.21.15.119:0/2511075557 learned_addr learned my addr 172.21.15.119:0/2511075557 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 -- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 msgr2=0x7fcbdc15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 0x7fcbdc15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe10d3700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 -- 172.21.15.119:0/2511075557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 msgr2=0x7fcbdc0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 -- 172.21.15.119:0/2511075557 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009450 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe10d3700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe20d5700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c6460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4015000 tx=0x7fcbd4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40099b0 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4009b30 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400ce80 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4004490 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc0b03c0 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcbd401c440 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.802+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcbd40257e0 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.812 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.806+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc163440 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.814 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.810+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcbdc163440 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.895 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.890+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6f700d1-b862-4a65-bf0c-e669adaadd53", "id": 0} v 0) v1 -- 0x7fcbdc065e90 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.905 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbd27fc700 1 -- 172.21.15.119:0/2511075557 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6f700d1-b862-4a65-bf0c-e669adaadd53", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbd4032020 con 0x7fcbdc0ceb90 2023-11-17T06:28:29.906 INFO:teuthology.orchestra.run.smithi119.stdout:0 2023-11-17T06:28:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 msgr2=0x7fcbdc0c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c6460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4015000 tx=0x7fcbd4004af0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 shutdown_connections 2023-11-17T06:28:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbdc0ceb90 0x7fcbdc0c6460 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbdc0b2020 0x7fcbdc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 --2- 172.21.15.119:0/2511075557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbdc0b1540 0x7fcbdc15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:29.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 >> 172.21.15.119:0/2511075557 conn(0x7fcbdc09a2a0 msgr2=0x7fcbdc161370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:29.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 shutdown_connections 2023-11-17T06:28:29.908 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:29.902+0000 7fcbe28d6700 1 -- 172.21.15.119:0/2511075557 wait complete. 2023-11-17T06:28:29.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new c176d34f-ad5f-4155-9773-b444ca4c9233 1 2023-11-17T06:28:30.014 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.010+0000 7f2e55a2d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-17T06:28:30.019 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.014+0000 7f6287b832c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-17T06:28:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.078+0000 7fb0dd9e4700 1 Processor -- start 2023-11-17T06:28:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.078+0000 7fb0dd9e4700 1 -- start start 2023-11-17T06:28:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0dd9e4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0d80c5970 0x7fb0d80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0dd9e4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0dd9e4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80c6290 con 0x7fb0d8071ee0 2023-11-17T06:28:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0dd9e4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d815a950 con 0x7fb0d80c5970 2023-11-17T06:28:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0dd9e4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d815ac30 con 0x7fb0d80cd390 2023-11-17T06:28:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:39174/0 (socket says 172.21.15.119:39174) 2023-11-17T06:28:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 -- 172.21.15.119:0/754211381 learned_addr learned my addr 172.21.15.119:0/754211381 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d6ffd700 1 --2- 172.21.15.119:0/754211381 >> v2:172.21.15.119:3300/0 conn(0x7fb0d80c5970 0x7fb0d80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 -- 172.21.15.119:0/754211381 >> v2:172.21.15.119:3300/0 conn(0x7fb0d80c5970 msgr2=0x7fb0d80c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 --2- 172.21.15.119:0/754211381 >> v2:172.21.15.119:3300/0 conn(0x7fb0d80c5970 0x7fb0d80c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 -- 172.21.15.119:0/754211381 >> v1:172.21.15.100:6789/0 conn(0x7fb0d8071ee0 legacy=0x7fb0d80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 -- 172.21.15.119:0/754211381 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d815af10 con 0x7fb0d80cd390 2023-11-17T06:28:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d67fc700 1 --2- 172.21.15.119:0/754211381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009910 tx=0x7fb0cc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5042297f0e99566 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d5ffb700 1 -- 172.21.15.119:0/754211381 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc004230 con 0x7fb0d80cd390 2023-11-17T06:28:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d5ffb700 1 -- 172.21.15.119:0/754211381 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc004390 con 0x7fb0d80cd390 2023-11-17T06:28:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.082+0000 7fb0d5ffb700 1 -- 172.21.15.119:0/754211381 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0036c0 con 0x7fb0d80cd390 2023-11-17T06:28:30.092 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.086+0000 7f2e55a2d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-17T06:28:30.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/754211381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 msgr2=0x7fb0d80719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/754211381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009910 tx=0x7fb0cc009c20 comp rx=0 tx=0).stop 2023-11-17T06:28:30.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/754211381 shutdown_connections 2023-11-17T06:28:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/754211381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80cd390 0x7fb0d80719a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/754211381 >> v2:172.21.15.119:3300/0 conn(0x7fb0d80c5970 0x7fb0d80c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/754211381 >> 172.21.15.119:0/754211381 conn(0x7fb0d806df00 msgr2=0x7fb0d806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/754211381 shutdown_connections 2023-11-17T06:28:30.098 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/754211381 wait complete. 2023-11-17T06:28:30.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 Processor -- start 2023-11-17T06:28:30.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- start start 2023-11-17T06:28:30.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80c5970 0x7fb0d8143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.099 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d80cd390 0x7fb0d8149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80ae530 con 0x7fb0d80cd390 2023-11-17T06:28:30.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8144190 con 0x7fb0d8071ee0 2023-11-17T06:28:30.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.086+0000 7fb0dd9e4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80ad8b0 con 0x7fb0d80c5970 2023-11-17T06:28:30.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d67fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80c5970 0x7fb0d8143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41654/0 (socket says 172.21.15.119:41654) 2023-11-17T06:28:30.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 -- 172.21.15.119:0/1186516168 learned_addr learned my addr 172.21.15.119:0/1186516168 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d77fe700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d80cd390 0x7fb0d8149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.101 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 -- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80c5970 msgr2=0x7fb0d8143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80c5970 0x7fb0d8143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 -- 172.21.15.119:0/1186516168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d80cd390 msgr2=0x7fb0d8149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d80cd390 0x7fb0d8149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 -- 172.21.15.119:0/1186516168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009570 con 0x7fb0d8071ee0 2023-11-17T06:28:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0d6ffd700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800ea00 tx=0x7fb0c800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8009720 con 0x7fb0d8071ee0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800c850 con 0x7fb0d8071ee0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d80adb90 con 0x7fb0d8071ee0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800cbc0 con 0x7fb0d8071ee0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d80ae150 con 0x7fb0d8071ee0 2023-11-17T06:28:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0c8005a40 con 0x7fb0d8071ee0 2023-11-17T06:28:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb0c8013820 con 0x7fb0d8071ee0 2023-11-17T06:28:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.090+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d804eea0 con 0x7fb0d8071ee0 2023-11-17T06:28:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.094+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb0c8021060 con 0x7fb0d8071ee0 2023-11-17T06:28:30.105 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.098+0000 7f6287b832c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-17T06:28:30.180 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.178+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c176d34f-ad5f-4155-9773-b444ca4c9233", "id": 1} v 0) v1 -- 0x7fb0d80cc4b0 con 0x7fb0d8071ee0 2023-11-17T06:28:30.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.186+0000 7fb0bffff700 1 -- 172.21.15.119:0/1186516168 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c176d34f-ad5f-4155-9773-b444ca4c9233", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb0c8017070 con 0x7fb0d8071ee0 2023-11-17T06:28:30.191 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 msgr2=0x7fb0d80ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800ea00 tx=0x7fb0c800ed10 comp rx=0 tx=0).stop 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 shutdown_connections 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d80cd390 0x7fb0d8149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0d80c5970 0x7fb0d8143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 --2- 172.21.15.119:0/1186516168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d8071ee0 0x7fb0d80ad2d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 >> 172.21.15.119:0/1186516168 conn(0x7fb0d806df00 msgr2=0x7fb0d80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 shutdown_connections 2023-11-17T06:28:30.193 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.190+0000 7fb0dd9e4700 1 -- 172.21.15.119:0/1186516168 wait complete. 2023-11-17T06:28:30.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new b1287d99-b295-460b-83f7-9fbf8a228073 2 2023-11-17T06:28:30.272 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.266+0000 7f2e55a2d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:30.297 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.294+0000 7f6287b832c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:30.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.374+0000 7f9960c1e700 1 Processor -- start 2023-11-17T06:28:30.378 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.374+0000 7f9960c1e700 1 -- start start 2023-11-17T06:28:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.374+0000 7f9960c1e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f995c15d310 0x7f995c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.374+0000 7f9960c1e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0d27e0 con 0x7f995c0d2c70 2023-11-17T06:28:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0ce8e0 con 0x7f995c15d310 2023-11-17T06:28:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0ce630 con 0x7f995c0d0340 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:47172/0 (socket says 172.21.15.119:47172) 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 -- 172.21.15.119:0/1991708014 learned_addr learned my addr 172.21.15.119:0/1991708014 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995a59c700 1 --2- 172.21.15.119:0/1991708014 >> v2:172.21.15.100:3300/0 conn(0x7f995c15d310 0x7f995c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 -- 172.21.15.119:0/1991708014 >> v2:172.21.15.100:3300/0 conn(0x7f995c15d310 msgr2=0x7f995c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 --2- 172.21.15.119:0/1991708014 >> v2:172.21.15.100:3300/0 conn(0x7f995c15d310 0x7f995c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 -- 172.21.15.119:0/1991708014 >> v1:172.21.15.100:6789/0 conn(0x7f995c0d2c70 legacy=0x7f995c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 -- 172.21.15.119:0/1991708014 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0d1eb0 con 0x7f995c0d0340 2023-11-17T06:28:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f995ad9d700 1 --2- 172.21.15.119:0/1991708014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9954009910 tx=0x7f9954009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f412f0103e5cd0f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9959d9b700 1 -- 172.21.15.119:0/1991708014 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400ba60 con 0x7f995c0d0340 2023-11-17T06:28:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9959d9b700 1 -- 172.21.15.119:0/1991708014 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995400bbc0 con 0x7f995c0d0340 2023-11-17T06:28:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9959d9b700 1 -- 172.21.15.119:0/1991708014 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954009e60 con 0x7f995c0d0340 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- 172.21.15.119:0/1991708014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 msgr2=0x7f995c0b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 --2- 172.21.15.119:0/1991708014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9954009910 tx=0x7f9954009c20 comp rx=0 tx=0).stop 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- 172.21.15.119:0/1991708014 shutdown_connections 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 --2- 172.21.15.119:0/1991708014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d0340 0x7f995c0b62b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 --2- 172.21.15.119:0/1991708014 >> v2:172.21.15.100:3300/0 conn(0x7f995c15d310 0x7f995c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- 172.21.15.119:0/1991708014 >> 172.21.15.119:0/1991708014 conn(0x7f995c06b4e0 msgr2=0x7f995c06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- 172.21.15.119:0/1991708014 shutdown_connections 2023-11-17T06:28:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.378+0000 7f9960c1e700 1 -- 172.21.15.119:0/1991708014 wait complete. 2023-11-17T06:28:30.387 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.382+0000 7f9960c1e700 1 Processor -- start 2023-11-17T06:28:30.388 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.382+0000 7f9960c1e700 1 -- start start 2023-11-17T06:28:30.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 0x7f995c1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 0x7f995c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 0x7f995c14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c151fa0 con 0x7f995c15d310 2023-11-17T06:28:30.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c14fd10 con 0x7f995c0d0340 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c14fff0 con 0x7f995c0d2c70 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f995a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 0x7f995c1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 0x7f995c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f995a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 0x7f995c1f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51494/0 (socket says 172.21.15.119:51494) 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f995a59c700 1 -- 172.21.15.119:0/650300822 learned_addr learned my addr 172.21.15.119:0/650300822 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f995ad9d700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 0x7f995c14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 -- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 msgr2=0x7f995c1f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 0x7f995c1f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 -- 172.21.15.119:0/650300822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 msgr2=0x7f995c14f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 0x7f995c14f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 -- 172.21.15.119:0/650300822 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954009570 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f995ad9d700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 0x7f995c14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9951d9b700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 0x7f995c14f0c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f994400cbe0 tx=0x7f994400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944003c20 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944003d80 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400ab50 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c1502d0 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c150890 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.386+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f99440050d0 con 0x7f995c0d2c70 2023-11-17T06:28:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.390+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f99440057a0 con 0x7f995c0d2c70 2023-11-17T06:28:30.394 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.390+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c04eea0 con 0x7f995c0d2c70 2023-11-17T06:28:30.397 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.394+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9944005380 con 0x7f995c0d2c70 2023-11-17T06:28:30.481 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.478+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b1287d99-b295-460b-83f7-9fbf8a228073", "id": 2} v 0) v1 -- 0x7f995c0d2440 con 0x7f995c0d2c70 2023-11-17T06:28:30.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f99537fe700 1 -- 172.21.15.119:0/650300822 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1287d99-b295-460b-83f7-9fbf8a228073", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f99440055a0 con 0x7f995c0d2c70 2023-11-17T06:28:30.493 INFO:teuthology.orchestra.run.smithi119.stdout:2 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 msgr2=0x7f995c14f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 0x7f995c14f0c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f994400cbe0 tx=0x7f994400cef0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 shutdown_connections 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f995c15d310 0x7f995c14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f995c0d2c70 0x7f995c14f0c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 --2- 172.21.15.119:0/650300822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f995c0d0340 0x7f995c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 >> 172.21.15.119:0/650300822 conn(0x7f995c06b4e0 msgr2=0x7f995c0b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 shutdown_connections 2023-11-17T06:28:30.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.490+0000 7f9960c1e700 1 -- 172.21.15.119:0/650300822 wait complete. 2023-11-17T06:28:30.518 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 96716903-24b6-4d40-9b89-0d43029059e9 3 2023-11-17T06:28:30.538 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.534+0000 7f2e55a2d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-17T06:28:30.577 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.574+0000 7f6287b832c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-17T06:28:30.614 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.606+0000 7f2e55a2d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:30.664 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.658+0000 7f6287b832c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 Processor -- start 2023-11-17T06:28:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 -- start start 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7b015ba70 0x7fa7b006a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b006b0f0 con 0x7fa7b0165bd0 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b006a850 con 0x7fa7b015ba70 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b5a62700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006ab30 con 0x7fa7b006b750 2023-11-17T06:28:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7affff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7affff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:47194/0 (socket says 172.21.15.119:47194) 2023-11-17T06:28:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7affff700 1 -- 172.21.15.119:0/2353697076 learned_addr learned my addr 172.21.15.119:0/2353697076 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.670+0000 7fa7b4a60700 1 --2- 172.21.15.119:0/2353697076 >> v2:172.21.15.119:3300/0 conn(0x7fa7b015ba70 0x7fa7b006a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7affff700 1 -- 172.21.15.119:0/2353697076 >> v2:172.21.15.119:3300/0 conn(0x7fa7b015ba70 msgr2=0x7fa7b006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7affff700 1 --2- 172.21.15.119:0/2353697076 >> v2:172.21.15.119:3300/0 conn(0x7fa7b015ba70 0x7fa7b006a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7affff700 1 -- 172.21.15.119:0/2353697076 >> v1:172.21.15.119:6789/0 conn(0x7fa7b0165bd0 legacy=0x7fa7b01619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7affff700 1 -- 172.21.15.119:0/2353697076 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b006ae10 con 0x7fa7b006b750 2023-11-17T06:28:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7affff700 1 --2- 172.21.15.119:0/2353697076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009910 tx=0x7fa79c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86195d4ebe167949 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7af7fe700 1 -- 172.21.15.119:0/2353697076 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c011830 con 0x7fa7b006b750 2023-11-17T06:28:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7af7fe700 1 -- 172.21.15.119:0/2353697076 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c011990 con 0x7fa7b006b750 2023-11-17T06:28:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7af7fe700 1 -- 172.21.15.119:0/2353697076 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c011d40 con 0x7fa7b006b750 2023-11-17T06:28:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 -- 172.21.15.119:0/2353697076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 msgr2=0x7fa7b0165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/2353697076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009910 tx=0x7fa79c009c20 comp rx=0 tx=0).stop 2023-11-17T06:28:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 -- 172.21.15.119:0/2353697076 shutdown_connections 2023-11-17T06:28:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/2353697076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0165690 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/2353697076 >> v2:172.21.15.119:3300/0 conn(0x7fa7b015ba70 0x7fa7b006a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 -- 172.21.15.119:0/2353697076 >> 172.21.15.119:0/2353697076 conn(0x7fa7b00cf540 msgr2=0x7fa7b00cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 -- 172.21.15.119:0/2353697076 shutdown_connections 2023-11-17T06:28:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.674+0000 7fa7b5a62700 1 -- 172.21.15.119:0/2353697076 wait complete. 2023-11-17T06:28:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 Processor -- start 2023-11-17T06:28:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 -- start start 2023-11-17T06:28:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7b015ba70 0x7fa7b0163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7b0165bd0 0x7fa7b00cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00713d0 con 0x7fa7b015ba70 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0150940 con 0x7fa7b0165bd0 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5a62700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0162e20 con 0x7fa7b006b750 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:47204/0 (socket says 172.21.15.119:47204) 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 -- 172.21.15.119:0/4089741717 learned_addr learned my addr 172.21.15.119:0/4089741717 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b5261700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7b0165bd0 0x7fa7b00cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7affff700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7b015ba70 0x7fa7b0163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 -- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7b0165bd0 msgr2=0x7fa7b00cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7b0165bd0 0x7fa7b00cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 -- 172.21.15.119:0/4089741717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7b015ba70 msgr2=0x7fa7b0163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7b015ba70 0x7fa7b0163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.678+0000 7fa7b4a60700 1 -- 172.21.15.119:0/4089741717 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009570 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7b4a60700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400e870 tx=0x7fa7a400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40095a0 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4013680 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0163100 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40139f0 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b01636c0 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa7a4005a40 con 0x7fa7b006b750 2023-11-17T06:28:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa7a4005cf0 con 0x7fa7b006b750 2023-11-17T06:28:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.682+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b0065e90 con 0x7fa7b006b750 2023-11-17T06:28:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.686+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa7a4021060 con 0x7fa7b006b750 2023-11-17T06:28:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.766+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96716903-24b6-4d40-9b89-0d43029059e9", "id": 3} v 0) v1 -- 0x7fa7b0165140 con 0x7fa7b006b750 2023-11-17T06:28:30.783 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.778+0000 7fa7ad7fa700 1 -- 172.21.15.119:0/4089741717 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96716903-24b6-4d40-9b89-0d43029059e9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7a4029020 con 0x7fa7b006b750 2023-11-17T06:28:30.783 INFO:teuthology.orchestra.run.smithi119.stdout:3 2023-11-17T06:28:30.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.778+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 msgr2=0x7fa7b0150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.784 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.778+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400e870 tx=0x7fa7a400eb80 comp rx=0 tx=0).stop 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 shutdown_connections 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7b0165bd0 0x7fa7b00cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7b015ba70 0x7fa7b0163ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 --2- 172.21.15.119:0/4089741717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7b006b750 0x7fa7b0150400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 >> 172.21.15.119:0/4089741717 conn(0x7fa7b00cf540 msgr2=0x7fa7b01605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 shutdown_connections 2023-11-17T06:28:30.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.782+0000 7fa7b5a62700 1 -- 172.21.15.119:0/4089741717 wait complete. 2023-11-17T06:28:30.809 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 20bae931-eff1-4366-a524-72d7306c91c5 4 2023-11-17T06:28:30.858 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.854+0000 7f2e55a2d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-17T06:28:30.935 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:30.930+0000 7f6287b832c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-17T06:28:30.949 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:30.942+0000 7f2e55a2d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-17T06:28:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.966+0000 7f07f8c08700 1 Processor -- start 2023-11-17T06:28:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.966+0000 7f07f8c08700 1 -- start start 2023-11-17T06:28:30.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07f415d310 0x7f07f40ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07f40d2c70 0x7f07f40cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.974 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40ce8e0 con 0x7f07f40d2c70 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40d27e0 con 0x7f07f415d310 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40ce630 con 0x7f07f415d6f0 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07f415d310 0x7f07f40ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07f415d310 0x7f07f40ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51526/0 (socket says 172.21.15.119:51526) 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 -- 172.21.15.119:0/3404323631 learned_addr learned my addr 172.21.15.119:0/3404323631 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f2d9d700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07e9d9b700 1 --2- 172.21.15.119:0/3404323631 >> v2:172.21.15.100:3300/0 conn(0x7f07f40d2c70 0x7f07f40cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 -- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 msgr2=0x7f07f40d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 -- 172.21.15.119:0/3404323631 >> v2:172.21.15.100:3300/0 conn(0x7f07f40d2c70 msgr2=0x7f07f40cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:30.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 --2- 172.21.15.119:0/3404323631 >> v2:172.21.15.100:3300/0 conn(0x7f07f40d2c70 0x7f07f40cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 -- 172.21.15.119:0/3404323631 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40d1eb0 con 0x7f07f415d310 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f259c700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f415d310 0x7f07f40ce0f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07f40d0d60 tx=0x7f07e4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a3e05ea92fdeac server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f1d9b700 1 -- 172.21.15.119:0/3404323631 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4011830 con 0x7f07f415d310 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f1d9b700 1 -- 172.21.15.119:0/3404323631 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4011990 con 0x7f07f415d310 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f1d9b700 1 -- 172.21.15.119:0/3404323631 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4011d20 con 0x7f07f415d310 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 -- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f415d310 msgr2=0x7f07f40ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f415d310 0x7f07f40ce0f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07f40d0d60 tx=0x7f07e4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 -- 172.21.15.119:0/3404323631 shutdown_connections 2023-11-17T06:28:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.970+0000 7f07f8c08700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 --2- 172.21.15.119:0/3404323631 >> v2:172.21.15.100:3300/0 conn(0x7f07f40d2c70 0x7f07f40cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 --2- 172.21.15.119:0/3404323631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f415d310 0x7f07f40ce0f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 -- 172.21.15.119:0/3404323631 >> 172.21.15.119:0/3404323631 conn(0x7f07f406b4e0 msgr2=0x7f07f406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 -- 172.21.15.119:0/3404323631 shutdown_connections 2023-11-17T06:28:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 -- 172.21.15.119:0/3404323631 wait complete. 2023-11-17T06:28:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 Processor -- start 2023-11-17T06:28:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.974+0000 7f07f8c08700 1 -- start start 2023-11-17T06:28:30.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 0x7f07f41f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 0x7f07f40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40cade0 con 0x7f07f415d310 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40ca830 con 0x7f07f40d2c70 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40cab00 con 0x7f07f415d6f0 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 0x7f07f41f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 0x7f07f41f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51538/0 (socket says 172.21.15.119:51538) 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f259c700 1 -- 172.21.15.119:0/1650734499 learned_addr learned my addr 172.21.15.119:0/1650734499 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:30.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.983 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07e9d9b700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 0x7f07f40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 -- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 msgr2=0x7f07f41f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 0x7f07f41f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 -- 172.21.15.119:0/1650734499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 msgr2=0x7f07f40ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 0x7f07f40ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 -- 172.21.15.119:0/1650734499 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009570 con 0x7f07f415d6f0 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07e9d9b700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 0x7f07f40ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f2d9d700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40c8ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e7c0 tx=0x7f07ec00ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:30.984 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec013680 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec013800 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f40cc4f0 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec013bb0 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f40ccab0 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f07ec005d40 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.978+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f07ec006700 con 0x7f07f415d6f0 2023-11-17T06:28:30.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.982+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40cc350 con 0x7f07f415d6f0 2023-11-17T06:28:30.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:30.982+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f07f40cc350 con 0x7f07f415d6f0 2023-11-17T06:28:31.039 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:31.034+0000 7f6287b832c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-17T06:28:31.040 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:31.034+0000 7f2e55a2d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-17T06:28:31.067 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.062+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "20bae931-eff1-4366-a524-72d7306c91c5", "id": 4} v 0) v1 -- 0x7f07f4067250 con 0x7f07f415d6f0 2023-11-17T06:28:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07eb7fe700 1 -- 172.21.15.119:0/1650734499 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20bae931-eff1-4366-a524-72d7306c91c5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07ec021060 con 0x7f07f415d6f0 2023-11-17T06:28:31.077 INFO:teuthology.orchestra.run.smithi119.stdout:4 2023-11-17T06:28:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 msgr2=0x7f07f40c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40c8ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e7c0 tx=0x7f07ec00ead0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 shutdown_connections 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07f415d6f0 0x7f07f40c8ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f415d310 0x7f07f40ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 --2- 172.21.15.119:0/1650734499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40d2c70 0x7f07f41f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 >> 172.21.15.119:0/1650734499 conn(0x7f07f406b4e0 msgr2=0x7f07f40b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 shutdown_connections 2023-11-17T06:28:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.074+0000 7f07f8c08700 1 -- 172.21.15.119:0/1650734499 wait complete. 2023-11-17T06:28:31.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 6b296c1e-1def-438b-8636-afafc681a28c 5 2023-11-17T06:28:31.139 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:31.134+0000 7f6287b832c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-17T06:28:31.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.254+0000 7fb5994c1700 1 Processor -- start 2023-11-17T06:28:31.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.254+0000 7fb5994c1700 1 -- start start 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb5994c1700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5941609b0 0x7fb59406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb5994c1700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5940afe40 0x7fb5940cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb5994c1700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940b26c0 con 0x7fb5940cdc90 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb5994c1700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb594160d90 con 0x7fb5940afe40 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb5994c1700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940d1710 con 0x7fb5941609b0 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5941609b0 0x7fb59406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5941609b0 0x7fb59406bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51550/0 (socket says 172.21.15.119:51550) 2023-11-17T06:28:31.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 -- 172.21.15.119:0/4263083 learned_addr learned my addr 172.21.15.119:0/4263083 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:31.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 -- 172.21.15.119:0/4263083 >> v2:172.21.15.100:3300/0 conn(0x7fb5940afe40 msgr2=0x7fb5940cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:31.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 --2- 172.21.15.119:0/4263083 >> v2:172.21.15.100:3300/0 conn(0x7fb5940afe40 0x7fb5940cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 -- 172.21.15.119:0/4263083 >> v1:172.21.15.119:6789/0 conn(0x7fb5940cdc90 legacy=0x7fb5940ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:31.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 -- 172.21.15.119:0/4263083 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940d19f0 con 0x7fb5941609b0 2023-11-17T06:28:31.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb593fff700 1 --2- 172.21.15.119:0/4263083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5941609b0 0x7fb59406bf00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb5940b3a50 tx=0x7fb584009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5a6552fdfd9269 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb592ffd700 1 -- 172.21.15.119:0/4263083 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584005e50 con 0x7fb5941609b0 2023-11-17T06:28:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb592ffd700 1 -- 172.21.15.119:0/4263083 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584004030 con 0x7fb5941609b0 2023-11-17T06:28:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.258+0000 7fb592ffd700 1 -- 172.21.15.119:0/4263083 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840043c0 con 0x7fb5941609b0 2023-11-17T06:28:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 -- 172.21.15.119:0/4263083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5941609b0 msgr2=0x7fb59406bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 --2- 172.21.15.119:0/4263083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5941609b0 0x7fb59406bf00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb5940b3a50 tx=0x7fb584009bf0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 -- 172.21.15.119:0/4263083 shutdown_connections 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 --2- 172.21.15.119:0/4263083 >> v2:172.21.15.100:3300/0 conn(0x7fb5940afe40 0x7fb5940cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 --2- 172.21.15.119:0/4263083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5941609b0 0x7fb59406bf00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 -- 172.21.15.119:0/4263083 >> 172.21.15.119:0/4263083 conn(0x7fb59409a210 msgr2=0x7fb5940d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 -- 172.21.15.119:0/4263083 shutdown_connections 2023-11-17T06:28:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.262+0000 7fb5994c1700 1 -- 172.21.15.119:0/4263083 wait complete. 2023-11-17T06:28:31.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 Processor -- start 2023-11-17T06:28:31.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- start start 2023-11-17T06:28:31.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5940cdc90 0x7fb5941f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 0x7fb5940aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941f28f0 con 0x7fb5941609b0 2023-11-17T06:28:31.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941f36d0 con 0x7fb5940cdc90 2023-11-17T06:28:31.271 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594147810 con 0x7fb5940afe40 2023-11-17T06:28:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:47240/0 (socket says 172.21.15.119:47240) 2023-11-17T06:28:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 -- 172.21.15.119:0/866104365 learned_addr learned my addr 172.21.15.119:0/866104365 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5937fe700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5940cdc90 0x7fb5941f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb598cc0700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 0x7fb5940aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 -- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5940cdc90 msgr2=0x7fb5941f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5940cdc90 0x7fb5941f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 -- 172.21.15.119:0/866104365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 msgr2=0x7fb5940aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 0x7fb5940aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 -- 172.21.15.119:0/866104365 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584009520 con 0x7fb5940afe40 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb598cc0700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 0x7fb5940aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb593fff700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb58400b0e0 tx=0x7fb584004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840045c0 con 0x7fb5940afe40 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58401d430 con 0x7fb5940afe40 2023-11-17T06:28:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5941f2ae0 con 0x7fb5940afe40 2023-11-17T06:28:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58401d7c0 con 0x7fb5940afe40 2023-11-17T06:28:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.266+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5941f3080 con 0x7fb5940afe40 2023-11-17T06:28:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.270+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb58401dc20 con 0x7fb5940afe40 2023-11-17T06:28:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.270+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb584026da0 con 0x7fb5940afe40 2023-11-17T06:28:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.270+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb594065e90 con 0x7fb5940afe40 2023-11-17T06:28:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.270+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb58402b060 con 0x7fb5940afe40 2023-11-17T06:28:31.352 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.346+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b296c1e-1def-438b-8636-afafc681a28c", "id": 5} v 0) v1 -- 0x7fb5940d1de0 con 0x7fb5940afe40 2023-11-17T06:28:31.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.354+0000 7fb590ff9700 1 -- 172.21.15.119:0/866104365 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b296c1e-1def-438b-8636-afafc681a28c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb584021070 con 0x7fb5940afe40 2023-11-17T06:28:31.359 INFO:teuthology.orchestra.run.smithi119.stdout:5 2023-11-17T06:28:31.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.354+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 msgr2=0x7fb5941472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.360 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.354+0000 7fb5994c1700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb58400b0e0 tx=0x7fb584004770 comp rx=0 tx=0).stop 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.354+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 shutdown_connections 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.354+0000 7fb5994c1700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5941609b0 0x7fb5940aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.358+0000 7fb5994c1700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5940cdc90 0x7fb5941f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.358+0000 7fb5994c1700 1 --2- 172.21.15.119:0/866104365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5940afe40 0x7fb5941472d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.358+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 >> 172.21.15.119:0/866104365 conn(0x7fb59409a210 msgr2=0x7fb59406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.358+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 shutdown_connections 2023-11-17T06:28:31.361 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.358+0000 7fb5994c1700 1 -- 172.21.15.119:0/866104365 wait complete. 2023-11-17T06:28:31.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new fb421d73-4e05-4517-8d38-0fd4ac3ea4c4 6 2023-11-17T06:28:31.529 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:31.522+0000 7f2e55a2d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-17T06:28:31.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 Processor -- start 2023-11-17T06:28:31.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 -- start start 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee6415d310 0x7fee640ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee640d2c70 0x7fee640cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640d27e0 con 0x7fee6415d6f0 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640ce8e0 con 0x7fee640d2c70 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee6aaec700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640ce630 con 0x7fee6415d310 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee68888700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee6415d310 0x7fee640ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee69089700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fee6415d6f0 0x7fee640b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:47472/0 (socket says 172.21.15.119:47472) 2023-11-17T06:28:31.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.590+0000 7fee69089700 1 -- 172.21.15.119:0/4262236743 learned_addr learned my addr 172.21.15.119:0/4262236743 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee63fff700 1 --2- 172.21.15.119:0/4262236743 >> v2:172.21.15.100:3300/0 conn(0x7fee640d2c70 0x7fee640cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee637fe700 1 -- 172.21.15.119:0/4262236743 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904670729 0 0) 0x7fee640d27e0 con 0x7fee6415d6f0 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee637fe700 1 -- 172.21.15.119:0/4262236743 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee540035d0 con 0x7fee6415d6f0 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee68888700 1 -- 172.21.15.119:0/4262236743 >> v2:172.21.15.100:3300/0 conn(0x7fee640d2c70 msgr2=0x7fee640cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee68888700 1 --2- 172.21.15.119:0/4262236743 >> v2:172.21.15.100:3300/0 conn(0x7fee640d2c70 0x7fee640cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee68888700 1 -- 172.21.15.119:0/4262236743 >> v1:172.21.15.119:6789/0 conn(0x7fee6415d6f0 legacy=0x7fee640b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee68888700 1 -- 172.21.15.119:0/4262236743 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640d1eb0 con 0x7fee6415d310 2023-11-17T06:28:31.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee68888700 1 --2- 172.21.15.119:0/4262236743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640ce0f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee640d0d60 tx=0x7fee58009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574b3e7fbcbcf124 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee637fe700 1 -- 172.21.15.119:0/4262236743 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011830 con 0x7fee6415d310 2023-11-17T06:28:31.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee637fe700 1 -- 172.21.15.119:0/4262236743 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58011990 con 0x7fee6415d310 2023-11-17T06:28:31.598 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee637fe700 1 -- 172.21.15.119:0/4262236743 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011d20 con 0x7fee6415d310 2023-11-17T06:28:31.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 -- 172.21.15.119:0/4262236743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 msgr2=0x7fee640ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 --2- 172.21.15.119:0/4262236743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640ce0f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee640d0d60 tx=0x7fee58009b30 comp rx=0 tx=0).stop 2023-11-17T06:28:31.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 -- 172.21.15.119:0/4262236743 shutdown_connections 2023-11-17T06:28:31.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 --2- 172.21.15.119:0/4262236743 >> v2:172.21.15.100:3300/0 conn(0x7fee640d2c70 0x7fee640cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.599 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 --2- 172.21.15.119:0/4262236743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640ce0f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 -- 172.21.15.119:0/4262236743 >> 172.21.15.119:0/4262236743 conn(0x7fee6406b4e0 msgr2=0x7fee6406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 -- 172.21.15.119:0/4262236743 shutdown_connections 2023-11-17T06:28:31.600 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.594+0000 7fee6aaec700 1 -- 172.21.15.119:0/4262236743 wait complete. 2023-11-17T06:28:31.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 Processor -- start 2023-11-17T06:28:31.602 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 -- start start 2023-11-17T06:28:31.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee640d2c70 0x7fee6415fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee6415d6f0 0x7fee640c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.607 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640ca490 con 0x7fee640d2c70 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640c9b00 con 0x7fee6415d310 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee6aaec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640ccb20 con 0x7fee6415d6f0 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee63fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee69089700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee6415d6f0 0x7fee640c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee63fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51580/0 (socket says 172.21.15.119:51580) 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee63fff700 1 -- 172.21.15.119:0/3100113301 learned_addr learned my addr 172.21.15.119:0/3100113301 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.598+0000 7fee68888700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee640d2c70 0x7fee6415fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 -- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee6415d6f0 msgr2=0x7fee640c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee6415d6f0 0x7fee640c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.608 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 -- 172.21.15.119:0/3100113301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee640d2c70 msgr2=0x7fee6415fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee640d2c70 0x7fee6415fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 -- 172.21.15.119:0/3100113301 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580094b0 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee63fff700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee5000e9d0 tx=0x7fee5000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50009720 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000ee70 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640cce00 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000ca50 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6414ff70 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee50005a40 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fee50005cf0 con 0x7fee6415d310 2023-11-17T06:28:31.609 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.602+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee640ca5d0 con 0x7fee6415d310 2023-11-17T06:28:31.610 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.606+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fee640ca5d0 con 0x7fee6415d310 2023-11-17T06:28:31.655 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:31.650+0000 7f6287b832c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-17T06:28:31.688 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.682+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb421d73-4e05-4517-8d38-0fd4ac3ea4c4", "id": 6} v 0) v1 -- 0x7fee640b8e80 con 0x7fee6415d310 2023-11-17T06:28:31.696 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.690+0000 7fee617fa700 1 -- 172.21.15.119:0/3100113301 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb421d73-4e05-4517-8d38-0fd4ac3ea4c4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee50029020 con 0x7fee6415d310 2023-11-17T06:28:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:6 2023-11-17T06:28:31.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 msgr2=0x7fee640cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.697 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee5000e9d0 tx=0x7fee5000ece0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 shutdown_connections 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee6415d6f0 0x7fee640c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee6415d310 0x7fee640cfea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 --2- 172.21.15.119:0/3100113301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee640d2c70 0x7fee6415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 >> 172.21.15.119:0/3100113301 conn(0x7fee6406b4e0 msgr2=0x7fee640c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 shutdown_connections 2023-11-17T06:28:31.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.694+0000 7fee6aaec700 1 -- 172.21.15.119:0/3100113301 wait complete. 2023-11-17T06:28:31.704 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:31.698+0000 7f2e55a2d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-17T06:28:31.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 4f0a5445-b221-4642-9ce9-385bf3d1dad9 7 2023-11-17T06:28:31.831 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:31.826+0000 7f6287b832c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-17T06:28:31.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.874+0000 7f6b7689d700 1 Processor -- start 2023-11-17T06:28:31.880 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.874+0000 7f6b7689d700 1 -- start start 2023-11-17T06:28:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7689d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b700cf910 0x7f6b7015b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7689d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7015a3b0 con 0x7f6b70159fd0 2023-11-17T06:28:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7689d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700ca590 con 0x7f6b7015e870 2023-11-17T06:28:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7689d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b700ca840 con 0x7f6b700cf910 2023-11-17T06:28:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7509a700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6b7015e870 0x7f6b700cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:47478/0 (socket says 172.21.15.119:47478) 2023-11-17T06:28:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7509a700 1 -- 172.21.15.119:0/597406134 learned_addr learned my addr 172.21.15.119:0/597406134 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-11-17T06:28:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7609c700 1 --2- 172.21.15.119:0/597406134 >> v2:172.21.15.119:3300/0 conn(0x7f6b700cf910 0x7f6b7015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b74899700 1 -- 172.21.15.119:0/597406134 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604007584 0 0) 0x7f6b700ca590 con 0x7f6b7015e870 2023-11-17T06:28:31.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7609c700 1 -- 172.21.15.119:0/597406134 >> v1:172.21.15.119:6789/0 conn(0x7f6b7015e870 legacy=0x7f6b700cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.884 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7609c700 1 -- 172.21.15.119:0/597406134 >> v1:172.21.15.100:6789/0 conn(0x7f6b70159fd0 legacy=0x7f6b700c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7609c700 1 -- 172.21.15.119:0/597406134 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7015a650 con 0x7f6b700cf910 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.878+0000 7f6b7609c700 1 --2- 172.21.15.119:0/597406134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b700cf910 0x7f6b7015b130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009d90 tx=0x7f6b6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46e393f4f2807322 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b74899700 1 -- 172.21.15.119:0/597406134 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800bdd0 con 0x7f6b700cf910 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b74899700 1 -- 172.21.15.119:0/597406134 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68011460 con 0x7f6b700cf910 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b74899700 1 -- 172.21.15.119:0/597406134 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011810 con 0x7f6b700cf910 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- 172.21.15.119:0/597406134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b700cf910 msgr2=0x7f6b7015b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.885 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 --2- 172.21.15.119:0/597406134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b700cf910 0x7f6b7015b130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009d90 tx=0x7f6b6800b330 comp rx=0 tx=0).stop 2023-11-17T06:28:31.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- 172.21.15.119:0/597406134 shutdown_connections 2023-11-17T06:28:31.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 --2- 172.21.15.119:0/597406134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b700cf910 0x7f6b7015b130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- 172.21.15.119:0/597406134 >> 172.21.15.119:0/597406134 conn(0x7f6b7006a690 msgr2=0x7f6b7006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- 172.21.15.119:0/597406134 shutdown_connections 2023-11-17T06:28:31.886 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- 172.21.15.119:0/597406134 wait complete. 2023-11-17T06:28:31.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 Processor -- start 2023-11-17T06:28:31.888 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.882+0000 7f6b7689d700 1 -- start start 2023-11-17T06:28:31.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b700cf910 0x7f6b701ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b70159fd0 0x7f6b700b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:31.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700c6dd0 con 0x7f6b700cf910 2023-11-17T06:28:31.889 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b2120 con 0x7f6b70159fd0 2023-11-17T06:28:31.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b2400 con 0x7f6b7015e870 2023-11-17T06:28:31.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7509a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b70159fd0 0x7f6b700b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:47256/0 (socket says 172.21.15.119:47256) 2023-11-17T06:28:31.890 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 -- 172.21.15.119:0/1254844673 learned_addr learned my addr 172.21.15.119:0/1254844673 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-11-17T06:28:31.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7589b700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b700cf910 0x7f6b701ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:31.891 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 -- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b70159fd0 msgr2=0x7f6b700b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b70159fd0 0x7f6b700b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 -- 172.21.15.119:0/1254844673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b700cf910 msgr2=0x7f6b701ef500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b700cf910 0x7f6b701ef500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 -- 172.21.15.119:0/1254844673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009a70 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7609c700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b7015a580 tx=0x7f6b68004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68019600 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6801f040 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680199a0 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b700b26e0 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700b1e30 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b68019b00 con 0x7f6b7015e870 2023-11-17T06:28:31.892 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6b68019db0 con 0x7f6b7015e870 2023-11-17T06:28:31.893 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.886+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b70067e10 con 0x7f6b7015e870 2023-11-17T06:28:31.894 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.890+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6b68003a40 con 0x7f6b7015e870 2023-11-17T06:28:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.970+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f0a5445-b221-4642-9ce9-385bf3d1dad9", "id": 7} v 0) v1 -- 0x7f6b700c7220 con 0x7f6b7015e870 2023-11-17T06:28:31.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.990+0000 7f6b667fc700 1 -- 172.21.15.119:0/1254844673 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f0a5445-b221-4642-9ce9-385bf3d1dad9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b68004070 con 0x7f6b7015e870 2023-11-17T06:28:31.996 INFO:teuthology.orchestra.run.smithi119.stdout:7 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 msgr2=0x7f6b701578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b7015a580 tx=0x7f6b68004af0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 shutdown_connections 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b7015e870 0x7f6b701578f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b70159fd0 0x7f6b700b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 --2- 172.21.15.119:0/1254844673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b700cf910 0x7f6b701ef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 >> 172.21.15.119:0/1254844673 conn(0x7f6b7006a690 msgr2=0x7f6b70071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 shutdown_connections 2023-11-17T06:28:31.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:28:31.994+0000 7f6b7689d700 1 -- 172.21.15.119:0/1254844673 wait complete. 2023-11-17T06:28:32.016 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-17T06:28:32.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-17T06:28:32.024 INFO:tasks.ceph.osd.0:Started 2023-11-17T06:28:32.024 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-17T06:28:32.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-17T06:28:32.028 INFO:tasks.ceph.osd.1:Started 2023-11-17T06:28:32.028 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-17T06:28:32.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-17T06:28:32.033 INFO:tasks.ceph.osd.2:Started 2023-11-17T06:28:32.033 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-17T06:28:32.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-17T06:28:32.039 INFO:tasks.ceph.osd.3:Started 2023-11-17T06:28:32.039 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-17T06:28:32.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-17T06:28:32.047 INFO:tasks.ceph.osd.4:Started 2023-11-17T06:28:32.047 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-17T06:28:32.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-17T06:28:32.053 INFO:tasks.ceph.osd.5:Started 2023-11-17T06:28:32.053 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-17T06:28:32.054 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-17T06:28:32.057 INFO:tasks.ceph.osd.6:Started 2023-11-17T06:28:32.058 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-17T06:28:32.058 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-17T06:28:32.063 INFO:tasks.ceph.osd.7:Started 2023-11-17T06:28:32.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:28:32.131 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:32.126+0000 7f2e55a2d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-17T06:28:32.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.242+0000 7ff2ad8c9700 1 Processor -- start 2023-11-17T06:28:32.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.242+0000 7ff2ad8c9700 1 -- start start 2023-11-17T06:28:32.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ad8c9700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 0x7ff2a80c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ad8c9700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80cde60 con 0x7ff2a80ac8c0 2023-11-17T06:28:32.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ad8c9700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80ce450 con 0x7ff2a806c290 2023-11-17T06:28:32.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ad8c9700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80cd600 con 0x7ff2a815d450 2023-11-17T06:28:32.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a7fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff2a80ac8c0 0x7ff2a80c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37452/0 (socket says 172.21.15.100:37452) 2023-11-17T06:28:32.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a7fff700 1 -- 172.21.15.100:0/3146243498 learned_addr learned my addr 172.21.15.100:0/3146243498 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:28:32.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ac8c7700 1 --2- 172.21.15.100:0/3146243498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 0x7ff2a80c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155090579 0 0) 0x7ff2a80cde60 con 0x7ff2a80ac8c0 2023-11-17T06:28:32.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2900035d0 con 0x7ff2a80ac8c0 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403509636 0 0) 0x7ff2a80ce450 con 0x7ff2a806c290 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a80cde60 con 0x7ff2a806c290 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2474725840 0 0) 0x7ff2900035d0 con 0x7ff2a80ac8c0 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ac8c7700 1 -- 172.21.15.100:0/3146243498 >> v1:172.21.15.119:6789/0 conn(0x7ff2a806c290 legacy=0x7ff2a806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ac8c7700 1 -- 172.21.15.100:0/3146243498 >> v1:172.21.15.100:6789/0 conn(0x7ff2a80ac8c0 legacy=0x7ff2a80c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ac8c7700 1 -- 172.21.15.100:0/3146243498 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a80cd810 con 0x7ff2a815d450 2023-11-17T06:28:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2ac8c7700 1 --2- 172.21.15.100:0/3146243498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 0x7ff2a80c3d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098b0 tx=0x7ff29c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89cbd657239cd309 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:32.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298001670 con 0x7ff2a815d450 2023-11-17T06:28:32.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c004030 con 0x7ff2a815d450 2023-11-17T06:28:32.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.246+0000 7ff2a77fe700 1 -- 172.21.15.100:0/3146243498 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0043e0 con 0x7ff2a815d450 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/3146243498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 msgr2=0x7ff2a80c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/3146243498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 0x7ff2a80c3d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098b0 tx=0x7ff29c009bc0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/3146243498 shutdown_connections 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/3146243498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a815d450 0x7ff2a80c3d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/3146243498 >> 172.21.15.100:0/3146243498 conn(0x7ff2a80cb730 msgr2=0x7ff2a80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/3146243498 shutdown_connections 2023-11-17T06:28:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/3146243498 wait complete. 2023-11-17T06:28:32.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 Processor -- start 2023-11-17T06:28:32.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.250+0000 7ff2ad8c9700 1 -- start start 2023-11-17T06:28:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a806c290 0x7ff2a8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2a80ac8c0 0x7ff2a8153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b19d0 con 0x7ff2a815d450 2023-11-17T06:28:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b1c20 con 0x7ff2a80ac8c0 2023-11-17T06:28:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b1f00 con 0x7ff2a806c290 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42386/0 (socket says 172.21.15.100:42386) 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 -- 172.21.15.100:0/975527010 learned_addr learned my addr 172.21.15.100:0/975527010 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a7fff700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2a80ac8c0 0x7ff2a8153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ac8c7700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a806c290 0x7ff2a8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 -- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a806c290 msgr2=0x7ff2a8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a806c290 0x7ff2a8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 -- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2a80ac8c0 msgr2=0x7ff2a8153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2a80ac8c0 0x7ff2a8153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 -- 172.21.15.100:0/975527010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0094b0 con 0x7ff2a815d450 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad0c8700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000cbc0 tx=0x7ff2a000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0003c20 con 0x7ff2a815d450 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a0003d80 con 0x7ff2a815d450 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80b21e0 con 0x7ff2a815d450 2023-11-17T06:28:32.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000aaa0 con 0x7ff2a815d450 2023-11-17T06:28:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a80b27a0 con 0x7ff2a815d450 2023-11-17T06:28:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2a00050d0 con 0x7ff2a815d450 2023-11-17T06:28:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.254+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff2a00125b0 con 0x7ff2a815d450 2023-11-17T06:28:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.258+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8065e90 con 0x7ff2a815d450 2023-11-17T06:28:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.262+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff2a0005380 con 0x7ff2a815d450 2023-11-17T06:28:32.329 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:32.326+0000 7f6287b832c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-17T06:28:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.370+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a806d350 con 0x7ff2a815d450 2023-11-17T06:28:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2a57fa700 1 -- 172.21.15.100:0/975527010 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2a0005520 con 0x7ff2a815d450 2023-11-17T06:28:32.379 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:28:32.379 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:28:31.976739+0000","last_up_change":"0.000000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:28:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 msgr2=0x7ff2a80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000cbc0 tx=0x7ff2a000ced0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 shutdown_connections 2023-11-17T06:28:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2a815d450 0x7ff2a80b2a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2a80ac8c0 0x7ff2a8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 --2- 172.21.15.100:0/975527010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2a806c290 0x7ff2a8071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 >> 172.21.15.100:0/975527010 conn(0x7ff2a80cb730 msgr2=0x7ff2a8156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 shutdown_connections 2023-11-17T06:28:32.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:28:32.374+0000 7ff2ad8c9700 1 -- 172.21.15.100:0/975527010 wait complete. 2023-11-17T06:28:32.402 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-17T06:28:32.402 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-17T06:28:32.412 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:32.406+0000 7f2e55a2d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:32.508 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:32.502+0000 7f2e55a2d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-17T06:28:32.571 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:32.566+0000 7f6287b832c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:32.592 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:32.586+0000 7f2e55a2d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-17T06:28:32.675 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:32.670+0000 7f6287b832c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-17T06:28:32.710 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-11-17T06:28:32.702+0000 7f27e276b700 -1 Falling back to public interface 2023-11-17T06:28:32.710 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-11-17T06:28:32.702+0000 7f0a169f6700 -1 Falling back to public interface 2023-11-17T06:28:32.710 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-11-17T06:28:32.706+0000 7f9c4bfdf700 -1 Falling back to public interface 2023-11-17T06:28:32.718 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-11-17T06:28:32.710+0000 7f27e1736700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6821/0: (98) Address already in use 2023-11-17T06:28:32.727 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-11-17T06:28:32.722+0000 7f1565d42700 -1 Falling back to public interface 2023-11-17T06:28:32.736 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-11-17T06:28:32.730+0000 7fccb6ba4700 -1 Falling back to public interface 2023-11-17T06:28:32.746 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-11-17T06:28:32.742+0000 7ff0c043d700 -1 Falling back to public interface 2023-11-17T06:28:32.746 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-11-17T06:28:32.742+0000 7f0df2128700 -1 Falling back to public interface 2023-11-17T06:28:32.759 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-11-17T06:28:32.754+0000 7fb8bbbca700 -1 Falling back to public interface 2023-11-17T06:28:32.767 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:32.762+0000 7f6287b832c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-17T06:28:33.209 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-17T06:28:33.350 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.342+0000 7f9dcda58700 1 Processor -- start 2023-11-17T06:28:33.350 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.342+0000 7f9dcda58700 1 -- start start 2023-11-17T06:28:33.351 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815c1a0 0x7f9dc806bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.351 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9dc806c470 0x7f9dc815f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.351 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc80725e0 con 0x7f9dc815af30 2023-11-17T06:28:33.351 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc8072020 con 0x7f9dc806c470 2023-11-17T06:28:33.351 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8072300 con 0x7f9dc815c1a0 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9dc806c470 0x7f9dc815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9dc806c470 0x7f9dc815f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42388/0 (socket says 172.21.15.100:42388) 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 -- 172.21.15.100:0/3503373664 learned_addr learned my addr 172.21.15.100:0/3503373664 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 -- 172.21.15.100:0/3503373664 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815c1a0 msgr2=0x7f9dc806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 --2- 172.21.15.100:0/3503373664 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815c1a0 0x7f9dc806bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 -- 172.21.15.100:0/3503373664 >> v1:172.21.15.119:6789/0 conn(0x7f9dc815af30 legacy=0x7f9dc80700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.352 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 -- 172.21.15.100:0/3503373664 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc815ec10 con 0x7f9dc806c470 2023-11-17T06:28:33.353 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcd257700 1 --2- 172.21.15.100:0/3503373664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc815f130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e50 tx=0x7f9dc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e895bd8f5b4cb90b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.353 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dc77fe700 1 -- 172.21.15.100:0/3503373664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000e070 con 0x7f9dc806c470 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dc77fe700 1 -- 172.21.15.100:0/3503373664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0003a40 con 0x7f9dc806c470 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dc77fe700 1 -- 172.21.15.100:0/3503373664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0003df0 con 0x7f9dc806c470 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- 172.21.15.100:0/3503373664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 msgr2=0x7f9dc815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 --2- 172.21.15.100:0/3503373664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc815f130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e50 tx=0x7f9dc000b330 comp rx=0 tx=0).stop 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- 172.21.15.100:0/3503373664 shutdown_connections 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 --2- 172.21.15.100:0/3503373664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc815f130 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 --2- 172.21.15.100:0/3503373664 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815c1a0 0x7f9dc806bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- 172.21.15.100:0/3503373664 >> 172.21.15.100:0/3503373664 conn(0x7f9dc80cebb0 msgr2=0x7f9dc80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- 172.21.15.100:0/3503373664 shutdown_connections 2023-11-17T06:28:33.354 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.346+0000 7f9dcda58700 1 -- 172.21.15.100:0/3503373664 wait complete. 2023-11-17T06:28:33.357 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.350+0000 7f9dcda58700 1 Processor -- start 2023-11-17T06:28:33.357 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.350+0000 7f9dcda58700 1 -- start start 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 0x7f9dc814e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dc815c1a0 0x7f9dc8155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8157230 con 0x7f9dc806c470 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8155c50 con 0x7f9dc815c1a0 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8155f30 con 0x7f9dc815af30 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42404/0 (socket says 172.21.15.100:42404) 2023-11-17T06:28:33.360 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 -- 172.21.15.100:0/1660324470 learned_addr learned my addr 172.21.15.100:0/1660324470 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcd257700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dc815c1a0 0x7f9dc8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc7fff700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 0x7f9dc814e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 -- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 msgr2=0x7f9dc814e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 0x7f9dc814e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 -- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dc815c1a0 msgr2=0x7f9dc8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dc815c1a0 0x7f9dc8155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.362 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 -- 172.21.15.100:0/1660324470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0009b30 con 0x7f9dc806c470 2023-11-17T06:28:33.579 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc7fff700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 0x7f9dc814e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcca56700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c4d0 tx=0x7f9dbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0054e0 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0036a0 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc003a50 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc8156210 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc81567d0 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9dbc006840 con 0x7f9dc806c470 2023-11-17T06:28:33.580 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.354+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9dbc0073e0 con 0x7f9dc806c470 2023-11-17T06:28:33.581 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.358+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc804eea0 con 0x7f9dc806c470 2023-11-17T06:28:33.581 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.362+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9dbc017070 con 0x7f9dc806c470 2023-11-17T06:28:33.581 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:33.398+0000 7f2e55a2d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-17T06:28:33.582 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.430+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dc806e300 con 0x7f9dc806c470 2023-11-17T06:28:33.582 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.430+0000 7f9dc57fa700 1 -- 172.21.15.100:0/1660324470 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9dbc007000 con 0x7f9dc806c470 2023-11-17T06:28:33.582 INFO:teuthology.misc.health.smithi100.stdout: 2023-11-17T06:28:33.582 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:28:31.976739+0000","last_up_change":"0.000000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 msgr2=0x7f9dc8156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c4d0 tx=0x7f9dbc00c890 comp rx=0 tx=0).stop 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 shutdown_connections 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dc815c1a0 0x7f9dc8155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dc815af30 0x7f9dc814e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 --2- 172.21.15.100:0/1660324470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc806c470 0x7f9dc8156cf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 >> 172.21.15.100:0/1660324470 conn(0x7f9dc80cebb0 msgr2=0x7f9dc815b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 shutdown_connections 2023-11-17T06:28:33.584 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:28:33.434+0000 7f9dcda58700 1 -- 172.21.15.100:0/1660324470 wait complete. 2023-11-17T06:28:33.585 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-17T06:28:33.585 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:33.482+0000 7f2e55a2d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-17T06:28:33.651 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:33.646+0000 7f6287b832c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-17T06:28:33.678 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:33.674+0000 7f2e55a2d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:33.739 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:33.734+0000 7f6287b832c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-17T06:28:33.811 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:33.806+0000 7f2e55a2d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-17T06:28:33.899 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:33.894+0000 7f2e55a2d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-17T06:28:33.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:33.918+0000 7f6287b832c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:34.009 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:34.006+0000 7f6287b832c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-17T06:29:33.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:29:33.627 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:34.102+0000 7f6287b832c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-17T06:29:33.627 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:34.318+0000 7f6287b832c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-17T06:29:33.627 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:34.566+0000 7f6287b832c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-17T06:29:33.628 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-11-17T06:28:35.386+0000 7f6287b832c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-17T06:29:33.628 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:34.110+0000 7f2e55a2d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-17T06:29:33.628 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:34.382+0000 7f2e55a2d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:35.218+0000 7f2e55a2d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:36.258+0000 7f2e3ca4d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-11-17T06:28:36.258+0000 7f2e3ca4d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-17T06:29:33.659 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-11-17T06:28:36.681+0000 7ff0c043d700 -1 osd.5 0 log_to_monitors true 2023-11-17T06:29:33.660 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-11-17T06:28:36.670+0000 7f9c4bfdf700 -1 osd.1 0 log_to_monitors true 2023-11-17T06:29:33.660 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-11-17T06:28:36.713+0000 7f1565d42700 -1 osd.6 0 log_to_monitors true 2023-11-17T06:29:33.660 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-11-17T06:28:36.758+0000 7fccb6ba4700 -1 osd.2 0 log_to_monitors true 2023-11-17T06:29:33.661 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-11-17T06:28:36.917+0000 7f0df2128700 -1 osd.7 0 log_to_monitors true 2023-11-17T06:29:33.661 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-11-17T06:28:36.874+0000 7f27e276b700 -1 osd.3 0 log_to_monitors true 2023-11-17T06:29:33.661 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-11-17T06:28:36.985+0000 7fb8bbbca700 -1 osd.4 0 log_to_monitors true 2023-11-17T06:29:33.661 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-11-17T06:28:36.882+0000 7f0a169f6700 -1 osd.0 0 log_to_monitors true 2023-11-17T06:29:33.662 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-11-17T06:28:40.729+0000 7f156135e700 -1 osd.6 0 waiting for initial osdmap 2023-11-17T06:29:33.662 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-11-17T06:28:40.733+0000 7f15595f1700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.662 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-11-17T06:28:40.770+0000 7f9c475fb700 -1 osd.1 0 waiting for initial osdmap 2023-11-17T06:29:33.663 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-11-17T06:28:40.778+0000 7f9c3f7f1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.663 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-11-17T06:28:40.745+0000 7ff0bba59700 -1 osd.5 0 waiting for initial osdmap 2023-11-17T06:29:33.663 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-11-17T06:28:40.753+0000 7ff0b3bf1700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.663 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-11-17T06:28:40.790+0000 7f0a12012700 -1 osd.0 0 waiting for initial osdmap 2023-11-17T06:29:33.664 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-11-17T06:28:40.798+0000 7f0a0a1f1700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.664 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-11-17T06:28:40.785+0000 7f0ded744700 -1 osd.7 0 waiting for initial osdmap 2023-11-17T06:29:33.664 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-11-17T06:28:40.793+0000 7f0de59f1700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.664 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-11-17T06:28:40.806+0000 7fccb21c0700 -1 osd.2 0 waiting for initial osdmap 2023-11-17T06:29:33.665 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-11-17T06:28:40.818+0000 7fccaa3f1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.665 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-11-17T06:28:40.805+0000 7fb8b71e6700 -1 osd.4 0 waiting for initial osdmap 2023-11-17T06:29:33.665 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-11-17T06:28:40.813+0000 7fb8af3f1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.665 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-11-17T06:28:40.826+0000 7f27ddd87700 -1 osd.3 0 waiting for initial osdmap 2023-11-17T06:29:33.665 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-11-17T06:28:40.838+0000 7f27d5ff1700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:33.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:29:34.427 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:34.587 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 Processor -- start 2023-11-17T06:29:34.587 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 -- start start 2023-11-17T06:29:34.589 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15a190 0x7f9f7c071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.589 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c071ba0 0x7f9f7c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0caf40 con 0x7f9f7c15aab0 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c15b030 con 0x7f9f7c071ba0 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f83f54700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c15b310 con 0x7f9f7c15a190 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f814ef700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c071ba0 0x7f9f7c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f814ef700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c071ba0 0x7f9f7c15a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38430/0 (socket says 172.21.15.100:38430) 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f814ef700 1 -- 172.21.15.100:0/752761445 learned_addr learned my addr 172.21.15.100:0/752761445 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:34.590 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.584+0000 7f9f81cf0700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15a190 0x7f9f7c071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f814ef700 1 -- 172.21.15.100:0/752761445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15a190 msgr2=0x7f9f7c071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f814ef700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15a190 0x7f9f7c071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f814ef700 1 -- 172.21.15.100:0/752761445 >> v1:172.21.15.119:6789/0 conn(0x7f9f7c15aab0 legacy=0x7f9f7c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f814ef700 1 -- 172.21.15.100:0/752761445 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0cb1e0 con 0x7f9f7c071ba0 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f814ef700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c15a570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4806ec17dcd195c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f80cee700 1 -- 172.21.15.100:0/752761445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c011830 con 0x7f9f7c071ba0 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f80cee700 1 -- 172.21.15.100:0/752761445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c011990 con 0x7f9f7c071ba0 2023-11-17T06:29:34.591 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f80cee700 1 -- 172.21.15.100:0/752761445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c011d40 con 0x7f9f7c071ba0 2023-11-17T06:29:34.592 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 -- 172.21.15.100:0/752761445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 msgr2=0x7f9f7c15a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.592 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c15a570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:34.593 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 -- 172.21.15.100:0/752761445 shutdown_connections 2023-11-17T06:29:34.593 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c15a570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.593 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 --2- 172.21.15.100:0/752761445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15a190 0x7f9f7c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.593 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 -- 172.21.15.100:0/752761445 >> 172.21.15.100:0/752761445 conn(0x7f9f7c06e170 msgr2=0x7f9f7c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.594 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 -- 172.21.15.100:0/752761445 shutdown_connections 2023-11-17T06:29:34.594 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.588+0000 7f9f83f54700 1 -- 172.21.15.100:0/752761445 wait complete. 2023-11-17T06:29:34.597 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.592+0000 7f9f83f54700 1 Processor -- start 2023-11-17T06:29:34.598 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 -- start start 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 0x7f9f7c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15aab0 0x7f9f7c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c8a40 con 0x7f9f7c071ba0 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c8ed0 con 0x7f9f7c15a190 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c7e30 con 0x7f9f7c15aab0 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f81cf0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.600 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f81cf0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38444/0 (socket says 172.21.15.100:38444) 2023-11-17T06:29:34.601 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f81cf0700 1 -- 172.21.15.100:0/1827817729 learned_addr learned my addr 172.21.15.100:0/1827817729 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:34.601 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 0x7f9f7c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.601 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f824f1700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15aab0 0x7f9f7c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 -- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15aab0 msgr2=0x7f9f7c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15aab0 0x7f9f7c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 -- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 msgr2=0x7f9f7c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 -- 172.21.15.100:0/1827817729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009570 con 0x7f9f7c15a190 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f81cf0700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f814ef700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 0x7f9f7c0c70c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c016000 tx=0x7f9f6c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c004510 con 0x7f9f7c15a190 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0036c0 con 0x7f9f7c15a190 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c003a70 con 0x7f9f7c15a190 2023-11-17T06:29:34.602 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.596+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c0c8110 con 0x7f9f7c15a190 2023-11-17T06:29:34.603 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.600+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c0c86d0 con 0x7f9f7c15a190 2023-11-17T06:29:34.603 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.600+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c0c8bb0 con 0x7f9f7c15a190 2023-11-17T06:29:34.605 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.600+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f6c003bd0 con 0x7f9f7c15a190 2023-11-17T06:29:34.607 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.604+0000 7f9f727fc700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 0x7f9f600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.607 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.604+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f6c021030 con 0x7f9f7c15a190 2023-11-17T06:29:34.607 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.604+0000 7f9f81cf0700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 0x7f9f600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.608 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.604+0000 7f9f81cf0700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 0x7f9f600689d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f780113d0 tx=0x7f9f78009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.618 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.616+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f6c052cc0 con 0x7f9f7c15a190 2023-11-17T06:29:34.797 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.792+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f7c065e90 con 0x7f9f7c15a190 2023-11-17T06:29:34.799 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.796+0000 7f9f727fc700 1 -- 172.21.15.100:0/1827817729 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f9f6c02b090 con 0x7f9f7c15a190 2023-11-17T06:29:34.799 INFO:teuthology.misc.health.smithi100.stdout: 2023-11-17T06:29:34.800 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":18,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:28:46.812209+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:34.802 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.796+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 msgr2=0x7f9f600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.802 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.796+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 0x7f9f600689d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f780113d0 tx=0x7f9f78009240 comp rx=0 tx=0).stop 2023-11-17T06:29:34.802 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.796+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 msgr2=0x7f9f7c0c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.802 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.796+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 0x7f9f7c0c70c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c016000 tx=0x7f9f6c004770 comp rx=0 tx=0).stop 2023-11-17T06:29:34.802 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 shutdown_connections 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c15aab0 0x7f9f7c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c15a190 0x7f9f7c0c70c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f60066510 0x7f9f600689d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 --2- 172.21.15.100:0/1827817729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c071ba0 0x7f9f7c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 >> 172.21.15.100:0/1827817729 conn(0x7f9f7c06e170 msgr2=0x7f9f7c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 shutdown_connections 2023-11-17T06:29:34.803 INFO:teuthology.misc.health.smithi100.stderr:2023-11-17T06:29:34.800+0000 7f9f83f54700 1 -- 172.21.15.100:0/1827817729 wait complete. 2023-11-17T06:29:34.820 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-17T06:29:34.820 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-17T06:29:34.820 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-17T06:29:34.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-17T06:29:34.827 INFO:tasks.ceph.mds.a:Started 2023-11-17T06:29:34.828 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-17T06:29:34.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-17T06:29:34.832 INFO:tasks.ceph.mds.c:Started 2023-11-17T06:29:34.832 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-17T06:29:34.832 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-17T06:29:34.839 INFO:tasks.ceph.mds.b:Started 2023-11-17T06:29:34.839 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-17T06:29:34.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-17T06:29:34.846 INFO:tasks.ceph.mds.d:Started 2023-11-17T06:29:34.846 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-17T06:29:34.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:34.942 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2023-11-17T06:29:34.952 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2023-11-17T06:29:34.973 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-11-17T06:29:34.974 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-11-17T06:29:35.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.024+0000 7fb609f9e700 1 Processor -- start 2023-11-17T06:29:35.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.024+0000 7fb609f9e700 1 -- start start 2023-11-17T06:29:35.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb609f9e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6040cb3c0 0x7fb6040cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb609f9e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb604070ad0 con 0x7fb6040b1150 2023-11-17T06:29:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb609f9e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6040cb7a0 con 0x7fb60415b0a0 2023-11-17T06:29:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb609f9e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb604071f20 con 0x7fb6040cb3c0 2023-11-17T06:29:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6040cb3c0 0x7fb6040cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6040cb3c0 0x7fb6040cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38458/0 (socket says 172.21.15.100:38458) 2023-11-17T06:29:35.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 -- 172.21.15.100:0/1451673002 learned_addr learned my addr 172.21.15.100:0/1451673002 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:35.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 -- 172.21.15.100:0/1451673002 >> v1:172.21.15.119:6789/0 conn(0x7fb60415b0a0 legacy=0x7fb6040b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 -- 172.21.15.100:0/1451673002 >> v1:172.21.15.100:6789/0 conn(0x7fb6040b1150 legacy=0x7fb60415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 -- 172.21.15.100:0/1451673002 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040721a0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb603fff700 1 --2- 172.21.15.100:0/1451673002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb6040cf8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009e50 tx=0x7fb5fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8362266d36705b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb602ffd700 1 -- 172.21.15.100:0/1451673002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00e070 con 0x7fb6040cb3c0 2023-11-17T06:29:35.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb602ffd700 1 -- 172.21.15.100:0/1451673002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00b9c0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.028+0000 7fb602ffd700 1 -- 172.21.15.100:0/1451673002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00bd70 con 0x7fb6040cb3c0 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 -- 172.21.15.100:0/1451673002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 msgr2=0x7fb6040cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 --2- 172.21.15.100:0/1451673002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb6040cf8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009e50 tx=0x7fb5fc00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 -- 172.21.15.100:0/1451673002 shutdown_connections 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 --2- 172.21.15.100:0/1451673002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb6040cf8a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 -- 172.21.15.100:0/1451673002 >> 172.21.15.100:0/1451673002 conn(0x7fb60406a270 msgr2=0x7fb60406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 -- 172.21.15.100:0/1451673002 shutdown_connections 2023-11-17T06:29:35.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.032+0000 7fb609f9e700 1 -- 172.21.15.100:0/1451673002 wait complete. 2023-11-17T06:29:35.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 Processor -- start 2023-11-17T06:29:35.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 -- start start 2023-11-17T06:29:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 0x7fb604142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60415b0a0 0x7fb604157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604155270 con 0x7fb6040cb3c0 2023-11-17T06:29:35.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604143480 con 0x7fb60415b0a0 2023-11-17T06:29:35.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb604154f40 con 0x7fb6040b1150 2023-11-17T06:29:35.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38462/0 (socket says 172.21.15.100:38462) 2023-11-17T06:29:35.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 -- 172.21.15.100:0/950538721 learned_addr learned my addr 172.21.15.100:0/950538721 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:35.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb603fff700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60415b0a0 0x7fb604157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb6037fe700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 0x7fb604142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 -- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 msgr2=0x7fb604142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 0x7fb604142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 -- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60415b0a0 msgr2=0x7fb604157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60415b0a0 0x7fb604157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 -- 172.21.15.100:0/950538721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009b30 con 0x7fb6040cb3c0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb6037fe700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 0x7fb604142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb5fbfff700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c530 tx=0x7fb5ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0052d0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec005430 con 0x7fb6040cb3c0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60415c6e0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.036+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0055a0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.040+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60415cca0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.040+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6041553e0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.040+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5ec0038e0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.044+0000 7fb600ff9700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 0x7fb5e40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.044+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5ec082ff0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.044+0000 7fb6037fe700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 0x7fb5e40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.044+0000 7fb6037fe700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 0x7fb5e40689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000f60 tx=0x7fb5f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.052+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5ec0507b0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.228+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb60404eea0 con 0x7fb6040cb3c0 2023-11-17T06:29:35.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb600ff9700 1 -- 172.21.15.100:0/950538721 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12874 (secure 0 0 0) 0x7fb5ec017090 con 0x7fb6040cb3c0 2023-11-17T06:29:35.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:35.235 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:28:46.812209+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 msgr2=0x7fb5e40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 0x7fb5e40689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000f60 tx=0x7fb5f4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 msgr2=0x7fb60415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c530 tx=0x7fb5ec00c8f0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 shutdown_connections 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60415b0a0 0x7fb604157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5e4066510 0x7fb5e40689d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6040cb3c0 0x7fb60415be90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 --2- 172.21.15.100:0/950538721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6040b1150 0x7fb604142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.232+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 >> 172.21.15.100:0/950538721 conn(0x7fb60406a270 msgr2=0x7fb6040ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.236+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 shutdown_connections 2023-11-17T06:29:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.236+0000 7fb609f9e700 1 -- 172.21.15.100:0/950538721 wait complete. 2023-11-17T06:29:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:35.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:35.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.440+0000 7f531d122700 1 Processor -- start 2023-11-17T06:29:35.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.440+0000 7f531d122700 1 -- start start 2023-11-17T06:29:35.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531d122700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5318160a80 0x7f53180d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531d122700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53180b4060 0x7f53180d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531d122700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53180d2090 con 0x7f53180d16f0 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531d122700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180b2940 con 0x7f5318160a80 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531d122700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180cedb0 con 0x7f53180b4060 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5318160a80 0x7f53180d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5318160a80 0x7f53180d3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38470/0 (socket says 172.21.15.100:38470) 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 -- 172.21.15.100:0/3390109613 learned_addr learned my addr 172.21.15.100:0/3390109613 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f53177fe700 1 --1- 172.21.15.100:0/3390109613 >> v1:172.21.15.100:6789/0 conn(0x7f53180d16f0 0x7f53180cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51984/0 (socket says 172.21.15.100:51984) 2023-11-17T06:29:35.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f531c921700 1 --2- 172.21.15.100:0/3390109613 >> v2:172.21.15.119:3300/0 conn(0x7f53180b4060 0x7f53180d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 -- 172.21.15.100:0/3390109613 >> v2:172.21.15.119:3300/0 conn(0x7f53180b4060 msgr2=0x7f53180d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 --2- 172.21.15.100:0/3390109613 >> v2:172.21.15.119:3300/0 conn(0x7f53180b4060 0x7f53180d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 -- 172.21.15.100:0/3390109613 >> v1:172.21.15.100:6789/0 conn(0x7f53180d16f0 legacy=0x7f53180cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5316ffd700 1 -- 172.21.15.100:0/3390109613 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192205466 0 0) 0x7f53180d2090 con 0x7f53180d16f0 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.444+0000 7f5317fff700 1 -- 172.21.15.100:0/3390109613 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180cf090 con 0x7f5318160a80 2023-11-17T06:29:35.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f5317fff700 1 --2- 172.21.15.100:0/3390109613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5318160a80 0x7f53180d3bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f531808bdc0 tx=0x7f5308009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba47178f399e0a3f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f5316ffd700 1 -- 172.21.15.100:0/3390109613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308011830 con 0x7f5318160a80 2023-11-17T06:29:35.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f5316ffd700 1 -- 172.21.15.100:0/3390109613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011990 con 0x7f5318160a80 2023-11-17T06:29:35.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f5316ffd700 1 -- 172.21.15.100:0/3390109613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308011d20 con 0x7f5318160a80 2023-11-17T06:29:35.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 -- 172.21.15.100:0/3390109613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5318160a80 msgr2=0x7f53180d3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 --2- 172.21.15.100:0/3390109613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5318160a80 0x7f53180d3bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f531808bdc0 tx=0x7f5308009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 -- 172.21.15.100:0/3390109613 shutdown_connections 2023-11-17T06:29:35.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 --2- 172.21.15.100:0/3390109613 >> v2:172.21.15.119:3300/0 conn(0x7f53180b4060 0x7f53180d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 --2- 172.21.15.100:0/3390109613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5318160a80 0x7f53180d3bc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 -- 172.21.15.100:0/3390109613 >> 172.21.15.100:0/3390109613 conn(0x7f531809c420 msgr2=0x7f53180d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 -- 172.21.15.100:0/3390109613 shutdown_connections 2023-11-17T06:29:35.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.448+0000 7f531d122700 1 -- 172.21.15.100:0/3390109613 wait complete. 2023-11-17T06:29:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 Processor -- start 2023-11-17T06:29:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 -- start start 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 0x7f53180ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 0x7f53180ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53180c95b0 con 0x7f53180b4060 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531815f020 con 0x7f5318160a80 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531815e410 con 0x7f53180d16f0 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38478/0 (socket says 172.21.15.100:38478) 2023-11-17T06:29:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 -- 172.21.15.100:0/2449266175 learned_addr learned my addr 172.21.15.100:0/2449266175 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531c921700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 0x7f53180ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f53177fe700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 0x7f53180ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 -- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 msgr2=0x7f53180ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 0x7f53180ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 -- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 msgr2=0x7f53180ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 0x7f53180ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 -- 172.21.15.100:0/2449266175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308009570 con 0x7f53180b4060 2023-11-17T06:29:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f53177fe700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 0x7f53180ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531c921700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 0x7f53180ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5317fff700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f531808b470 tx=0x7f5308004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308004480 con 0x7f53180b4060 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530801f070 con 0x7f53180b4060 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080038e0 con 0x7f53180b4060 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.452+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531815e6f0 con 0x7f53180b4060 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.456+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531815ecb0 con 0x7f53180b4060 2023-11-17T06:29:35.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.456+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5318065e90 con 0x7f53180b4060 2023-11-17T06:29:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.456+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5308021030 con 0x7f53180b4060 2023-11-17T06:29:35.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.460+0000 7f5314ff9700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 0x7f53040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.460+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5308085020 con 0x7f53180b4060 2023-11-17T06:29:35.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.460+0000 7f53177fe700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 0x7f53040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.460+0000 7f53177fe700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 0x7f53040689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53180b19b0 tx=0x7f530c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.464+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5308052880 con 0x7f53180b4060 2023-11-17T06:29:35.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.636+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53180ce6a0 con 0x7f53180b4060 2023-11-17T06:29:35.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.640+0000 7f5314ff9700 1 -- 172.21.15.100:0/2449266175 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5308055ea0 con 0x7f53180b4060 2023-11-17T06:29:35.643 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 msgr2=0x7f53040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 0x7f53040689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53180b19b0 tx=0x7f530c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 msgr2=0x7f531815f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f531808b470 tx=0x7f5308004770 comp rx=0 tx=0).stop 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 shutdown_connections 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318160a80 0x7f53180ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180d16f0 0x7f53180ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5304066510 0x7f53040689d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 --2- 172.21.15.100:0/2449266175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53180b4060 0x7f531815f4b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 >> 172.21.15.100:0/2449266175 conn(0x7f531809c420 msgr2=0x7f53180b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 shutdown_connections 2023-11-17T06:29:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.644+0000 7f531d122700 1 -- 172.21.15.100:0/2449266175 wait complete. 2023-11-17T06:29:35.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:35.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 Processor -- start 2023-11-17T06:29:35.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 -- start start 2023-11-17T06:29:35.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f0300165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 0x7f03001621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000cfd70 con 0x7f0300161d40 2023-11-17T06:29:35.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0300165380 con 0x7f03000b1150 2023-11-17T06:29:35.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f0304d44700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0300158ce0 con 0x7f03000cf990 2023-11-17T06:29:35.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f02fdd9b700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0300161d40 0x7f03000b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:34100/0 (socket says 172.21.15.100:34100) 2023-11-17T06:29:35.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f02fdd9b700 1 -- 172.21.15.100:0/1070646736 learned_addr learned my addr 172.21.15.100:0/1070646736 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:35.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f02fed9d700 1 --2- 172.21.15.100:0/1070646736 >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 0x7f03001621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.840+0000 7f02fe59c700 1 --2- 172.21.15.100:0/1070646736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f0300165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fd59a700 1 -- 172.21.15.100:0/1070646736 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293885000 0 0) 0x7f02f4001110 con 0x7f0300161d40 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fd59a700 1 -- 172.21.15.100:0/1070646736 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e80035d0 con 0x7f0300161d40 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fe59c700 1 -- 172.21.15.100:0/1070646736 >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 msgr2=0x7f03001621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fe59c700 1 --2- 172.21.15.100:0/1070646736 >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 0x7f03001621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fe59c700 1 -- 172.21.15.100:0/1070646736 >> v1:172.21.15.119:6789/0 conn(0x7f0300161d40 legacy=0x7f03000b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fe59c700 1 -- 172.21.15.100:0/1070646736 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03001662d0 con 0x7f03000cf990 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fed9d700 1 --2- 172.21.15.100:0/1070646736 >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 0x7f03001621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:35.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fe59c700 1 --2- 172.21.15.100:0/1070646736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f0300165d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009880 tx=0x7f02f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83593a9aa0ca526f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fd59a700 1 -- 172.21.15.100:0/1070646736 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011830 con 0x7f03000cf990 2023-11-17T06:29:35.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fd59a700 1 -- 172.21.15.100:0/1070646736 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0011990 con 0x7f03000cf990 2023-11-17T06:29:35.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f02fd59a700 1 -- 172.21.15.100:0/1070646736 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011d20 con 0x7f03000cf990 2023-11-17T06:29:35.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 -- 172.21.15.100:0/1070646736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 msgr2=0x7f0300165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 --2- 172.21.15.100:0/1070646736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f0300165d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009880 tx=0x7f02f0009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:35.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 -- 172.21.15.100:0/1070646736 shutdown_connections 2023-11-17T06:29:35.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 --2- 172.21.15.100:0/1070646736 >> v2:172.21.15.100:3300/0 conn(0x7f03000b1150 0x7f03001621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 --2- 172.21.15.100:0/1070646736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f0300165d90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 -- 172.21.15.100:0/1070646736 >> 172.21.15.100:0/1070646736 conn(0x7f030006a270 msgr2=0x7f030006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 -- 172.21.15.100:0/1070646736 shutdown_connections 2023-11-17T06:29:35.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.844+0000 7f0304d44700 1 -- 172.21.15.100:0/1070646736 wait complete. 2023-11-17T06:29:35.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.848+0000 7f0304d44700 1 Processor -- start 2023-11-17T06:29:35.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.848+0000 7f0304d44700 1 -- start start 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000b1150 0x7f03000b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f03000c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c7210 con 0x7f0300161d40 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000b4aa0 con 0x7f03000b1150 2023-11-17T06:29:35.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c6590 con 0x7f03000cf990 2023-11-17T06:29:35.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38496/0 (socket says 172.21.15.100:38496) 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 -- 172.21.15.100:0/2339622223 learned_addr learned my addr 172.21.15.100:0/2339622223 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fe59c700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000b1150 0x7f03000b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fdd9b700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f03000c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 -- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 msgr2=0x7f03000c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f03000c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 -- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000b1150 msgr2=0x7f03000b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000b1150 0x7f03000b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 -- 172.21.15.100:0/2339622223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8009a70 con 0x7f0300161d40 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02fed9d700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009eb0 tx=0x7f02f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8009d50 con 0x7f0300161d40 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800f040 con 0x7f0300161d40 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800ceb0 con 0x7f0300161d40 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.852+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f00094b0 con 0x7f0300161d40 2023-11-17T06:29:35.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.856+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03000c6b50 con 0x7f0300161d40 2023-11-17T06:29:35.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.856+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030004eea0 con 0x7f0300161d40 2023-11-17T06:29:35.861 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.856+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02f8014480 con 0x7f0300161d40 2023-11-17T06:29:35.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.860+0000 7f02eeffd700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 0x7f02e00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.860+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f02f8084700 con 0x7f0300161d40 2023-11-17T06:29:35.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.860+0000 7f02fe59c700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 0x7f02e00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.860+0000 7f02fe59c700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 0x7f02e00689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000c00 tx=0x7f02f0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:35.864+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02f8051ed0 con 0x7f0300161d40 2023-11-17T06:29:36.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.080+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0300072590 con 0x7f0300161d40 2023-11-17T06:29:36.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f02eeffd700 1 -- 172.21.15.100:0/2339622223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f02f8018090 con 0x7f0300161d40 2023-11-17T06:29:36.086 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:36.086 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-17T06:29:36.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 msgr2=0x7f02e00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 0x7f02e00689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000c00 tx=0x7f02f0008030 comp rx=0 tx=0).stop 2023-11-17T06:29:36.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 msgr2=0x7f03000c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009eb0 tx=0x7f02f800c3a0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 shutdown_connections 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f02e0066510 0x7f02e00689d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0300161d40 0x7f03000c7630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03000cf990 0x7f03000c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 --2- 172.21.15.100:0/2339622223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03000b1150 0x7f03000b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 >> 172.21.15.100:0/2339622223 conn(0x7f030006a270 msgr2=0x7f03000c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 shutdown_connections 2023-11-17T06:29:36.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.084+0000 7f0304d44700 1 -- 172.21.15.100:0/2339622223 wait complete. 2023-11-17T06:29:36.091 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2023-11-17T06:29:36.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.300+0000 7ff3bd1ac700 1 Processor -- start 2023-11-17T06:29:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.300+0000 7ff3bd1ac700 1 -- start start 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3bd1ac700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff3b8161d40 0x7ff3b81621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3bd1ac700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 0x7ff3b80b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3bd1ac700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80cfd70 con 0x7ff3b80cf990 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3bd1ac700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b80b1410 con 0x7ff3b8161d40 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3bd1ac700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8165380 con 0x7ff3b80b0a40 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b6d9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff3b80cf990 0x7ff3b8165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51990/0 (socket says 172.21.15.100:51990) 2023-11-17T06:29:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b6d9d700 1 -- 172.21.15.100:0/1132919791 learned_addr learned my addr 172.21.15.100:0/1132919791 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 --2- 172.21.15.100:0/1132919791 >> v2:172.21.15.119:3300/0 conn(0x7ff3b8161d40 0x7ff3b81621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b759e700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 0x7ff3b80b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b659c700 1 -- 172.21.15.100:0/1132919791 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113035775 0 0) 0x7ff3a8001110 con 0x7ff3b80cf990 2023-11-17T06:29:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b659c700 1 -- 172.21.15.100:0/1132919791 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a40035d0 con 0x7ff3b80cf990 2023-11-17T06:29:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 -- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 msgr2=0x7ff3b80b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 0x7ff3b80b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 -- 172.21.15.100:0/1132919791 >> v1:172.21.15.100:6789/0 conn(0x7ff3b80cf990 legacy=0x7ff3b8165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 -- 172.21.15.100:0/1132919791 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8158ce0 con 0x7ff3b8161d40 2023-11-17T06:29:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b759e700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 0x7ff3b80b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3affff700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b8161d40 0x7ff3b81621c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009850 tx=0x7ff3a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cedf1d42787ae169 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b659c700 1 -- 172.21.15.100:0/1132919791 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0011830 con 0x7ff3b8161d40 2023-11-17T06:29:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b659c700 1 -- 172.21.15.100:0/1132919791 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0011990 con 0x7ff3b8161d40 2023-11-17T06:29:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.304+0000 7ff3b659c700 1 -- 172.21.15.100:0/1132919791 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0011d40 con 0x7ff3b8161d40 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b8161d40 msgr2=0x7ff3b81621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b8161d40 0x7ff3b81621c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009850 tx=0x7ff3a0009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/1132919791 shutdown_connections 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b80b0a40 0x7ff3b80b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/1132919791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b8161d40 0x7ff3b81621c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/1132919791 >> 172.21.15.100:0/1132919791 conn(0x7ff3b806a270 msgr2=0x7ff3b806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/1132919791 shutdown_connections 2023-11-17T06:29:36.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/1132919791 wait complete. 2023-11-17T06:29:36.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.308+0000 7ff3bd1ac700 1 Processor -- start 2023-11-17T06:29:36.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- start start 2023-11-17T06:29:36.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b80b0a40 0x7ff3b815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b8161d40 0x7ff3b815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80c8770 con 0x7ff3b80cf990 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80c7af0 con 0x7ff3b80b0a40 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80c7dd0 con 0x7ff3b8161d40 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38500/0 (socket says 172.21.15.100:38500) 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 -- 172.21.15.100:0/785130491 learned_addr learned my addr 172.21.15.100:0/785130491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3b759e700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b8161d40 0x7ff3b815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3b6d9d700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b80b0a40 0x7ff3b815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 -- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b8161d40 msgr2=0x7ff3b815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b8161d40 0x7ff3b815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 -- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b80b0a40 msgr2=0x7ff3b815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b80b0a40 0x7ff3b815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 -- 172.21.15.100:0/785130491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009a70 con 0x7ff3b80cf990 2023-11-17T06:29:36.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3affff700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0014040 tx=0x7ff3a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00036c0 con 0x7ff3b80cf990 2023-11-17T06:29:36.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a001e070 con 0x7ff3b80cf990 2023-11-17T06:29:36.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a00094b0 con 0x7ff3b80cf990 2023-11-17T06:29:36.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0003a80 con 0x7ff3b80cf990 2023-11-17T06:29:36.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.312+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80c8390 con 0x7ff3b80cf990 2023-11-17T06:29:36.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.316+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b804eea0 con 0x7ff3b80cf990 2023-11-17T06:29:36.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.316+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff3a0003be0 con 0x7ff3b80cf990 2023-11-17T06:29:36.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.320+0000 7ff3af7fe700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 0x7ff3980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.320+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3a0020070 con 0x7ff3b80cf990 2023-11-17T06:29:36.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.320+0000 7ff3b6d9d700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 0x7ff3980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.320+0000 7ff3b6d9d700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 0x7ff3980689d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001270 tx=0x7ff3a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.324+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3a0052830 con 0x7ff3b80cf990 2023-11-17T06:29:36.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.500+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b80cc360 con 0x7ff3b80cf990 2023-11-17T06:29:36.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.500+0000 7ff3af7fe700 1 -- 172.21.15.100:0/785130491 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12874 (secure 0 0 0) 0x7ff3a002a090 con 0x7ff3b80cf990 2023-11-17T06:29:36.504 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:36.504 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:28:46.812209+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:36.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 msgr2=0x7ff3980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 0x7ff3980689d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8001270 tx=0x7ff3a8009040 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 msgr2=0x7ff3b80c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0014040 tx=0x7ff3a0004770 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 shutdown_connections 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3b8161d40 0x7ff3b815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff398066510 0x7ff3980689d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b80cf990 0x7ff3b80c73f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 --2- 172.21.15.100:0/785130491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3b80b0a40 0x7ff3b815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 >> 172.21.15.100:0/785130491 conn(0x7ff3b806a270 msgr2=0x7ff3b8163280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 shutdown_connections 2023-11-17T06:29:36.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.504+0000 7ff3bd1ac700 1 -- 172.21.15.100:0/785130491 wait complete. 2023-11-17T06:29:36.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:36.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.708+0000 7f6679487700 1 Processor -- start 2023-11-17T06:29:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 -- start start 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f667415d6f0 0x7f66740d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740d27e0 con 0x7f667415d310 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740ce8e0 con 0x7f667415d6f0 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6679487700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740d1eb0 con 0x7f66740d2c70 2023-11-17T06:29:36.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f66737fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f667415d6f0 0x7f66740d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6672ffd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f667415d310 0x7f66740ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51998/0 (socket says 172.21.15.100:51998) 2023-11-17T06:29:36.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f66727fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f6672ffd700 1 -- 172.21.15.100:0/320671702 learned_addr learned my addr 172.21.15.100:0/320671702 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.712+0000 7f66737fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f667415d6f0 0x7f66740d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38514/0 (socket says 172.21.15.100:38514) 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6671ffb700 1 -- 172.21.15.100:0/320671702 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397886212 0 0) 0x7f66740d27e0 con 0x7f667415d310 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6671ffb700 1 -- 172.21.15.100:0/320671702 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c0035d0 con 0x7f667415d310 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66737fe700 1 -- 172.21.15.100:0/320671702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 msgr2=0x7f66740cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66737fe700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66737fe700 1 -- 172.21.15.100:0/320671702 >> v1:172.21.15.100:6789/0 conn(0x7f667415d310 legacy=0x7f66740ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66737fe700 1 -- 172.21.15.100:0/320671702 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740d2190 con 0x7f667415d6f0 2023-11-17T06:29:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66727fc700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f66737fe700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d6f0 0x7f66740d0170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f666c009d90 tx=0x7f666c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54910d26abdad8e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6671ffb700 1 -- 172.21.15.100:0/320671702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00e070 con 0x7f667415d6f0 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6671ffb700 1 -- 172.21.15.100:0/320671702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00bb20 con 0x7f667415d6f0 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6671ffb700 1 -- 172.21.15.100:0/320671702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c012430 con 0x7f667415d6f0 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 -- 172.21.15.100:0/320671702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d6f0 msgr2=0x7f66740d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d6f0 0x7f66740d0170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f666c009d90 tx=0x7f666c00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 -- 172.21.15.100:0/320671702 shutdown_connections 2023-11-17T06:29:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d6f0 0x7f66740d0170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 --2- 172.21.15.100:0/320671702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 -- 172.21.15.100:0/320671702 >> 172.21.15.100:0/320671702 conn(0x7f667406b4e0 msgr2=0x7f667406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 -- 172.21.15.100:0/320671702 shutdown_connections 2023-11-17T06:29:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.716+0000 7f6679487700 1 -- 172.21.15.100:0/320671702 wait complete. 2023-11-17T06:29:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.720+0000 7f6679487700 1 Processor -- start 2023-11-17T06:29:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.720+0000 7f6679487700 1 -- start start 2023-11-17T06:29:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 0x7f66740b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740cb510 con 0x7f667415d310 2023-11-17T06:29:36.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740cbee0 con 0x7f667415d6f0 2023-11-17T06:29:36.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740c7b60 con 0x7f66740d2c70 2023-11-17T06:29:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38528/0 (socket says 172.21.15.100:38528) 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 -- 172.21.15.100:0/2138664468 learned_addr learned my addr 172.21.15.100:0/2138664468 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6672ffd700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66737fe700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 0x7f66740b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 -- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 msgr2=0x7f66740cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 -- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 msgr2=0x7f66740b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 0x7f66740b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 -- 172.21.15.100:0/2138664468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680094b0 con 0x7f667415d310 2023-11-17T06:29:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66737fe700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 0x7f66740b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f66727fc700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f666800ebb0 tx=0x7f666800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800c850 con 0x7f667415d310 2023-11-17T06:29:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c009a70 con 0x7f667415d310 2023-11-17T06:29:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800c9b0 con 0x7f667415d310 2023-11-17T06:29:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800cd40 con 0x7f667415d310 2023-11-17T06:29:36.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.724+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66740caec0 con 0x7f667415d310 2023-11-17T06:29:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.728+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66740cb680 con 0x7f667415d310 2023-11-17T06:29:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.728+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6668013470 con 0x7f667415d310 2023-11-17T06:29:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.728+0000 7f665b7fe700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 0x7f66600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.728+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6668083d10 con 0x7f667415d310 2023-11-17T06:29:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.728+0000 7f6672ffd700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 0x7f66600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.732+0000 7f6672ffd700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 0x7f66600689d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6664007fd0 tx=0x7f6664007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.736+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6668089020 con 0x7f667415d310 2023-11-17T06:29:36.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.908+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f667404eea0 con 0x7f667415d310 2023-11-17T06:29:36.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f665b7fe700 1 -- 172.21.15.100:0/2138664468 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66680513c0 con 0x7f667415d310 2023-11-17T06:29:36.914 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:29:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 msgr2=0x7f66600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 0x7f66600689d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6664007fd0 tx=0x7f6664007de0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 msgr2=0x7f667415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f666800ebb0 tx=0x7f666800eec0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 shutdown_connections 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f667415d6f0 0x7f66740b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6660066510 0x7f66600689d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f667415d310 0x7f667415a600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 --2- 172.21.15.100:0/2138664468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66740d2c70 0x7f66740cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 >> 172.21.15.100:0/2138664468 conn(0x7f667406b4e0 msgr2=0x7f667415ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 shutdown_connections 2023-11-17T06:29:36.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:36.912+0000 7f6679487700 1 -- 172.21.15.100:0/2138664468 wait complete. 2023-11-17T06:29:36.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-17T06:29:37.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.096+0000 7f7ffe722700 1 Processor -- start 2023-11-17T06:29:37.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.096+0000 7f7ffe722700 1 -- start start 2023-11-17T06:29:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffe722700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7ff80c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffe722700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff80cde60 con 0x7f7ff815d450 2023-11-17T06:29:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffe722700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff80ce450 con 0x7f7ff806c290 2023-11-17T06:29:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffe722700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80cd600 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffd720700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7ff815d450 0x7f7ff80c3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52010/0 (socket says 172.21.15.100:52010) 2023-11-17T06:29:37.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffd720700 1 -- 172.21.15.100:0/11821928 learned_addr learned my addr 172.21.15.100:0/11821928 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:37.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7ffcf1f700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7ff80c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676593460 0 0) 0x7f7ff80cde60 con 0x7f7ff815d450 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe40035d0 con 0x7f7ff815d450 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940210854 0 0) 0x7f7ff80ce450 con 0x7f7ff806c290 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff80cde60 con 0x7f7ff806c290 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972739291 0 0) 0x7f7fe40035d0 con 0x7f7ff815d450 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 msgr2=0x7f7ff80c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7ff80c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 >> v1:172.21.15.119:6789/0 conn(0x7f7ff806c290 legacy=0x7f7ff806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80cd810 con 0x7f7ff815d450 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f7ff4001670 con 0x7f7ff815d450 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 >> v1:172.21.15.100:6789/0 conn(0x7f7ff815d450 legacy=0x7f7ff80c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe4003be0 0x7f7fe4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.100+0000 7f7feffff700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe4004870 0x7f7fe4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7fe4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80cd600 con 0x7f7fe4004870 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe400bae0 con 0x7f7fe4003be0 2023-11-17T06:29:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe400bc70 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7fe4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffcf1f700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe4004870 0x7f7fe4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffd720700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe4003be0 0x7f7fe4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 -- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe4003be0 msgr2=0x7f7fe4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe4003be0 0x7f7fe4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 -- 172.21.15.100:0/11821928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe4004870 msgr2=0x7f7fe4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe4004870 0x7f7fe4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 -- 172.21.15.100:0/11821928 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40035d0 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7fe4005230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000c2f0 tx=0x7f7fe40058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6768201aac888979 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0001f30 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000ce70 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7feffff700 1 -- 172.21.15.100:0/11821928 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0003c40 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 -- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 msgr2=0x7f7fe4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 --2- 172.21.15.100:0/11821928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff80ac8c0 0x7f7fe4005230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000c2f0 tx=0x7f7fe40058a0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffdf21700 1 -- 172.21.15.100:0/11821928 reap_dead start 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 -- 172.21.15.100:0/11821928 shutdown_connections 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 -- 172.21.15.100:0/11821928 >> 172.21.15.100:0/11821928 conn(0x7f7ff80cb730 msgr2=0x7f7ff80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 -- 172.21.15.100:0/11821928 shutdown_connections 2023-11-17T06:29:37.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.104+0000 7f7ffe722700 1 -- 172.21.15.100:0/11821928 wait complete. 2023-11-17T06:29:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.108+0000 7f7ffe722700 1 Processor -- start 2023-11-17T06:29:37.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.108+0000 7f7ffe722700 1 -- start start 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff8158dc0 0x7f7ff80af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 0x7f7ff81f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80b0180 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80b4800 con 0x7f7ff80afcd0 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff80b3b70 con 0x7f7ff8158dc0 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38540/0 (socket says 172.21.15.100:38540) 2023-11-17T06:29:37.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 -- 172.21.15.100:0/2537841527 learned_addr learned my addr 172.21.15.100:0/2537841527 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 0x7f7ff81f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffcf1f700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff8158dc0 0x7f7ff80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 -- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff8158dc0 msgr2=0x7f7ff80af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff8158dc0 0x7f7ff80af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 -- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 msgr2=0x7f7ff81f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 0x7f7ff81f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 -- 172.21.15.100:0/2537841527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff81f3810 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffdf21700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 0x7f7ff81f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffd720700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40073a0 tx=0x7f7ff4007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400f8d0 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400fa50 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400fe00 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff81f3530 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.112+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff80b2e30 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.116+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff8065e90 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.116+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ff401d360 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.116+0000 7f7fedffb700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 0x7f7fdc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.116+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ff40831f0 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.116+0000 7f7ffcf1f700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 0x7f7fdc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.120+0000 7f7ffcf1f700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 0x7f7fdc068a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8159710 tx=0x7f7fe8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.124+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ff4050a50 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.300+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7ff815cc70 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.300+0000 7f7fedffb700 1 -- 172.21.15.100:0/2537841527 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7ff4054070 con 0x7f7ff80ac8c0 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:29:37.304 INFO:teuthology.orchestra.run.smithi100.stdout:] 2023-11-17T06:29:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 msgr2=0x7f7fdc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 0x7f7fdc068a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8159710 tx=0x7f7fe8008040 comp rx=0 tx=0).stop 2023-11-17T06:29:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 msgr2=0x7f7ff80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40073a0 tx=0x7f7ff4007760 comp rx=0 tx=0).stop 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 shutdown_connections 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff80afcd0 0x7f7ff81f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff8158dc0 0x7f7ff80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fdc066540 0x7f7fdc068a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 --2- 172.21.15.100:0/2537841527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff80ac8c0 0x7f7ff80b3630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 >> 172.21.15.100:0/2537841527 conn(0x7f7ff80cb730 msgr2=0x7f7ff80acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:37.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 shutdown_connections 2023-11-17T06:29:37.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.304+0000 7f7ffe722700 1 -- 172.21.15.100:0/2537841527 wait complete. 2023-11-17T06:29:37.326 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-17T06:29:37.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-17T06:29:37.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.508+0000 7f5893bc2700 1 Processor -- start 2023-11-17T06:29:37.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.508+0000 7f5893bc2700 1 -- start start 2023-11-17T06:29:37.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c165be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f588c0cbc80 0x7f588c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f588c0b0f80 0x7f588c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c0b13f0 con 0x7f588c0b0f80 2023-11-17T06:29:37.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c166120 con 0x7f588c0cbc80 2023-11-17T06:29:37.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f5893bc2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0c97c0 con 0x7f588c14b190 2023-11-17T06:29:37.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f588c0b0f80 0x7f588c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f588c0b0f80 0x7f588c0cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38550/0 (socket says 172.21.15.100:38550) 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 -- 172.21.15.100:0/3205843749 learned_addr learned my addr 172.21.15.100:0/3205843749 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589195e700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589115d700 1 --2- 172.21.15.100:0/3205843749 >> v2:172.21.15.119:3300/0 conn(0x7f588c0cbc80 0x7f588c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 -- 172.21.15.100:0/3205843749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 msgr2=0x7f588c165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c165be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 -- 172.21.15.100:0/3205843749 >> v2:172.21.15.119:3300/0 conn(0x7f588c0cbc80 msgr2=0x7f588c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 --2- 172.21.15.100:0/3205843749 >> v2:172.21.15.119:3300/0 conn(0x7f588c0cbc80 0x7f588c0b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 -- 172.21.15.100:0/3205843749 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0c9aa0 con 0x7f588c0b0f80 2023-11-17T06:29:37.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589215f700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0cc960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f588c06d910 tx=0x7f588400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ba6a4f2a4ce8b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589095c700 1 -- 172.21.15.100:0/3205843749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588400e070 con 0x7f588c0b0f80 2023-11-17T06:29:37.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589095c700 1 -- 172.21.15.100:0/3205843749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588400b9c0 con 0x7f588c0b0f80 2023-11-17T06:29:37.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.512+0000 7f589095c700 1 -- 172.21.15.100:0/3205843749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588400bd70 con 0x7f588c0b0f80 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 -- 172.21.15.100:0/3205843749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 msgr2=0x7f588c0cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0cc960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f588c06d910 tx=0x7f588400b330 comp rx=0 tx=0).stop 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 -- 172.21.15.100:0/3205843749 shutdown_connections 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0cc960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3205843749 >> v2:172.21.15.119:3300/0 conn(0x7f588c0cbc80 0x7f588c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3205843749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 -- 172.21.15.100:0/3205843749 >> 172.21.15.100:0/3205843749 conn(0x7f588c06a270 msgr2=0x7f588c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:37.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 -- 172.21.15.100:0/3205843749 shutdown_connections 2023-11-17T06:29:37.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.516+0000 7f5893bc2700 1 -- 172.21.15.100:0/3205843749 wait complete. 2023-11-17T06:29:37.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 Processor -- start 2023-11-17T06:29:37.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 -- start start 2023-11-17T06:29:37.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f588c0cbc80 0x7f588c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c1fb780 con 0x7f588c0b0f80 2023-11-17T06:29:37.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c1fac00 con 0x7f588c0cbc80 2023-11-17T06:29:37.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f5893bc2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c1faee0 con 0x7f588c14b190 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38560/0 (socket says 172.21.15.100:38560) 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 -- 172.21.15.100:0/3967813071 learned_addr learned my addr 172.21.15.100:0/3967813071 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589115d700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f588c0cbc80 0x7f588c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589215f700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 -- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 msgr2=0x7f588c0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 -- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f588c0cbc80 msgr2=0x7f588c1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f588c0cbc80 0x7f588c1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.520+0000 7f589195e700 1 -- 172.21.15.100:0/3967813071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884009b30 con 0x7f588c0b0f80 2023-11-17T06:29:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f589195e700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f588800e760 tx=0x7f588800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800c070 con 0x7f588c0b0f80 2023-11-17T06:29:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888013610 con 0x7f588c0b0f80 2023-11-17T06:29:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c1fb1c0 con 0x7f588c0b0f80 2023-11-17T06:29:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888013980 con 0x7f588c0b0f80 2023-11-17T06:29:37.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c0c72d0 con 0x7f588c0b0f80 2023-11-17T06:29:37.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c04eea0 con 0x7f588c0b0f80 2023-11-17T06:29:37.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.524+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5888013ae0 con 0x7f588c0b0f80 2023-11-17T06:29:37.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.528+0000 7f58827fc700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 0x7f58700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:37.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.528+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5888083820 con 0x7f588c0b0f80 2023-11-17T06:29:37.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.528+0000 7f589115d700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 0x7f58700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:37.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.528+0000 7f589115d700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 0x7f58700689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f588c164960 tx=0x7f587c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:37.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.532+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5888050ff0 con 0x7f588c0b0f80 2023-11-17T06:29:37.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.708+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f588c06cb70 con 0x7f588c0b0f80 2023-11-17T06:29:37.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.972+0000 7f58827fc700 1 -- 172.21.15.100:0/3967813071 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5888054610 con 0x7f588c0b0f80 2023-11-17T06:29:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 msgr2=0x7f58700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 0x7f58700689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f588c164960 tx=0x7f587c008040 comp rx=0 tx=0).stop 2023-11-17T06:29:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 msgr2=0x7f588c0c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f588800e760 tx=0x7f588800ea70 comp rx=0 tx=0).stop 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 shutdown_connections 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f588c14b190 0x7f588c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f588c0cbc80 0x7f588c1653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5870066510 0x7f58700689d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 --2- 172.21.15.100:0/3967813071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f588c0b0f80 0x7f588c0c6d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 >> 172.21.15.100:0/3967813071 conn(0x7f588c06a270 msgr2=0x7f588c071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 shutdown_connections 2023-11-17T06:29:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:37.976+0000 7f5893bc2700 1 -- 172.21.15.100:0/3967813071 wait complete. 2023-11-17T06:29:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2023-11-17T06:29:38.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-17T06:29:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.188+0000 7fbd1f5bf700 1 Processor -- start 2023-11-17T06:29:38.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.188+0000 7fbd1f5bf700 1 -- start start 2023-11-17T06:29:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd180d2c70 0x7fbd180cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd1815d6f0 0x7fbd180d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180d27e0 con 0x7fbd1815d310 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180ce8e0 con 0x7fbd1815d6f0 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180d1eb0 con 0x7fbd180d2c70 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd1815d6f0 0x7fbd180d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd1815d6f0 0x7fbd180d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38568/0 (socket says 172.21.15.100:38568) 2023-11-17T06:29:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 -- 172.21.15.100:0/3564198836 learned_addr learned my addr 172.21.15.100:0/3564198836 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1cb5a700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd180d2c70 0x7fbd180cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 -- 172.21.15.100:0/3564198836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd180d2c70 msgr2=0x7fbd180cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd180d2c70 0x7fbd180cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 -- 172.21.15.100:0/3564198836 >> v1:172.21.15.100:6789/0 conn(0x7fbd1815d310 legacy=0x7fbd180ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 -- 172.21.15.100:0/3564198836 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180d2190 con 0x7fbd1815d6f0 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1db5c700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd1815d6f0 0x7fbd180d0170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009e50 tx=0x7fbd1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb26a435ff367a7b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd0ffff700 1 -- 172.21.15.100:0/3564198836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000e070 con 0x7fbd1815d6f0 2023-11-17T06:29:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd0ffff700 1 -- 172.21.15.100:0/3564198836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000b9c0 con 0x7fbd1815d6f0 2023-11-17T06:29:38.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd0ffff700 1 -- 172.21.15.100:0/3564198836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000bd70 con 0x7fbd1815d6f0 2023-11-17T06:29:38.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/3564198836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd1815d6f0 msgr2=0x7fbd180d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd1815d6f0 0x7fbd180d0170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009e50 tx=0x7fbd1000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/3564198836 shutdown_connections 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd1815d6f0 0x7fbd180d0170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/3564198836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd180d2c70 0x7fbd180cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.192+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/3564198836 >> 172.21.15.100:0/3564198836 conn(0x7fbd1806b4e0 msgr2=0x7fbd1806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/3564198836 shutdown_connections 2023-11-17T06:29:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/3564198836 wait complete. 2023-11-17T06:29:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 Processor -- start 2023-11-17T06:29:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- start start 2023-11-17T06:29:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 0x7fbd1815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd1815d6f0 0x7fbd1815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180cc0f0 con 0x7fbd180d2c70 2023-11-17T06:29:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180cb470 con 0x7fbd1815d310 2023-11-17T06:29:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1f5bf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180cb750 con 0x7fbd1815d6f0 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.196+0000 7fbd1d35b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1cb5a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 0x7fbd1815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38580/0 (socket says 172.21.15.100:38580) 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 -- 172.21.15.100:0/1140923392 learned_addr learned my addr 172.21.15.100:0/1140923392 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1db5c700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd1815d6f0 0x7fbd1815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 -- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd1815d6f0 msgr2=0x7fbd1815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd1815d6f0 0x7fbd1815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 -- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 msgr2=0x7fbd1815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 0x7fbd1815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 -- 172.21.15.100:0/1140923392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009b30 con 0x7fbd180d2c70 2023-11-17T06:29:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1cb5a700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 0x7fbd1815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1d35b700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c500 tx=0x7fbd1400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140052d0 con 0x7fbd180d2c70 2023-11-17T06:29:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14005430 con 0x7fbd180d2c70 2023-11-17T06:29:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140055a0 con 0x7fbd180d2c70 2023-11-17T06:29:38.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180cba30 con 0x7fbd180d2c70 2023-11-17T06:29:38.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.200+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd180c9340 con 0x7fbd180d2c70 2023-11-17T06:29:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.204+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1804eea0 con 0x7fbd180d2c70 2023-11-17T06:29:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.204+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd140038e0 con 0x7fbd180d2c70 2023-11-17T06:29:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.204+0000 7fbd0dffb700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.204+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbd14082ff0 con 0x7fbd180d2c70 2023-11-17T06:29:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.208+0000 7fbd1cb5a700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.208+0000 7fbd1cb5a700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 0x7fbcfc0689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd181605c0 tx=0x7fbd08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:38.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.212+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd14050640 con 0x7fbd180d2c70 2023-11-17T06:29:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.384+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbd181606f0 con 0x7fbd180d2c70 2023-11-17T06:29:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.980+0000 7fbd0dffb700 1 -- 172.21.15.100:0/1140923392 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbd140170d0 con 0x7fbd180d2c70 2023-11-17T06:29:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 msgr2=0x7fbcfc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 0x7fbcfc0689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd181605c0 tx=0x7fbd08008040 comp rx=0 tx=0).stop 2023-11-17T06:29:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 msgr2=0x7fbd180c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c500 tx=0x7fbd1400c810 comp rx=0 tx=0).stop 2023-11-17T06:29:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 shutdown_connections 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd1815d6f0 0x7fbd1815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd1815d310 0x7fbd1815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 --2- 172.21.15.100:0/1140923392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd180d2c70 0x7fbd180c8e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 >> 172.21.15.100:0/1140923392 conn(0x7fbd1806b4e0 msgr2=0x7fbd180cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 shutdown_connections 2023-11-17T06:29:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:38.984+0000 7fbd1f5bf700 1 -- 172.21.15.100:0/1140923392 wait complete. 2023-11-17T06:29:38.999 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2023-11-17T06:29:39.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-17T06:29:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.196+0000 7f5dc4c76700 1 Processor -- start 2023-11-17T06:29:39.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.196+0000 7f5dc4c76700 1 -- start start 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dc015aec0 0x7f5dc015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dc00b1350 0x7f5dc00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00ce380 con 0x7f5dc00b1350 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00b17e0 con 0x7f5dc015aec0 2023-11-17T06:29:39.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dc4c76700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00cc400 con 0x7f5dc00ce7a0 2023-11-17T06:29:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dc00b1350 0x7f5dc00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbdd9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbdd9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:39820/0 (socket says 172.21.15.100:39820) 2023-11-17T06:29:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbe59c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dc015aec0 0x7f5dc015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbdd9b700 1 -- 172.21.15.100:0/3324083840 learned_addr learned my addr 172.21.15.100:0/3324083840 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 -- 172.21.15.100:0/3324083840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 msgr2=0x7f5dc00b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 -- 172.21.15.100:0/3324083840 >> v2:172.21.15.119:3300/0 conn(0x7f5dc015aec0 msgr2=0x7f5dc015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/3324083840 >> v2:172.21.15.119:3300/0 conn(0x7f5dc015aec0 0x7f5dc015b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 -- 172.21.15.100:0/3324083840 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00cdcc0 con 0x7f5dc00b1350 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbdd9b700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.200+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc00b1350 0x7f5dc00cb6a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00cc9b0 tx=0x7f5db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4287b201ab5183c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dbd59a700 1 -- 172.21.15.100:0/3324083840 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800e070 con 0x7f5dc00b1350 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dbd59a700 1 -- 172.21.15.100:0/3324083840 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800bb20 con 0x7f5dc00b1350 2023-11-17T06:29:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dbd59a700 1 -- 172.21.15.100:0/3324083840 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8012430 con 0x7f5dc00b1350 2023-11-17T06:29:39.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 -- 172.21.15.100:0/3324083840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc00b1350 msgr2=0x7f5dc00cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:39.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc00b1350 0x7f5dc00cb6a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00cc9b0 tx=0x7f5db800b330 comp rx=0 tx=0).stop 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 -- 172.21.15.100:0/3324083840 shutdown_connections 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc00b1350 0x7f5dc00cb6a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/3324083840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00ce7a0 0x7f5dc00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/3324083840 >> v2:172.21.15.119:3300/0 conn(0x7f5dc015aec0 0x7f5dc015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 -- 172.21.15.100:0/3324083840 >> 172.21.15.100:0/3324083840 conn(0x7f5dc006a450 msgr2=0x7f5dc006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 -- 172.21.15.100:0/3324083840 shutdown_connections 2023-11-17T06:29:39.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.204+0000 7f5dc4c76700 1 -- 172.21.15.100:0/3324083840 wait complete. 2023-11-17T06:29:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 Processor -- start 2023-11-17T06:29:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 -- start start 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00b1350 0x7f5dc015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dc00ce7a0 0x7f5dc00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc01f2880 con 0x7f5dc015aec0 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc015ea80 con 0x7f5dc00ce7a0 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.208+0000 7f5dc4c76700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc01f2b40 con 0x7f5dc00b1350 2023-11-17T06:29:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38586/0 (socket says 172.21.15.100:38586) 2023-11-17T06:29:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 -- 172.21.15.100:0/1893351952 learned_addr learned my addr 172.21.15.100:0/1893351952 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbdd9b700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dc00ce7a0 0x7f5dc00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbe59c700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00b1350 0x7f5dc015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 -- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00b1350 msgr2=0x7f5dc015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00b1350 0x7f5dc015c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 -- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dc00ce7a0 msgr2=0x7f5dc00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dc00ce7a0 0x7f5dc00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 -- 172.21.15.100:0/1893351952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db400b810 con 0x7f5dc015aec0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dbed9d700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5db8014040 tx=0x7f5db8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8004800 con 0x7f5dc015aec0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8020070 con 0x7f5dc015aec0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80276c0 con 0x7f5dc015aec0 2023-11-17T06:29:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8009a70 con 0x7f5dc015aec0 2023-11-17T06:29:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc01f3100 con 0x7f5dc015aec0 2023-11-17T06:29:39.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.212+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc004eea0 con 0x7f5dc015aec0 2023-11-17T06:29:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.216+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5db8012430 con 0x7f5dc015aec0 2023-11-17T06:29:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.216+0000 7f5daeffd700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 0x7f5da0068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.216+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5db8022070 con 0x7f5dc015aec0 2023-11-17T06:29:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.216+0000 7f5dbe59c700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 0x7f5da0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:39.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.220+0000 7f5dbe59c700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 0x7f5da0068a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009bf0 tx=0x7f5db0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:39.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.224+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5db8087e60 con 0x7f5dc015aec0 2023-11-17T06:29:39.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:39.436+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5dc00cd4b0 con 0x7f5dc015aec0 2023-11-17T06:29:40.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.024+0000 7f5daeffd700 1 -- 172.21.15.100:0/1893351952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5db8053200 con 0x7f5dc015aec0 2023-11-17T06:29:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 msgr2=0x7f5da0068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 0x7f5da0068a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009bf0 tx=0x7f5db0009240 comp rx=0 tx=0).stop 2023-11-17T06:29:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 msgr2=0x7f5dc00ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5db8014040 tx=0x7f5db8004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 shutdown_connections 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5da0066560 0x7f5da0068a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc015aec0 0x7f5dc00ca4a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dc00ce7a0 0x7f5dc00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 --2- 172.21.15.100:0/1893351952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dc00b1350 0x7f5dc015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.032+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 >> 172.21.15.100:0/1893351952 conn(0x7f5dc006a450 msgr2=0x7f5dc015a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.036+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 shutdown_connections 2023-11-17T06:29:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.036+0000 7f5dc4c76700 1 -- 172.21.15.100:0/1893351952 wait complete. 2023-11-17T06:29:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2023-11-17T06:29:40.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.240+0000 7feab32b6700 1 Processor -- start 2023-11-17T06:29:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 -- start start 2023-11-17T06:29:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaac144ac0 0x7feaac06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feaac0cde70 0x7feaac0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0c9c90 con 0x7feaac0c9840 2023-11-17T06:29:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac06da00 con 0x7feaac144ac0 2023-11-17T06:29:40.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.244+0000 7feab32b6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac06cf70 con 0x7feaac0cde70 2023-11-17T06:29:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaac144ac0 0x7feaac06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab1ab3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feaac0cde70 0x7feaac0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaac144ac0 0x7feaac06ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38592/0 (socket says 172.21.15.100:38592) 2023-11-17T06:29:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 -- 172.21.15.100:0/2867617992 learned_addr learned my addr 172.21.15.100:0/2867617992 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 -- 172.21.15.100:0/2867617992 >> v2:172.21.15.119:3300/0 conn(0x7feaac0cde70 msgr2=0x7feaac0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 --2- 172.21.15.100:0/2867617992 >> v2:172.21.15.119:3300/0 conn(0x7feaac0cde70 0x7feaac0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 -- 172.21.15.100:0/2867617992 >> v1:172.21.15.119:6789/0 conn(0x7feaac0c9840 legacy=0x7feaac0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 -- 172.21.15.100:0/2867617992 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac06d160 con 0x7feaac144ac0 2023-11-17T06:29:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab22b4700 1 --2- 172.21.15.100:0/2867617992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac144ac0 0x7feaac06ca30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feaac072870 tx=0x7feaa8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226b7d55f435a1d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab12b2700 1 -- 172.21.15.100:0/2867617992 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011830 con 0x7feaac144ac0 2023-11-17T06:29:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab12b2700 1 -- 172.21.15.100:0/2867617992 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8011990 con 0x7feaac144ac0 2023-11-17T06:29:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab12b2700 1 -- 172.21.15.100:0/2867617992 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011d20 con 0x7feaac144ac0 2023-11-17T06:29:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 -- 172.21.15.100:0/2867617992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac144ac0 msgr2=0x7feaac06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 --2- 172.21.15.100:0/2867617992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac144ac0 0x7feaac06ca30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feaac072870 tx=0x7feaa8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 -- 172.21.15.100:0/2867617992 shutdown_connections 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 --2- 172.21.15.100:0/2867617992 >> v2:172.21.15.119:3300/0 conn(0x7feaac0cde70 0x7feaac0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 --2- 172.21.15.100:0/2867617992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac144ac0 0x7feaac06ca30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.248+0000 7feab32b6700 1 -- 172.21.15.100:0/2867617992 >> 172.21.15.100:0/2867617992 conn(0x7feaac0cb730 msgr2=0x7feaac0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- 172.21.15.100:0/2867617992 shutdown_connections 2023-11-17T06:29:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- 172.21.15.100:0/2867617992 wait complete. 2023-11-17T06:29:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 Processor -- start 2023-11-17T06:29:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- start start 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feaac0c9840 0x7feaac1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 0x7feaac15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c4bf0 con 0x7feaac0cde70 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c3b50 con 0x7feaac144ac0 2023-11-17T06:29:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab32b6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c3e30 con 0x7feaac0c9840 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab1ab3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab1ab3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38596/0 (socket says 172.21.15.100:38596) 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab1ab3700 1 -- 172.21.15.100:0/952096297 learned_addr learned my addr 172.21.15.100:0/952096297 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.252+0000 7feab2ab5700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 0x7feaac15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab22b4700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feaac0c9840 0x7feaac1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 -- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feaac0c9840 msgr2=0x7feaac1f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feaac0c9840 0x7feaac1f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 -- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 msgr2=0x7feaac15dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 0x7feaac15dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 -- 172.21.15.100:0/952096297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8009570 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab2ab5700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 0x7feaac15dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab1ab3700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e9d0 tx=0x7fea9c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c009720 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00c850 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0c4110 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00cbc0 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac0c46d0 con 0x7feaac0cde70 2023-11-17T06:29:40.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.256+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac065e90 con 0x7feaac0cde70 2023-11-17T06:29:40.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.260+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea9c00cd20 con 0x7feaac0cde70 2023-11-17T06:29:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.260+0000 7feaa2ffd700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 0x7fea900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.260+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea9c0840b0 con 0x7feaac0cde70 2023-11-17T06:29:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.260+0000 7feab22b4700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 0x7fea900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.260+0000 7feab22b4700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 0x7fea900689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaa8000c00 tx=0x7feaa8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.264+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea9c051490 con 0x7feaac0cde70 2023-11-17T06:29:40.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.436+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaac140e80 con 0x7feaac0cde70 2023-11-17T06:29:40.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.440+0000 7feaa2ffd700 1 -- 172.21.15.100:0/952096297 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fea9c054ab0 con 0x7feaac0cde70 2023-11-17T06:29:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:40.445 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:39.440488+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:40.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 msgr2=0x7fea900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 0x7fea900689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feaa8000c00 tx=0x7feaa8008030 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 msgr2=0x7feaac15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e9d0 tx=0x7fea9c00ed90 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 shutdown_connections 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac144ac0 0x7feaac15dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea90066510 0x7fea900689d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaac0cde70 0x7feaac15d6a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 --2- 172.21.15.100:0/952096297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feaac0c9840 0x7feaac1f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 >> 172.21.15.100:0/952096297 conn(0x7feaac0cb730 msgr2=0x7feaac06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 shutdown_connections 2023-11-17T06:29:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.444+0000 7feab32b6700 1 -- 172.21.15.100:0/952096297 wait complete. 2023-11-17T06:29:40.467 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.624+0000 7f9d5359e700 1 Processor -- start 2023-11-17T06:29:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.624+0000 7f9d5359e700 1 -- start start 2023-11-17T06:29:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9d5415d450 0x7f9d540c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5359e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9d5406c290 0x7f9d5406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5359e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540cde60 con 0x7f9d540ac8c0 2023-11-17T06:29:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5359e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540cd600 con 0x7f9d5406c290 2023-11-17T06:29:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540ce450 con 0x7f9d5415d450 2023-11-17T06:29:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9d5415d450 0x7f9d540c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d52d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9d5406c290 0x7f9d5406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9d5415d450 0x7f9d540c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:56228/0 (socket says 172.21.15.100:56228) 2023-11-17T06:29:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 -- 172.21.15.100:0/1580276410 learned_addr learned my addr 172.21.15.100:0/1580276410 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 -- 172.21.15.100:0/1580276410 >> v2:172.21.15.100:3300/0 conn(0x7f9d5406c290 msgr2=0x7f9d5406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 --2- 172.21.15.100:0/1580276410 >> v2:172.21.15.100:3300/0 conn(0x7f9d5406c290 0x7f9d5406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 -- 172.21.15.100:0/1580276410 >> v1:172.21.15.100:6789/0 conn(0x7f9d540ac8c0 legacy=0x7f9d540c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 -- 172.21.15.100:0/1580276410 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540cd810 con 0x7f9d5415d450 2023-11-17T06:29:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d5259c700 1 --2- 172.21.15.100:0/1580276410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c3d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d5406dbe0 tx=0x7f9d4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4edac06c3bb43ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.628+0000 7f9d51d9b700 1 -- 172.21.15.100:0/1580276410 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400e070 con 0x7f9d5415d450 2023-11-17T06:29:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d51d9b700 1 -- 172.21.15.100:0/1580276410 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400b910 con 0x7f9d5415d450 2023-11-17T06:29:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d51d9b700 1 -- 172.21.15.100:0/1580276410 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400bcc0 con 0x7f9d5415d450 2023-11-17T06:29:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 -- 172.21.15.100:0/1580276410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 msgr2=0x7f9d540c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 --2- 172.21.15.100:0/1580276410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c3d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d5406dbe0 tx=0x7f9d4400b330 comp rx=0 tx=0).stop 2023-11-17T06:29:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 -- 172.21.15.100:0/1580276410 shutdown_connections 2023-11-17T06:29:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 --2- 172.21.15.100:0/1580276410 >> v2:172.21.15.100:3300/0 conn(0x7f9d5406c290 0x7f9d5406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 --2- 172.21.15.100:0/1580276410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c3d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 -- 172.21.15.100:0/1580276410 >> 172.21.15.100:0/1580276410 conn(0x7f9d540cb730 msgr2=0x7f9d540cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 -- 172.21.15.100:0/1580276410 shutdown_connections 2023-11-17T06:29:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.632+0000 7f9d5359e700 1 -- 172.21.15.100:0/1580276410 wait complete. 2023-11-17T06:29:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 Processor -- start 2023-11-17T06:29:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 -- start start 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d5406c290 0x7f9d5414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5414e8c0 con 0x7f9d540ac8c0 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c5d80 con 0x7f9d5415d450 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.636+0000 7f9d5359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c6790 con 0x7f9d5406c290 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38604/0 (socket says 172.21.15.100:38604) 2023-11-17T06:29:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 -- 172.21.15.100:0/3438509151 learned_addr learned my addr 172.21.15.100:0/3438509151 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d5259c700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d5406c290 0x7f9d5414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d52d9d700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 -- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d5406c290 msgr2=0x7f9d5414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d5406c290 0x7f9d5414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 -- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 msgr2=0x7f9d540c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 -- 172.21.15.100:0/3438509151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44009b30 con 0x7f9d540ac8c0 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d52d9d700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d49d9b700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c500 tx=0x7f9d3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0052d0 con 0x7f9d540ac8c0 2023-11-17T06:29:40.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c005430 con 0x7f9d540ac8c0 2023-11-17T06:29:40.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d540b2e10 con 0x7f9d540ac8c0 2023-11-17T06:29:40.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0055a0 con 0x7f9d540ac8c0 2023-11-17T06:29:40.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d540c69e0 con 0x7f9d540ac8c0 2023-11-17T06:29:40.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.640+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54065e90 con 0x7f9d540ac8c0 2023-11-17T06:29:40.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.644+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d3c0038c0 con 0x7f9d540ac8c0 2023-11-17T06:29:40.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.644+0000 7f9d4b7fe700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 0x7f9d340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:40.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.644+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d3c083350 con 0x7f9d540ac8c0 2023-11-17T06:29:40.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.644+0000 7f9d5259c700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 0x7f9d340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:40.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.648+0000 7f9d5259c700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 0x7f9d340689d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000f80 tx=0x7f9d44009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.648+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d3c050730 con 0x7f9d540ac8c0 2023-11-17T06:29:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.820+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d540c9b00 con 0x7f9d540ac8c0 2023-11-17T06:29:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.824+0000 7f9d4b7fe700 1 -- 172.21.15.100:0/3438509151 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f9d3c053d50 con 0x7f9d540ac8c0 2023-11-17T06:29:40.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:40.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:39.440488+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 msgr2=0x7f9d340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 0x7f9d340689d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000f80 tx=0x7f9d44009000 comp rx=0 tx=0).stop 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 msgr2=0x7f9d540b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c500 tx=0x7f9d3c00c8c0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 shutdown_connections 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d5415d450 0x7f9d540c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9d34066510 0x7f9d340689d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d540ac8c0 0x7f9d540b28d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 --2- 172.21.15.100:0/3438509151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d5406c290 0x7f9d5414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 >> 172.21.15.100:0/3438509151 conn(0x7f9d540cb730 msgr2=0x7f9d540acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 shutdown_connections 2023-11-17T06:29:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:40.828+0000 7f9d5359e700 1 -- 172.21.15.100:0/3438509151 wait complete. 2023-11-17T06:29:40.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-17T06:29:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 Processor -- start 2023-11-17T06:29:41.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 -- start start 2023-11-17T06:29:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 0x7f2e4015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e400cfc90 0x7f2e400b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e40071e50 con 0x7f2e400cc430 2023-11-17T06:29:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4015b440 con 0x7f2e400cfc90 2023-11-17T06:29:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.040+0000 7f2e463ad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400d0150 con 0x7f2e400b20a0 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 0x7f2e4015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e453ab700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2e400cc430 0x7f2e400b1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:34122/0 (socket says 172.21.15.100:34122) 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e453ab700 1 -- 172.21.15.100:0/817388971 learned_addr learned my addr 172.21.15.100:0/817388971 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e45bac700 1 --2- 172.21.15.100:0/817388971 >> v2:172.21.15.119:3300/0 conn(0x7f2e400cfc90 0x7f2e400b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 -- 172.21.15.100:0/817388971 >> v2:172.21.15.119:3300/0 conn(0x7f2e400cfc90 msgr2=0x7f2e400b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 --2- 172.21.15.100:0/817388971 >> v2:172.21.15.119:3300/0 conn(0x7f2e400cfc90 0x7f2e400b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 -- 172.21.15.100:0/817388971 >> v1:172.21.15.119:6789/0 conn(0x7f2e400cc430 legacy=0x7f2e400b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 -- 172.21.15.100:0/817388971 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400d0430 con 0x7f2e400b20a0 2023-11-17T06:29:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e37fff700 1 -- 172.21.15.100:0/817388971 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332860255 0 0) 0x7f2e40071e50 con 0x7f2e400cc430 2023-11-17T06:29:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e44baa700 1 --2- 172.21.15.100:0/817388971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 0x7f2e4015af00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009850 tx=0x7f2e30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ecec2de957d8740 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e37fff700 1 -- 172.21.15.100:0/817388971 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011830 con 0x7f2e400b20a0 2023-11-17T06:29:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e37fff700 1 -- 172.21.15.100:0/817388971 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30011990 con 0x7f2e400b20a0 2023-11-17T06:29:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e37fff700 1 -- 172.21.15.100:0/817388971 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011d40 con 0x7f2e400b20a0 2023-11-17T06:29:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 -- 172.21.15.100:0/817388971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 msgr2=0x7f2e4015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 --2- 172.21.15.100:0/817388971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 0x7f2e4015af00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009850 tx=0x7f2e30009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 -- 172.21.15.100:0/817388971 shutdown_connections 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 --2- 172.21.15.100:0/817388971 >> v2:172.21.15.119:3300/0 conn(0x7f2e400cfc90 0x7f2e400b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 --2- 172.21.15.100:0/817388971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400b20a0 0x7f2e4015af00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 -- 172.21.15.100:0/817388971 >> 172.21.15.100:0/817388971 conn(0x7f2e400733c0 msgr2=0x7f2e4006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 -- 172.21.15.100:0/817388971 shutdown_connections 2023-11-17T06:29:41.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.044+0000 7f2e463ad700 1 -- 172.21.15.100:0/817388971 wait complete. 2023-11-17T06:29:41.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 Processor -- start 2023-11-17T06:29:41.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 -- start start 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e400b20a0 0x7f2e40153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 0x7f2e40147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400ceae0 con 0x7f2e400cc430 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4014e1d0 con 0x7f2e400b20a0 2023-11-17T06:29:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e463ad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4014e4b0 con 0x7f2e400cfc90 2023-11-17T06:29:41.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e44baa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e44baa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38608/0 (socket says 172.21.15.100:38608) 2023-11-17T06:29:41.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e44baa700 1 -- 172.21.15.100:0/3225272230 learned_addr learned my addr 172.21.15.100:0/3225272230 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:41.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e45bac700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 0x7f2e40147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e453ab700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e400b20a0 0x7f2e40153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.048+0000 7f2e44baa700 1 -- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 msgr2=0x7f2e40147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e44baa700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 0x7f2e40147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e44baa700 1 -- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e400b20a0 msgr2=0x7f2e40153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e44baa700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e400b20a0 0x7f2e40153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e44baa700 1 -- 172.21.15.100:0/3225272230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300094b0 con 0x7f2e400cc430 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e45bac700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 0x7f2e40147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:41.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e44baa700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e30014040 tx=0x7f2e30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30019ab0 con 0x7f2e400cc430 2023-11-17T06:29:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3001e070 con 0x7f2e400cc430 2023-11-17T06:29:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30019e50 con 0x7f2e400cc430 2023-11-17T06:29:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4014e790 con 0x7f2e400cc430 2023-11-17T06:29:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e401488b0 con 0x7f2e400cc430 2023-11-17T06:29:41.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4014e9b0 con 0x7f2e400cc430 2023-11-17T06:29:41.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.052+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e3002d450 con 0x7f2e400cc430 2023-11-17T06:29:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.056+0000 7f2e35ffb700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 0x7f2e24068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.056+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e30084de0 con 0x7f2e400cc430 2023-11-17T06:29:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.056+0000 7f2e453ab700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 0x7f2e24068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.056+0000 7f2e453ab700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 0x7f2e24068a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c000f60 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.064+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e300523d0 con 0x7f2e400cc430 2023-11-17T06:29:41.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:41.284+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e40061eb0 con 0x7f2e400cc430 2023-11-17T06:29:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.048+0000 7f2e35ffb700 1 -- 172.21.15.100:0/3225272230 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e300150b0 con 0x7f2e400cc430 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 msgr2=0x7f2e24068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 0x7f2e24068a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c000f60 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 msgr2=0x7f2e400ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e30014040 tx=0x7f2e30004770 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 shutdown_connections 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e400cfc90 0x7f2e40147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e24066560 0x7f2e24068a20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e400cc430 0x7f2e400ce060 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 --2- 172.21.15.100:0/3225272230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e400b20a0 0x7f2e40153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 >> 172.21.15.100:0/3225272230 conn(0x7f2e400733c0 msgr2=0x7f2e4006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 shutdown_connections 2023-11-17T06:29:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.052+0000 7f2e463ad700 1 -- 172.21.15.100:0/3225272230 wait complete. 2023-11-17T06:29:42.078 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-17T06:29:42.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-17T06:29:42.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 Processor -- start 2023-11-17T06:29:42.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 -- start start 2023-11-17T06:29:42.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa9415d310 0x7ffa940ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffa940d2c70 0x7ffa940cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa940d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940ce8e0 con 0x7ffa9415d310 2023-11-17T06:29:42.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940d27e0 con 0x7ffa940d2c70 2023-11-17T06:29:42.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa993ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940ce630 con 0x7ffa9415d6f0 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa9415d310 0x7ffa940ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa9415d310 0x7ffa940ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47256/0 (socket says 172.21.15.100:47256) 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 -- 172.21.15.100:0/3644531609 learned_addr learned my addr 172.21.15.100:0/3644531609 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa927fc700 1 --2- 172.21.15.100:0/3644531609 >> v2:172.21.15.119:3300/0 conn(0x7ffa940d2c70 0x7ffa940cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa937fe700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa940d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 -- 172.21.15.100:0/3644531609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 msgr2=0x7ffa940d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa940d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 -- 172.21.15.100:0/3644531609 >> v2:172.21.15.119:3300/0 conn(0x7ffa940d2c70 msgr2=0x7ffa940cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/3644531609 >> v2:172.21.15.119:3300/0 conn(0x7ffa940d2c70 0x7ffa940cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 -- 172.21.15.100:0/3644531609 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940d1eb0 con 0x7ffa9415d310 2023-11-17T06:29:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa9415d310 0x7ffa940ce0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa940d09f0 tx=0x7ffa84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb8cbec13c555f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa91ffb700 1 -- 172.21.15.100:0/3644531609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400b8a0 con 0x7ffa9415d310 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa91ffb700 1 -- 172.21.15.100:0/3644531609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400ba00 con 0x7ffa9415d310 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.248+0000 7ffa91ffb700 1 -- 172.21.15.100:0/3644531609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400bd90 con 0x7ffa9415d310 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 -- 172.21.15.100:0/3644531609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa9415d310 msgr2=0x7ffa940ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa9415d310 0x7ffa940ce0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa940d09f0 tx=0x7ffa84009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 -- 172.21.15.100:0/3644531609 shutdown_connections 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa940d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 --2- 172.21.15.100:0/3644531609 >> v2:172.21.15.119:3300/0 conn(0x7ffa940d2c70 0x7ffa940cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 --2- 172.21.15.100:0/3644531609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa9415d310 0x7ffa940ce0f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 -- 172.21.15.100:0/3644531609 >> 172.21.15.100:0/3644531609 conn(0x7ffa9406b4e0 msgr2=0x7ffa9406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 -- 172.21.15.100:0/3644531609 shutdown_connections 2023-11-17T06:29:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.252+0000 7ffa993ce700 1 -- 172.21.15.100:0/3644531609 wait complete. 2023-11-17T06:29:42.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 Processor -- start 2023-11-17T06:29:42.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 -- start start 2023-11-17T06:29:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa9415d310 0x7ffa941f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa9415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940a9d70 con 0x7ffa940d2c70 2023-11-17T06:29:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940c6d10 con 0x7ffa9415d310 2023-11-17T06:29:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940cc2d0 con 0x7ffa9415d6f0 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47260/0 (socket says 172.21.15.100:47260) 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 -- 172.21.15.100:0/1387288556 learned_addr learned my addr 172.21.15.100:0/1387288556 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa927fc700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa9415d310 0x7ffa941f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa937fe700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa9415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 -- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 msgr2=0x7ffa9415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa9415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 -- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa9415d310 msgr2=0x7ffa941f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa9415d310 0x7ffa941f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:42.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 -- 172.21.15.100:0/1387288556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009570 con 0x7ffa940d2c70 2023-11-17T06:29:42.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa937fe700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa9415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:42.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa92ffd700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa9406cec0 tx=0x7ffa84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:42.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840036c0 con 0x7ffa940d2c70 2023-11-17T06:29:42.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8401f070 con 0x7ffa940d2c70 2023-11-17T06:29:42.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa940cc5b0 con 0x7ffa940d2c70 2023-11-17T06:29:42.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.256+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84003a80 con 0x7ffa940d2c70 2023-11-17T06:29:42.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.260+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa940c6f60 con 0x7ffa940d2c70 2023-11-17T06:29:42.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.260+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa940ccad0 con 0x7ffa940d2c70 2023-11-17T06:29:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.260+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa84021030 con 0x7ffa940d2c70 2023-11-17T06:29:42.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.264+0000 7ffa7b7fe700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 0x7ffa800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:42.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.264+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa840853f0 con 0x7ffa940d2c70 2023-11-17T06:29:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.264+0000 7ffa927fc700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 0x7ffa800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.264+0000 7ffa927fc700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 0x7ffa800689d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa9415bcf0 tx=0x7ffa88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:42.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.268+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa84052a30 con 0x7ffa940d2c70 2023-11-17T06:29:42.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:42.480+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffa940c7180 con 0x7ffa940d2c70 2023-11-17T06:29:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.052+0000 7ffa7b7fe700 1 -- 172.21.15.100:0/1387288556 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffa84056050 con 0x7ffa940d2c70 2023-11-17T06:29:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 msgr2=0x7ffa800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 0x7ffa800689d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa9415bcf0 tx=0x7ffa88008040 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 msgr2=0x7ffa94160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa9406cec0 tx=0x7ffa84004770 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 shutdown_connections 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa9415d6f0 0x7ffa9415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa9415d310 0x7ffa941f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffa80066510 0x7ffa800689d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 --2- 172.21.15.100:0/1387288556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa940d2c70 0x7ffa94160540 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 >> 172.21.15.100:0/1387288556 conn(0x7ffa9406b4e0 msgr2=0x7ffa9415ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 shutdown_connections 2023-11-17T06:29:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.056+0000 7ffa993ce700 1 -- 172.21.15.100:0/1387288556 wait complete. 2023-11-17T06:29:43.086 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-17T06:29:43.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.264+0000 7f4b4321e700 1 Processor -- start 2023-11-17T06:29:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 -- start start 2023-11-17T06:29:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 0x7f4b3c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4b3c0b0a40 0x7f4b3c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0cfd70 con 0x7f4b3c0cf990 2023-11-17T06:29:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b1410 con 0x7f4b3c0b0a40 2023-11-17T06:29:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b4321e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c165380 con 0x7f4b3c161d40 2023-11-17T06:29:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b40fba700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4b3c0cf990 0x7f4b3c165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43714/0 (socket says 172.21.15.100:43714) 2023-11-17T06:29:43.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b40fba700 1 -- 172.21.15.100:0/2608299953 learned_addr learned my addr 172.21.15.100:0/2608299953 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:43.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b3bfff700 1 --2- 172.21.15.100:0/2608299953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 0x7f4b3c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.268+0000 7f4b417bb700 1 --2- 172.21.15.100:0/2608299953 >> v2:172.21.15.119:3300/0 conn(0x7f4b3c0b0a40 0x7f4b3c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3b7fe700 1 -- 172.21.15.100:0/2608299953 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437796609 0 0) 0x7f4b30001110 con 0x7f4b3c0cf990 2023-11-17T06:29:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3b7fe700 1 -- 172.21.15.100:0/2608299953 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b2c0035d0 con 0x7f4b3c0cf990 2023-11-17T06:29:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3bfff700 1 -- 172.21.15.100:0/2608299953 >> v2:172.21.15.119:3300/0 conn(0x7f4b3c0b0a40 msgr2=0x7f4b3c0b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3bfff700 1 --2- 172.21.15.100:0/2608299953 >> v2:172.21.15.119:3300/0 conn(0x7f4b3c0b0a40 0x7f4b3c0b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3bfff700 1 -- 172.21.15.100:0/2608299953 >> v1:172.21.15.119:6789/0 conn(0x7f4b3c0cf990 legacy=0x7f4b3c165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3bfff700 1 -- 172.21.15.100:0/2608299953 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c158ce0 con 0x7f4b3c161d40 2023-11-17T06:29:43.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3bfff700 1 --2- 172.21.15.100:0/2608299953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 0x7f4b3c1621c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009880 tx=0x7f4b28009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc12d4007ff15e58 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3b7fe700 1 -- 172.21.15.100:0/2608299953 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011830 con 0x7f4b3c161d40 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3b7fe700 1 -- 172.21.15.100:0/2608299953 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28011990 con 0x7f4b3c161d40 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b3b7fe700 1 -- 172.21.15.100:0/2608299953 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011d20 con 0x7f4b3c161d40 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 -- 172.21.15.100:0/2608299953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 msgr2=0x7f4b3c1621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2608299953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 0x7f4b3c1621c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009880 tx=0x7f4b28009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 -- 172.21.15.100:0/2608299953 shutdown_connections 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2608299953 >> v2:172.21.15.119:3300/0 conn(0x7f4b3c0b0a40 0x7f4b3c0b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2608299953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c161d40 0x7f4b3c1621c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 -- 172.21.15.100:0/2608299953 >> 172.21.15.100:0/2608299953 conn(0x7f4b3c06a270 msgr2=0x7f4b3c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 -- 172.21.15.100:0/2608299953 shutdown_connections 2023-11-17T06:29:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.272+0000 7f4b4321e700 1 -- 172.21.15.100:0/2608299953 wait complete. 2023-11-17T06:29:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 Processor -- start 2023-11-17T06:29:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 -- start start 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c0b0a40 0x7f4b3c0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c0cf990 0x7f4b3c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c159e80 con 0x7f4b3c161d40 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b3650 con 0x7f4b3c0cf990 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b4321e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b3920 con 0x7f4b3c0b0a40 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47270/0 (socket says 172.21.15.100:47270) 2023-11-17T06:29:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 -- 172.21.15.100:0/2268164670 learned_addr learned my addr 172.21.15.100:0/2268164670 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b3bfff700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c0cf990 0x7f4b3c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b40fba700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c0b0a40 0x7f4b3c0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 -- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c0b0a40 msgr2=0x7f4b3c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c0b0a40 0x7f4b3c0b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 -- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c0cf990 msgr2=0x7f4b3c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c0cf990 0x7f4b3c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.276+0000 7f4b417bb700 1 -- 172.21.15.100:0/2268164670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280094b0 con 0x7f4b3c161d40 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b417bb700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400efc0 tx=0x7f4b3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34009ea0 con 0x7f4b3c161d40 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3400f040 con 0x7f4b3c161d40 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c0b3c00 con 0x7f4b3c161d40 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3400ced0 con 0x7f4b3c161d40 2023-11-17T06:29:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c0b41c0 con 0x7f4b3c161d40 2023-11-17T06:29:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.280+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c0669b0 con 0x7f4b3c161d40 2023-11-17T06:29:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.284+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4b34014480 con 0x7f4b3c161d40 2023-11-17T06:29:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.284+0000 7f4b397fa700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 0x7f4b20068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.284+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b34084610 con 0x7f4b3c161d40 2023-11-17T06:29:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.284+0000 7f4b40fba700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 0x7f4b20068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.284+0000 7f4b40fba700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 0x7f4b20068a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b30007fd0 tx=0x7f4b30007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.288+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b3c0669b0 con 0x7f4b3c161d40 2023-11-17T06:29:43.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b3c0669b0 con 0x7f4b3c161d40 2023-11-17T06:29:43.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b397fa700 1 -- 172.21.15.100:0/2268164670 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f4b3c0669b0 con 0x7f4b3c161d40 2023-11-17T06:29:43.499 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:43.500 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:29:43.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 msgr2=0x7f4b20068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 0x7f4b20068a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b30007fd0 tx=0x7f4b30007c60 comp rx=0 tx=0).stop 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 msgr2=0x7f4b3c158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.496+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400efc0 tx=0x7f4b3400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 shutdown_connections 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b20066540 0x7f4b20068a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c161d40 0x7f4b3c158eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c0cf990 0x7f4b3c0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 --2- 172.21.15.100:0/2268164670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b3c0b0a40 0x7f4b3c0b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 >> 172.21.15.100:0/2268164670 conn(0x7f4b3c06a270 msgr2=0x7f4b3c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:43.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 shutdown_connections 2023-11-17T06:29:43.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.500+0000 7f4b4321e700 1 -- 172.21.15.100:0/2268164670 wait complete. 2023-11-17T06:29:43.504 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:29:43.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:43.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 Processor -- start 2023-11-17T06:29:43.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 -- start start 2023-11-17T06:29:43.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14c80c5070 0x7f14c80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14c80c9bb0 0x7f14c80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80cd570 con 0x7f14c80cc880 2023-11-17T06:29:43.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c806cf30 con 0x7f14c80c9bb0 2023-11-17T06:29:43.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ce595700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c806c3f0 con 0x7f14c80c5070 2023-11-17T06:29:43.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14cdd94700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14c80c9bb0 0x7f14c80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14ccd92700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14c80c5070 0x7f14c80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14cdd94700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14c80c9bb0 0x7f14c80ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47274/0 (socket says 172.21.15.100:47274) 2023-11-17T06:29:43.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.700+0000 7f14cdd94700 1 -- 172.21.15.100:0/1507830353 learned_addr learned my addr 172.21.15.100:0/1507830353 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14cdd94700 1 -- 172.21.15.100:0/1507830353 >> v2:172.21.15.119:3300/0 conn(0x7f14c80c5070 msgr2=0x7f14c80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14cdd94700 1 --2- 172.21.15.100:0/1507830353 >> v2:172.21.15.119:3300/0 conn(0x7f14c80c5070 0x7f14c80c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14cdd94700 1 -- 172.21.15.100:0/1507830353 >> v1:172.21.15.119:6789/0 conn(0x7f14c80cc880 legacy=0x7f14c80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14cdd94700 1 -- 172.21.15.100:0/1507830353 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c806d110 con 0x7f14c80c9bb0 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14cdd94700 1 --2- 172.21.15.100:0/1507830353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80c9bb0 0x7f14c80ca040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009e50 tx=0x7f14c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110f9011e5392e5b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14bffff700 1 -- 172.21.15.100:0/1507830353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000e070 con 0x7f14c80c9bb0 2023-11-17T06:29:43.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14bffff700 1 -- 172.21.15.100:0/1507830353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c000b8d0 con 0x7f14c80c9bb0 2023-11-17T06:29:43.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14bffff700 1 -- 172.21.15.100:0/1507830353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000bc80 con 0x7f14c80c9bb0 2023-11-17T06:29:43.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 -- 172.21.15.100:0/1507830353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80c9bb0 msgr2=0x7f14c80ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 --2- 172.21.15.100:0/1507830353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80c9bb0 0x7f14c80ca040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009e50 tx=0x7f14c000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:43.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 -- 172.21.15.100:0/1507830353 shutdown_connections 2023-11-17T06:29:43.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 --2- 172.21.15.100:0/1507830353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80c9bb0 0x7f14c80ca040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 --2- 172.21.15.100:0/1507830353 >> v2:172.21.15.119:3300/0 conn(0x7f14c80c5070 0x7f14c80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 -- 172.21.15.100:0/1507830353 >> 172.21.15.100:0/1507830353 conn(0x7f14c80cb730 msgr2=0x7f14c80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:43.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 -- 172.21.15.100:0/1507830353 shutdown_connections 2023-11-17T06:29:43.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.704+0000 7f14ce595700 1 -- 172.21.15.100:0/1507830353 wait complete. 2023-11-17T06:29:43.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.708+0000 7f14ce595700 1 Processor -- start 2023-11-17T06:29:43.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.708+0000 7f14ce595700 1 -- start start 2023-11-17T06:29:43.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 0x7f14c8146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14c80c9bb0 0x7f14c8163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b2ea0 con 0x7f14c80cc880 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8164c60 con 0x7f14c80c5070 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8162b80 con 0x7f14c80c9bb0 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47278/0 (socket says 172.21.15.100:47278) 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 -- 172.21.15.100:0/248122789 learned_addr learned my addr 172.21.15.100:0/248122789 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ccd92700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14c80c9bb0 0x7f14c8163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cd593700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 0x7f14c8146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 -- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14c80c9bb0 msgr2=0x7f14c8163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14c80c9bb0 0x7f14c8163760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 -- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 msgr2=0x7f14c8146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 0x7f14c8146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 -- 172.21.15.100:0/248122789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009b30 con 0x7f14c80cc880 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cd593700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 0x7f14c8146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14cdd94700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14c806f4c0 tx=0x7f14c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00048b0 con 0x7f14c80cc880 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c00092e0 con 0x7f14c80cc880 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c8162e60 con 0x7f14c80cc880 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.712+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c001c680 con 0x7f14c80cc880 2023-11-17T06:29:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.716+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c80b2ac0 con 0x7f14c80cc880 2023-11-17T06:29:43.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.716+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80cdde0 con 0x7f14c80cc880 2023-11-17T06:29:43.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.716+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14c001c7e0 con 0x7f14c80cc880 2023-11-17T06:29:43.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.720+0000 7f14bdffb700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 0x7f14ac0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:43.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.720+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c0085b50 con 0x7f14c80cc880 2023-11-17T06:29:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.720+0000 7f14cd593700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 0x7f14ac0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.720+0000 7f14cd593700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 0x7f14ac0689d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14c4001700 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:43.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.724+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14c0052fc0 con 0x7f14c80cc880 2023-11-17T06:29:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.896+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14c80b2fe0 con 0x7f14c80cc880 2023-11-17T06:29:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.900+0000 7f14bdffb700 1 -- 172.21.15.100:0/248122789 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f14c80b2fe0 con 0x7f14c80cc880 2023-11-17T06:29:43.904 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:43.904 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.900+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 msgr2=0x7f14ac0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.900+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 0x7f14ac0689d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14c4001700 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.900+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 msgr2=0x7f14c80c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.900+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14c806f4c0 tx=0x7f14c0004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 shutdown_connections 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14ac066510 0x7f14ac0689d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c80cc880 0x7f14c80c9f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14c80c9bb0 0x7f14c8163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 --2- 172.21.15.100:0/248122789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c80c5070 0x7f14c8146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 >> 172.21.15.100:0/248122789 conn(0x7f14c80cb730 msgr2=0x7f14c80af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 shutdown_connections 2023-11-17T06:29:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:43.904+0000 7f14ce595700 1 -- 172.21.15.100:0/248122789 wait complete. 2023-11-17T06:29:43.929 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-17T06:29:43.929 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:29:44.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.108+0000 7f21d1605700 1 Processor -- start 2023-11-17T06:29:44.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.108+0000 7f21d1605700 1 -- start start 2023-11-17T06:29:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d1605700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21cc0af800 0x7f21cc15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d1605700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f21cc071880 0x7f21cc071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d1605700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc15ab50 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d1605700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc071460 con 0x7f21cc0af800 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d1605700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc15ae30 con 0x7f21cc071880 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21cc0af800 0x7f21cc15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21cc0af800 0x7f21cc15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47290/0 (socket says 172.21.15.100:47290) 2023-11-17T06:29:44.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 -- 172.21.15.100:0/4156180472 learned_addr learned my addr 172.21.15.100:0/4156180472 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:44.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21d0e04700 1 --2- 172.21.15.100:0/4156180472 >> v2:172.21.15.119:3300/0 conn(0x7f21cc071880 0x7f21cc071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 -- 172.21.15.100:0/4156180472 >> v2:172.21.15.119:3300/0 conn(0x7f21cc071880 msgr2=0x7f21cc071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:44.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 --2- 172.21.15.100:0/4156180472 >> v2:172.21.15.119:3300/0 conn(0x7f21cc071880 0x7f21cc071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 -- 172.21.15.100:0/4156180472 >> v1:172.21.15.119:6789/0 conn(0x7f21cc0cd3a0 legacy=0x7f21cc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 -- 172.21.15.100:0/4156180472 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc15b110 con 0x7f21cc0af800 2023-11-17T06:29:44.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.112+0000 7f21cbfff700 1 --2- 172.21.15.100:0/4156180472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0af800 0x7f21cc15a4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21cc06c360 tx=0x7f21bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273bbe82e9db64b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21cb7fe700 1 -- 172.21.15.100:0/4156180472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00b8a0 con 0x7f21cc0af800 2023-11-17T06:29:44.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21cb7fe700 1 -- 172.21.15.100:0/4156180472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00ba00 con 0x7f21cc0af800 2023-11-17T06:29:44.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21cb7fe700 1 -- 172.21.15.100:0/4156180472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00bd90 con 0x7f21cc0af800 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- 172.21.15.100:0/4156180472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0af800 msgr2=0x7f21cc15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 --2- 172.21.15.100:0/4156180472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0af800 0x7f21cc15a4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21cc06c360 tx=0x7f21bc009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- 172.21.15.100:0/4156180472 shutdown_connections 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 --2- 172.21.15.100:0/4156180472 >> v2:172.21.15.119:3300/0 conn(0x7f21cc071880 0x7f21cc071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 --2- 172.21.15.100:0/4156180472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0af800 0x7f21cc15a4e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- 172.21.15.100:0/4156180472 >> 172.21.15.100:0/4156180472 conn(0x7f21cc06f7f0 msgr2=0x7f21cc06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- 172.21.15.100:0/4156180472 shutdown_connections 2023-11-17T06:29:44.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- 172.21.15.100:0/4156180472 wait complete. 2023-11-17T06:29:44.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 Processor -- start 2023-11-17T06:29:44.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.116+0000 7f21d1605700 1 -- start start 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 0x7f21cc13c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 0x7f21cc1368b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc13c0b0 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc136df0 con 0x7f21cc071880 2023-11-17T06:29:44.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc13b430 con 0x7f21cc0af800 2023-11-17T06:29:44.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47302/0 (socket says 172.21.15.100:47302) 2023-11-17T06:29:44.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 -- 172.21.15.100:0/718562487 learned_addr learned my addr 172.21.15.100:0/718562487 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:44.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21cbfff700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 0x7f21cc13c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21c37fe700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 0x7f21cc1368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 -- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 msgr2=0x7f21cc1368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 0x7f21cc1368b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 -- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 msgr2=0x7f21cc13c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 0x7f21cc13c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 -- 172.21.15.100:0/718562487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009570 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21cbfff700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 0x7f21cc13c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21c37fe700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 0x7f21cc1368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d0e04700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e840 tx=0x7f21c400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013610 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4013770 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc13b710 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013b20 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.120+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc13bcd0 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.124+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc13c1f0 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.124+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f21c4013c80 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.124+0000 7f21c97fa700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 0x7f21ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.124+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c4083ae0 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.124+0000 7f21cbfff700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 0x7f21ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.128+0000 7f21cbfff700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 0x7f21ac068a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21bc000c00 tx=0x7f21bc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.132+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f21cc13c1f0 con 0x7f21cc0cd3a0 2023-11-17T06:29:44.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.300+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21cc0cd830 con 0x7f21ac066540 2023-11-17T06:29:44.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.308+0000 7f21c97fa700 1 -- 172.21.15.100:0/718562487 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264514 (secure 0 0 0) 0x7f21bc0040f0 con 0x7f21ac066540 2023-11-17T06:29:44.316 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:44.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 msgr2=0x7f21ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 0x7f21ac068a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21bc000c00 tx=0x7f21bc008030 comp rx=0 tx=0).stop 2023-11-17T06:29:44.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 msgr2=0x7f21cc13aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e840 tx=0x7f21c400ec00 comp rx=0 tx=0).stop 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 shutdown_connections 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f21ac066540 0x7f21ac068a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc0cd3a0 0x7f21cc13aac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21cc0af800 0x7f21cc1368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 --2- 172.21.15.100:0/718562487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21cc071880 0x7f21cc13c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 >> 172.21.15.100:0/718562487 conn(0x7f21cc06f7f0 msgr2=0x7f21cc0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 shutdown_connections 2023-11-17T06:29:44.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.316+0000 7f21d1605700 1 -- 172.21.15.100:0/718562487 wait complete. 2023-11-17T06:29:44.323 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:29:44.343 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2023-11-17T06:29:43.264085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219200,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755520,"statfs":{"total":773094113280,"available":772869652480,"internally_reserved":0,"allocated":3088384,"data_stored":1830564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.288147"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152090+0000","last_change":"2023-11-17T06:29:40.063019+0000","last_active":"2023-11-17T06:29:41.152090+0000","last_peered":"2023-11-17T06:29:41.152090+0000","last_clean":"2023-11-17T06:29:41.152090+0000","last_became_active":"2023-11-17T06:29:40.062726+0000","last_became_peered":"2023-11-17T06:29:40.062726+0000","last_unstale":"2023-11-17T06:29:41.152090+0000","last_undegraded":"2023-11-17T06:29:41.152090+0000","last_fullsized":"2023-11-17T06:29:41.152090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107932+0000","last_change":"2023-11-17T06:29:40.059039+0000","last_active":"2023-11-17T06:29:41.107932+0000","last_peered":"2023-11-17T06:29:41.107932+0000","last_clean":"2023-11-17T06:29:41.107932+0000","last_became_active":"2023-11-17T06:29:40.058738+0000","last_became_peered":"2023-11-17T06:29:40.058738+0000","last_unstale":"2023-11-17T06:29:41.107932+0000","last_undegraded":"2023-11-17T06:29:41.107932+0000","last_fullsized":"2023-11-17T06:29:41.107932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189875+0000","last_change":"2023-11-17T06:29:40.036396+0000","last_active":"2023-11-17T06:29:41.189875+0000","last_peered":"2023-11-17T06:29:41.189875+0000","last_clean":"2023-11-17T06:29:41.189875+0000","last_became_active":"2023-11-17T06:29:40.034856+0000","last_became_peered":"2023-11-17T06:29:40.034856+0000","last_unstale":"2023-11-17T06:29:41.189875+0000","last_undegraded":"2023-11-17T06:29:41.189875+0000","last_fullsized":"2023-11-17T06:29:41.189875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036505+0000","last_change":"2023-11-17T06:29:40.054375+0000","last_active":"2023-11-17T06:29:41.036505+0000","last_peered":"2023-11-17T06:29:41.036505+0000","last_clean":"2023-11-17T06:29:41.036505+0000","last_became_active":"2023-11-17T06:29:40.054057+0000","last_became_peered":"2023-11-17T06:29:40.054057+0000","last_unstale":"2023-11-17T06:29:41.036505+0000","last_undegraded":"2023-11-17T06:29:41.036505+0000","last_fullsized":"2023-11-17T06:29:41.036505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151486+0000","last_change":"2023-11-17T06:29:40.043645+0000","last_active":"2023-11-17T06:29:41.151486+0000","last_peered":"2023-11-17T06:29:41.151486+0000","last_clean":"2023-11-17T06:29:41.151486+0000","last_became_active":"2023-11-17T06:29:40.043104+0000","last_became_peered":"2023-11-17T06:29:40.043104+0000","last_unstale":"2023-11-17T06:29:41.151486+0000","last_undegraded":"2023-11-17T06:29:41.151486+0000","last_fullsized":"2023-11-17T06:29:41.151486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036135+0000","last_change":"2023-11-17T06:29:40.058390+0000","last_active":"2023-11-17T06:29:41.036135+0000","last_peered":"2023-11-17T06:29:41.036135+0000","last_clean":"2023-11-17T06:29:41.036135+0000","last_became_active":"2023-11-17T06:29:40.058051+0000","last_became_peered":"2023-11-17T06:29:40.058051+0000","last_unstale":"2023-11-17T06:29:41.036135+0000","last_undegraded":"2023-11-17T06:29:41.036135+0000","last_fullsized":"2023-11-17T06:29:41.036135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151241+0000","last_change":"2023-11-17T06:29:40.033175+0000","last_active":"2023-11-17T06:29:41.151241+0000","last_peered":"2023-11-17T06:29:41.151241+0000","last_clean":"2023-11-17T06:29:41.151241+0000","last_became_active":"2023-11-17T06:29:40.032870+0000","last_became_peered":"2023-11-17T06:29:40.032870+0000","last_unstale":"2023-11-17T06:29:41.151241+0000","last_undegraded":"2023-11-17T06:29:41.151241+0000","last_fullsized":"2023-11-17T06:29:41.151241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187178+0000","last_change":"2023-11-17T06:29:40.067796+0000","last_active":"2023-11-17T06:29:41.187178+0000","last_peered":"2023-11-17T06:29:41.187178+0000","last_clean":"2023-11-17T06:29:41.187178+0000","last_became_active":"2023-11-17T06:29:40.067549+0000","last_became_peered":"2023-11-17T06:29:40.067549+0000","last_unstale":"2023-11-17T06:29:41.187178+0000","last_undegraded":"2023-11-17T06:29:41.187178+0000","last_fullsized":"2023-11-17T06:29:41.187178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152224+0000","last_change":"2023-11-17T06:29:40.053086+0000","last_active":"2023-11-17T06:29:41.152224+0000","last_peered":"2023-11-17T06:29:41.152224+0000","last_clean":"2023-11-17T06:29:41.152224+0000","last_became_active":"2023-11-17T06:29:40.052820+0000","last_became_peered":"2023-11-17T06:29:40.052820+0000","last_unstale":"2023-11-17T06:29:41.152224+0000","last_undegraded":"2023-11-17T06:29:41.152224+0000","last_fullsized":"2023-11-17T06:29:41.152224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:34:42.735002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187565+0000","last_change":"2023-11-17T06:29:40.067431+0000","last_active":"2023-11-17T06:29:41.187565+0000","last_peered":"2023-11-17T06:29:41.187565+0000","last_clean":"2023-11-17T06:29:41.187565+0000","last_became_active":"2023-11-17T06:29:40.067106+0000","last_became_peered":"2023-11-17T06:29:40.067106+0000","last_unstale":"2023-11-17T06:29:41.187565+0000","last_undegraded":"2023-11-17T06:29:41.187565+0000","last_fullsized":"2023-11-17T06:29:41.187565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187309+0000","last_change":"2023-11-17T06:29:40.069847+0000","last_active":"2023-11-17T06:29:41.187309+0000","last_peered":"2023-11-17T06:29:41.187309+0000","last_clean":"2023-11-17T06:29:41.187309+0000","last_became_active":"2023-11-17T06:29:40.069567+0000","last_became_peered":"2023-11-17T06:29:40.069567+0000","last_unstale":"2023-11-17T06:29:41.187309+0000","last_undegraded":"2023-11-17T06:29:41.187309+0000","last_fullsized":"2023-11-17T06:29:41.187309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039102+0000","last_change":"2023-11-17T06:29:40.055649+0000","last_active":"2023-11-17T06:29:41.039102+0000","last_peered":"2023-11-17T06:29:41.039102+0000","last_clean":"2023-11-17T06:29:41.039102+0000","last_became_active":"2023-11-17T06:29:40.054763+0000","last_became_peered":"2023-11-17T06:29:40.054763+0000","last_unstale":"2023-11-17T06:29:41.039102+0000","last_undegraded":"2023-11-17T06:29:41.039102+0000","last_fullsized":"2023-11-17T06:29:41.039102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187571+0000","last_change":"2023-11-17T06:29:40.056634+0000","last_active":"2023-11-17T06:29:41.187571+0000","last_peered":"2023-11-17T06:29:41.187571+0000","last_clean":"2023-11-17T06:29:41.187571+0000","last_became_active":"2023-11-17T06:29:40.055547+0000","last_became_peered":"2023-11-17T06:29:40.055547+0000","last_unstale":"2023-11-17T06:29:41.187571+0000","last_undegraded":"2023-11-17T06:29:41.187571+0000","last_fullsized":"2023-11-17T06:29:41.187571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189196+0000","last_change":"2023-11-17T06:29:40.038547+0000","last_active":"2023-11-17T06:29:41.189196+0000","last_peered":"2023-11-17T06:29:41.189196+0000","last_clean":"2023-11-17T06:29:41.189196+0000","last_became_active":"2023-11-17T06:29:40.038231+0000","last_became_peered":"2023-11-17T06:29:40.038231+0000","last_unstale":"2023-11-17T06:29:41.189196+0000","last_undegraded":"2023-11-17T06:29:41.189196+0000","last_fullsized":"2023-11-17T06:29:41.189196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107274+0000","last_change":"2023-11-17T06:29:40.051827+0000","last_active":"2023-11-17T06:29:41.107274+0000","last_peered":"2023-11-17T06:29:41.107274+0000","last_clean":"2023-11-17T06:29:41.107274+0000","last_became_active":"2023-11-17T06:29:40.051501+0000","last_became_peered":"2023-11-17T06:29:40.051501+0000","last_unstale":"2023-11-17T06:29:41.107274+0000","last_undegraded":"2023-11-17T06:29:41.107274+0000","last_fullsized":"2023-11-17T06:29:41.107274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036003+0000","last_change":"2023-11-17T06:29:40.059452+0000","last_active":"2023-11-17T06:29:41.036003+0000","last_peered":"2023-11-17T06:29:41.036003+0000","last_clean":"2023-11-17T06:29:41.036003+0000","last_became_active":"2023-11-17T06:29:40.059183+0000","last_became_peered":"2023-11-17T06:29:40.059183+0000","last_unstale":"2023-11-17T06:29:41.036003+0000","last_undegraded":"2023-11-17T06:29:41.036003+0000","last_fullsized":"2023-11-17T06:29:41.036003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036860+0000","last_change":"2023-11-17T06:29:40.042601+0000","last_active":"2023-11-17T06:29:41.036860+0000","last_peered":"2023-11-17T06:29:41.036860+0000","last_clean":"2023-11-17T06:29:41.036860+0000","last_became_active":"2023-11-17T06:29:40.042331+0000","last_became_peered":"2023-11-17T06:29:40.042331+0000","last_unstale":"2023-11-17T06:29:41.036860+0000","last_undegraded":"2023-11-17T06:29:41.036860+0000","last_fullsized":"2023-11-17T06:29:41.036860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034229+0000","last_change":"2023-11-17T06:29:40.060783+0000","last_active":"2023-11-17T06:29:41.034229+0000","last_peered":"2023-11-17T06:29:41.034229+0000","last_clean":"2023-11-17T06:29:41.034229+0000","last_became_active":"2023-11-17T06:29:40.060402+0000","last_became_peered":"2023-11-17T06:29:40.060402+0000","last_unstale":"2023-11-17T06:29:41.034229+0000","last_undegraded":"2023-11-17T06:29:41.034229+0000","last_fullsized":"2023-11-17T06:29:41.034229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152132+0000","last_change":"2023-11-17T06:29:40.036086+0000","last_active":"2023-11-17T06:29:41.152132+0000","last_peered":"2023-11-17T06:29:41.152132+0000","last_clean":"2023-11-17T06:29:41.152132+0000","last_became_active":"2023-11-17T06:29:40.035726+0000","last_became_peered":"2023-11-17T06:29:40.035726+0000","last_unstale":"2023-11-17T06:29:41.152132+0000","last_undegraded":"2023-11-17T06:29:41.152132+0000","last_fullsized":"2023-11-17T06:29:41.152132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:32:30.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:40.054009+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:40.053676+0000","last_became_peered":"2023-11-17T06:29:40.053676+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188829+0000","last_change":"2023-11-17T06:29:40.030845+0000","last_active":"2023-11-17T06:29:41.188829+0000","last_peered":"2023-11-17T06:29:41.188829+0000","last_clean":"2023-11-17T06:29:41.188829+0000","last_became_active":"2023-11-17T06:29:40.030543+0000","last_became_peered":"2023-11-17T06:29:40.030543+0000","last_unstale":"2023-11-17T06:29:41.188829+0000","last_undegraded":"2023-11-17T06:29:41.188829+0000","last_fullsized":"2023-11-17T06:29:41.188829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:58.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036380+0000","last_change":"2023-11-17T06:29:40.044683+0000","last_active":"2023-11-17T06:29:41.036380+0000","last_peered":"2023-11-17T06:29:41.036380+0000","last_clean":"2023-11-17T06:29:41.036380+0000","last_became_active":"2023-11-17T06:29:40.044388+0000","last_became_peered":"2023-11-17T06:29:40.044388+0000","last_unstale":"2023-11-17T06:29:41.036380+0000","last_undegraded":"2023-11-17T06:29:41.036380+0000","last_fullsized":"2023-11-17T06:29:41.036380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187189+0000","last_change":"2023-11-17T06:29:40.053205+0000","last_active":"2023-11-17T06:29:41.187189+0000","last_peered":"2023-11-17T06:29:41.187189+0000","last_clean":"2023-11-17T06:29:41.187189+0000","last_became_active":"2023-11-17T06:29:40.052089+0000","last_became_peered":"2023-11-17T06:29:40.052089+0000","last_unstale":"2023-11-17T06:29:41.187189+0000","last_undegraded":"2023-11-17T06:29:41.187189+0000","last_fullsized":"2023-11-17T06:29:41.187189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036256+0000","last_change":"2023-11-17T06:29:40.043201+0000","last_active":"2023-11-17T06:29:41.036256+0000","last_peered":"2023-11-17T06:29:41.036256+0000","last_clean":"2023-11-17T06:29:41.036256+0000","last_became_active":"2023-11-17T06:29:40.042925+0000","last_became_peered":"2023-11-17T06:29:40.042925+0000","last_unstale":"2023-11-17T06:29:41.036256+0000","last_undegraded":"2023-11-17T06:29:41.036256+0000","last_fullsized":"2023-11-17T06:29:41.036256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189502+0000","last_change":"2023-11-17T06:29:40.051636+0000","last_active":"2023-11-17T06:29:41.189502+0000","last_peered":"2023-11-17T06:29:41.189502+0000","last_clean":"2023-11-17T06:29:41.189502+0000","last_became_active":"2023-11-17T06:29:40.051367+0000","last_became_peered":"2023-11-17T06:29:40.051367+0000","last_unstale":"2023-11-17T06:29:41.189502+0000","last_undegraded":"2023-11-17T06:29:41.189502+0000","last_fullsized":"2023-11-17T06:29:41.189502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187655+0000","last_change":"2023-11-17T06:29:40.048676+0000","last_active":"2023-11-17T06:29:41.187655+0000","last_peered":"2023-11-17T06:29:41.187655+0000","last_clean":"2023-11-17T06:29:41.187655+0000","last_became_active":"2023-11-17T06:29:40.048373+0000","last_became_peered":"2023-11-17T06:29:40.048373+0000","last_unstale":"2023-11-17T06:29:41.187655+0000","last_undegraded":"2023-11-17T06:29:41.187655+0000","last_fullsized":"2023-11-17T06:29:41.187655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107920+0000","last_change":"2023-11-17T06:29:40.048999+0000","last_active":"2023-11-17T06:29:41.107920+0000","last_peered":"2023-11-17T06:29:41.107920+0000","last_clean":"2023-11-17T06:29:41.107920+0000","last_became_active":"2023-11-17T06:29:40.048673+0000","last_became_peered":"2023-11-17T06:29:40.048673+0000","last_unstale":"2023-11-17T06:29:41.107920+0000","last_undegraded":"2023-11-17T06:29:41.107920+0000","last_fullsized":"2023-11-17T06:29:41.107920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187923+0000","last_change":"2023-11-17T06:29:40.049137+0000","last_active":"2023-11-17T06:29:41.187923+0000","last_peered":"2023-11-17T06:29:41.187923+0000","last_clean":"2023-11-17T06:29:41.187923+0000","last_became_active":"2023-11-17T06:29:40.047540+0000","last_became_peered":"2023-11-17T06:29:40.047540+0000","last_unstale":"2023-11-17T06:29:41.187923+0000","last_undegraded":"2023-11-17T06:29:41.187923+0000","last_fullsized":"2023-11-17T06:29:41.187923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189050+0000","last_change":"2023-11-17T06:29:40.044520+0000","last_active":"2023-11-17T06:29:41.189050+0000","last_peered":"2023-11-17T06:29:41.189050+0000","last_clean":"2023-11-17T06:29:41.189050+0000","last_became_active":"2023-11-17T06:29:40.044262+0000","last_became_peered":"2023-11-17T06:29:40.044262+0000","last_unstale":"2023-11-17T06:29:41.189050+0000","last_undegraded":"2023-11-17T06:29:41.189050+0000","last_fullsized":"2023-11-17T06:29:41.189050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036714+0000","last_change":"2023-11-17T06:29:40.051605+0000","last_active":"2023-11-17T06:29:41.036714+0000","last_peered":"2023-11-17T06:29:41.036714+0000","last_clean":"2023-11-17T06:29:41.036714+0000","last_became_active":"2023-11-17T06:29:40.051341+0000","last_became_peered":"2023-11-17T06:29:40.051341+0000","last_unstale":"2023-11-17T06:29:41.036714+0000","last_undegraded":"2023-11-17T06:29:41.036714+0000","last_fullsized":"2023-11-17T06:29:41.036714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034092+0000","last_change":"2023-11-17T06:29:40.033266+0000","last_active":"2023-11-17T06:29:41.034092+0000","last_peered":"2023-11-17T06:29:41.034092+0000","last_clean":"2023-11-17T06:29:41.034092+0000","last_became_active":"2023-11-17T06:29:40.032947+0000","last_became_peered":"2023-11-17T06:29:40.032947+0000","last_unstale":"2023-11-17T06:29:41.034092+0000","last_undegraded":"2023-11-17T06:29:41.034092+0000","last_fullsized":"2023-11-17T06:29:41.034092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187145+0000","last_change":"2023-11-17T06:29:40.061167+0000","last_active":"2023-11-17T06:29:41.187145+0000","last_peered":"2023-11-17T06:29:41.187145+0000","last_clean":"2023-11-17T06:29:41.187145+0000","last_became_active":"2023-11-17T06:29:40.060764+0000","last_became_peered":"2023-11-17T06:29:40.060764+0000","last_unstale":"2023-11-17T06:29:41.187145+0000","last_undegraded":"2023-11-17T06:29:41.187145+0000","last_fullsized":"2023-11-17T06:29:41.187145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038784+0000","last_change":"2023-11-17T06:29:40.049645+0000","last_active":"2023-11-17T06:29:41.038784+0000","last_peered":"2023-11-17T06:29:41.038784+0000","last_clean":"2023-11-17T06:29:41.038784+0000","last_became_active":"2023-11-17T06:29:40.049273+0000","last_became_peered":"2023-11-17T06:29:40.049273+0000","last_unstale":"2023-11-17T06:29:41.038784+0000","last_undegraded":"2023-11-17T06:29:41.038784+0000","last_fullsized":"2023-11-17T06:29:41.038784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:55:28.543526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187800+0000","last_change":"2023-11-17T06:29:39.017855+0000","last_active":"2023-11-17T06:29:41.187800+0000","last_peered":"2023-11-17T06:29:41.187800+0000","last_clean":"2023-11-17T06:29:41.187800+0000","last_became_active":"2023-11-17T06:29:39.017537+0000","last_became_peered":"2023-11-17T06:29:39.017537+0000","last_unstale":"2023-11-17T06:29:41.187800+0000","last_undegraded":"2023-11-17T06:29:41.187800+0000","last_fullsized":"2023-11-17T06:29:41.187800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188971+0000","last_change":"2023-11-17T06:29:40.055514+0000","last_active":"2023-11-17T06:29:41.188971+0000","last_peered":"2023-11-17T06:29:41.188971+0000","last_clean":"2023-11-17T06:29:41.188971+0000","last_became_active":"2023-11-17T06:29:40.055200+0000","last_became_peered":"2023-11-17T06:29:40.055200+0000","last_unstale":"2023-11-17T06:29:41.188971+0000","last_undegraded":"2023-11-17T06:29:41.188971+0000","last_fullsized":"2023-11-17T06:29:41.188971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:40.599968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187590+0000","last_change":"2023-11-17T06:29:39.020908+0000","last_active":"2023-11-17T06:29:41.187590+0000","last_peered":"2023-11-17T06:29:41.187590+0000","last_clean":"2023-11-17T06:29:41.187590+0000","last_became_active":"2023-11-17T06:29:39.020586+0000","last_became_peered":"2023-11-17T06:29:39.020586+0000","last_unstale":"2023-11-17T06:29:41.187590+0000","last_undegraded":"2023-11-17T06:29:41.187590+0000","last_fullsized":"2023-11-17T06:29:41.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187260+0000","last_change":"2023-11-17T06:29:39.021831+0000","last_active":"2023-11-17T06:29:41.187260+0000","last_peered":"2023-11-17T06:29:41.187260+0000","last_clean":"2023-11-17T06:29:41.187260+0000","last_became_active":"2023-11-17T06:29:39.019316+0000","last_became_peered":"2023-11-17T06:29:39.019316+0000","last_unstale":"2023-11-17T06:29:41.187260+0000","last_undegraded":"2023-11-17T06:29:41.187260+0000","last_fullsized":"2023-11-17T06:29:41.187260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187226+0000","last_change":"2023-11-17T06:29:40.045533+0000","last_active":"2023-11-17T06:29:41.187226+0000","last_peered":"2023-11-17T06:29:41.187226+0000","last_clean":"2023-11-17T06:29:41.187226+0000","last_became_active":"2023-11-17T06:29:40.045114+0000","last_became_peered":"2023-11-17T06:29:40.045114+0000","last_unstale":"2023-11-17T06:29:41.187226+0000","last_undegraded":"2023-11-17T06:29:41.187226+0000","last_fullsized":"2023-11-17T06:29:41.187226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036436+0000","last_change":"2023-11-17T06:29:39.017157+0000","last_active":"2023-11-17T06:29:41.036436+0000","last_peered":"2023-11-17T06:29:41.036436+0000","last_clean":"2023-11-17T06:29:41.036436+0000","last_became_active":"2023-11-17T06:29:39.016730+0000","last_became_peered":"2023-11-17T06:29:39.016730+0000","last_unstale":"2023-11-17T06:29:41.036436+0000","last_undegraded":"2023-11-17T06:29:41.036436+0000","last_fullsized":"2023-11-17T06:29:41.036436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107184+0000","last_change":"2023-11-17T06:29:40.049925+0000","last_active":"2023-11-17T06:29:41.107184+0000","last_peered":"2023-11-17T06:29:41.107184+0000","last_clean":"2023-11-17T06:29:41.107184+0000","last_became_active":"2023-11-17T06:29:40.049606+0000","last_became_peered":"2023-11-17T06:29:40.049606+0000","last_unstale":"2023-11-17T06:29:41.107184+0000","last_undegraded":"2023-11-17T06:29:41.107184+0000","last_fullsized":"2023-11-17T06:29:41.107184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187631+0000","last_change":"2023-11-17T06:29:39.022881+0000","last_active":"2023-11-17T06:29:41.187631+0000","last_peered":"2023-11-17T06:29:41.187631+0000","last_clean":"2023-11-17T06:29:41.187631+0000","last_became_active":"2023-11-17T06:29:39.022626+0000","last_became_peered":"2023-11-17T06:29:39.022626+0000","last_unstale":"2023-11-17T06:29:41.187631+0000","last_undegraded":"2023-11-17T06:29:41.187631+0000","last_fullsized":"2023-11-17T06:29:41.187631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036999+0000","last_change":"2023-11-17T06:29:40.064114+0000","last_active":"2023-11-17T06:29:41.036999+0000","last_peered":"2023-11-17T06:29:41.036999+0000","last_clean":"2023-11-17T06:29:41.036999+0000","last_became_active":"2023-11-17T06:29:40.063813+0000","last_became_peered":"2023-11-17T06:29:40.063813+0000","last_unstale":"2023-11-17T06:29:41.036999+0000","last_undegraded":"2023-11-17T06:29:41.036999+0000","last_fullsized":"2023-11-17T06:29:41.036999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037198+0000","last_change":"2023-11-17T06:29:39.021771+0000","last_active":"2023-11-17T06:29:41.037198+0000","last_peered":"2023-11-17T06:29:41.037198+0000","last_clean":"2023-11-17T06:29:41.037198+0000","last_became_active":"2023-11-17T06:29:39.020672+0000","last_became_peered":"2023-11-17T06:29:39.020672+0000","last_unstale":"2023-11-17T06:29:41.037198+0000","last_undegraded":"2023-11-17T06:29:41.037198+0000","last_fullsized":"2023-11-17T06:29:41.037198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:51.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189905+0000","last_change":"2023-11-17T06:29:40.034173+0000","last_active":"2023-11-17T06:29:41.189905+0000","last_peered":"2023-11-17T06:29:41.189905+0000","last_clean":"2023-11-17T06:29:41.189905+0000","last_became_active":"2023-11-17T06:29:40.033194+0000","last_became_peered":"2023-11-17T06:29:40.033194+0000","last_unstale":"2023-11-17T06:29:41.189905+0000","last_undegraded":"2023-11-17T06:29:41.189905+0000","last_fullsized":"2023-11-17T06:29:41.189905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107726+0000","last_change":"2023-11-17T06:29:39.017388+0000","last_active":"2023-11-17T06:29:41.107726+0000","last_peered":"2023-11-17T06:29:41.107726+0000","last_clean":"2023-11-17T06:29:41.107726+0000","last_became_active":"2023-11-17T06:29:39.017072+0000","last_became_peered":"2023-11-17T06:29:39.017072+0000","last_unstale":"2023-11-17T06:29:41.107726+0000","last_undegraded":"2023-11-17T06:29:41.107726+0000","last_fullsized":"2023-11-17T06:29:41.107726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039292+0000","last_change":"2023-11-17T06:29:40.047302+0000","last_active":"2023-11-17T06:29:41.039292+0000","last_peered":"2023-11-17T06:29:41.039292+0000","last_clean":"2023-11-17T06:29:41.039292+0000","last_became_active":"2023-11-17T06:29:40.043674+0000","last_became_peered":"2023-11-17T06:29:40.043674+0000","last_unstale":"2023-11-17T06:29:41.039292+0000","last_undegraded":"2023-11-17T06:29:41.039292+0000","last_fullsized":"2023-11-17T06:29:41.039292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:39.017824+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:39.016946+0000","last_became_peered":"2023-11-17T06:29:39.016946+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.049717+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.048800+0000","last_became_peered":"2023-11-17T06:29:40.048800+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189065+0000","last_change":"2023-11-17T06:29:39.015752+0000","last_active":"2023-11-17T06:29:41.189065+0000","last_peered":"2023-11-17T06:29:41.189065+0000","last_clean":"2023-11-17T06:29:41.189065+0000","last_became_active":"2023-11-17T06:29:39.015186+0000","last_became_peered":"2023-11-17T06:29:39.015186+0000","last_unstale":"2023-11-17T06:29:41.189065+0000","last_undegraded":"2023-11-17T06:29:41.189065+0000","last_fullsized":"2023-11-17T06:29:41.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189437+0000","last_change":"2023-11-17T06:29:40.031730+0000","last_active":"2023-11-17T06:29:41.189437+0000","last_peered":"2023-11-17T06:29:41.189437+0000","last_clean":"2023-11-17T06:29:41.189437+0000","last_became_active":"2023-11-17T06:29:40.031393+0000","last_became_peered":"2023-11-17T06:29:40.031393+0000","last_unstale":"2023-11-17T06:29:41.189437+0000","last_undegraded":"2023-11-17T06:29:41.189437+0000","last_fullsized":"2023-11-17T06:29:41.189437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037146+0000","last_change":"2023-11-17T06:29:39.018521+0000","last_active":"2023-11-17T06:29:41.037146+0000","last_peered":"2023-11-17T06:29:41.037146+0000","last_clean":"2023-11-17T06:29:41.037146+0000","last_became_active":"2023-11-17T06:29:39.016769+0000","last_became_peered":"2023-11-17T06:29:39.016769+0000","last_unstale":"2023-11-17T06:29:41.037146+0000","last_undegraded":"2023-11-17T06:29:41.037146+0000","last_fullsized":"2023-11-17T06:29:41.037146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:24.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151548+0000","last_change":"2023-11-17T06:29:40.058720+0000","last_active":"2023-11-17T06:29:41.151548+0000","last_peered":"2023-11-17T06:29:41.151548+0000","last_clean":"2023-11-17T06:29:41.151548+0000","last_became_active":"2023-11-17T06:29:40.057027+0000","last_became_peered":"2023-11-17T06:29:40.057027+0000","last_unstale":"2023-11-17T06:29:41.151548+0000","last_undegraded":"2023-11-17T06:29:41.151548+0000","last_fullsized":"2023-11-17T06:29:41.151548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187287+0000","last_change":"2023-11-17T06:29:39.019273+0000","last_active":"2023-11-17T06:29:41.187287+0000","last_peered":"2023-11-17T06:29:41.187287+0000","last_clean":"2023-11-17T06:29:41.187287+0000","last_became_active":"2023-11-17T06:29:39.017424+0000","last_became_peered":"2023-11-17T06:29:39.017424+0000","last_unstale":"2023-11-17T06:29:41.187287+0000","last_undegraded":"2023-11-17T06:29:41.187287+0000","last_fullsized":"2023-11-17T06:29:41.187287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187172+0000","last_change":"2023-11-17T06:29:40.052673+0000","last_active":"2023-11-17T06:29:41.187172+0000","last_peered":"2023-11-17T06:29:41.187172+0000","last_clean":"2023-11-17T06:29:41.187172+0000","last_became_active":"2023-11-17T06:29:40.052360+0000","last_became_peered":"2023-11-17T06:29:40.052360+0000","last_unstale":"2023-11-17T06:29:41.187172+0000","last_undegraded":"2023-11-17T06:29:41.187172+0000","last_fullsized":"2023-11-17T06:29:41.187172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033791+0000","last_change":"2023-11-17T06:29:39.012145+0000","last_active":"2023-11-17T06:29:41.033791+0000","last_peered":"2023-11-17T06:29:41.033791+0000","last_clean":"2023-11-17T06:29:41.033791+0000","last_became_active":"2023-11-17T06:29:39.011840+0000","last_became_peered":"2023-11-17T06:29:39.011840+0000","last_unstale":"2023-11-17T06:29:41.033791+0000","last_undegraded":"2023-11-17T06:29:41.033791+0000","last_fullsized":"2023-11-17T06:29:41.033791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:14:03.642188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151184+0000","last_change":"2023-11-17T06:29:40.047955+0000","last_active":"2023-11-17T06:29:41.151184+0000","last_peered":"2023-11-17T06:29:41.151184+0000","last_clean":"2023-11-17T06:29:41.151184+0000","last_became_active":"2023-11-17T06:29:40.047530+0000","last_became_peered":"2023-11-17T06:29:40.047530+0000","last_unstale":"2023-11-17T06:29:41.151184+0000","last_undegraded":"2023-11-17T06:29:41.151184+0000","last_fullsized":"2023-11-17T06:29:41.151184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039359+0000","last_change":"2023-11-17T06:29:39.015633+0000","last_active":"2023-11-17T06:29:41.039359+0000","last_peered":"2023-11-17T06:29:41.039359+0000","last_clean":"2023-11-17T06:29:41.039359+0000","last_became_active":"2023-11-17T06:29:39.015301+0000","last_became_peered":"2023-11-17T06:29:39.015301+0000","last_unstale":"2023-11-17T06:29:41.039359+0000","last_undegraded":"2023-11-17T06:29:41.039359+0000","last_fullsized":"2023-11-17T06:29:41.039359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152124+0000","last_change":"2023-11-17T06:29:40.056743+0000","last_active":"2023-11-17T06:29:41.152124+0000","last_peered":"2023-11-17T06:29:41.152124+0000","last_clean":"2023-11-17T06:29:41.152124+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152124+0000","last_undegraded":"2023-11-17T06:29:41.152124+0000","last_fullsized":"2023-11-17T06:29:41.152124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:48:00.372978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034190+0000","last_change":"2023-11-17T06:29:39.018457+0000","last_active":"2023-11-17T06:29:41.034190+0000","last_peered":"2023-11-17T06:29:41.034190+0000","last_clean":"2023-11-17T06:29:41.034190+0000","last_became_active":"2023-11-17T06:29:39.014204+0000","last_became_peered":"2023-11-17T06:29:39.014204+0000","last_unstale":"2023-11-17T06:29:41.034190+0000","last_undegraded":"2023-11-17T06:29:41.034190+0000","last_fullsized":"2023-11-17T06:29:41.034190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152267+0000","last_change":"2023-11-17T06:29:40.056354+0000","last_active":"2023-11-17T06:29:41.152267+0000","last_peered":"2023-11-17T06:29:41.152267+0000","last_clean":"2023-11-17T06:29:41.152267+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152267+0000","last_undegraded":"2023-11-17T06:29:41.152267+0000","last_fullsized":"2023-11-17T06:29:41.152267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:13:49.943175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107824+0000","last_change":"2023-11-17T06:29:39.006221+0000","last_active":"2023-11-17T06:29:41.107824+0000","last_peered":"2023-11-17T06:29:41.107824+0000","last_clean":"2023-11-17T06:29:41.107824+0000","last_became_active":"2023-11-17T06:29:39.005712+0000","last_became_peered":"2023-11-17T06:29:39.005712+0000","last_unstale":"2023-11-17T06:29:41.107824+0000","last_undegraded":"2023-11-17T06:29:41.107824+0000","last_fullsized":"2023-11-17T06:29:41.107824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037120+0000","last_change":"2023-11-17T06:29:40.054044+0000","last_active":"2023-11-17T06:29:41.037120+0000","last_peered":"2023-11-17T06:29:41.037120+0000","last_clean":"2023-11-17T06:29:41.037120+0000","last_became_active":"2023-11-17T06:29:40.050897+0000","last_became_peered":"2023-11-17T06:29:40.050897+0000","last_unstale":"2023-11-17T06:29:41.037120+0000","last_undegraded":"2023-11-17T06:29:41.037120+0000","last_fullsized":"2023-11-17T06:29:41.037120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033921+0000","last_change":"2023-11-17T06:29:39.018173+0000","last_active":"2023-11-17T06:29:41.033921+0000","last_peered":"2023-11-17T06:29:41.033921+0000","last_clean":"2023-11-17T06:29:41.033921+0000","last_became_active":"2023-11-17T06:29:39.017909+0000","last_became_peered":"2023-11-17T06:29:39.017909+0000","last_unstale":"2023-11-17T06:29:41.033921+0000","last_undegraded":"2023-11-17T06:29:41.033921+0000","last_fullsized":"2023-11-17T06:29:41.033921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:57.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.067949+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.065233+0000","last_became_peered":"2023-11-17T06:29:40.065233+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-17T06:29:40.021755+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:29:40.021755+0000","last_peered":"2023-11-17T06:29:40.021755+0000","last_clean":"2023-11-17T06:29:40.021755+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:29:40.021755+0000","last_undegraded":"2023-11-17T06:29:40.021755+0000","last_fullsized":"2023-11-17T06:29:40.021755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.035967+0000","last_change":"2023-11-17T06:29:39.012948+0000","last_active":"2023-11-17T06:29:41.035967+0000","last_peered":"2023-11-17T06:29:41.035967+0000","last_clean":"2023-11-17T06:29:41.035967+0000","last_became_active":"2023-11-17T06:29:39.012399+0000","last_became_peered":"2023-11-17T06:29:39.012399+0000","last_unstale":"2023-11-17T06:29:41.035967+0000","last_undegraded":"2023-11-17T06:29:41.035967+0000","last_fullsized":"2023-11-17T06:29:41.035967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:04.513942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187413+0000","last_change":"2023-11-17T06:29:40.067314+0000","last_active":"2023-11-17T06:29:41.187413+0000","last_peered":"2023-11-17T06:29:41.187413+0000","last_clean":"2023-11-17T06:29:41.187413+0000","last_became_active":"2023-11-17T06:29:40.067024+0000","last_became_peered":"2023-11-17T06:29:40.067024+0000","last_unstale":"2023-11-17T06:29:41.187413+0000","last_undegraded":"2023-11-17T06:29:41.187413+0000","last_fullsized":"2023-11-17T06:29:41.187413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150983+0000","last_change":"2023-11-17T06:29:39.018265+0000","last_active":"2023-11-17T06:29:41.150983+0000","last_peered":"2023-11-17T06:29:41.150983+0000","last_clean":"2023-11-17T06:29:41.150983+0000","last_became_active":"2023-11-17T06:29:39.017921+0000","last_became_peered":"2023-11-17T06:29:39.017921+0000","last_unstale":"2023-11-17T06:29:41.150983+0000","last_undegraded":"2023-11-17T06:29:41.150983+0000","last_fullsized":"2023-11-17T06:29:41.150983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:21.174865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188592+0000","last_change":"2023-11-17T06:29:40.058305+0000","last_active":"2023-11-17T06:29:41.188592+0000","last_peered":"2023-11-17T06:29:41.188592+0000","last_clean":"2023-11-17T06:29:41.188592+0000","last_became_active":"2023-11-17T06:29:40.058045+0000","last_became_peered":"2023-11-17T06:29:40.058045+0000","last_unstale":"2023-11-17T06:29:41.188592+0000","last_undegraded":"2023-11-17T06:29:41.188592+0000","last_fullsized":"2023-11-17T06:29:41.188592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:48.722666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033924+0000","last_change":"2023-11-17T06:29:39.009964+0000","last_active":"2023-11-17T06:29:41.033924+0000","last_peered":"2023-11-17T06:29:41.033924+0000","last_clean":"2023-11-17T06:29:41.033924+0000","last_became_active":"2023-11-17T06:29:39.007573+0000","last_became_peered":"2023-11-17T06:29:39.007573+0000","last_unstale":"2023-11-17T06:29:41.033924+0000","last_undegraded":"2023-11-17T06:29:41.033924+0000","last_fullsized":"2023-11-17T06:29:41.033924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:00:22.924749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107525+0000","last_change":"2023-11-17T06:29:40.038796+0000","last_active":"2023-11-17T06:29:41.107525+0000","last_peered":"2023-11-17T06:29:41.107525+0000","last_clean":"2023-11-17T06:29:41.107525+0000","last_became_active":"2023-11-17T06:29:40.038469+0000","last_became_peered":"2023-11-17T06:29:40.038469+0000","last_unstale":"2023-11-17T06:29:41.107525+0000","last_undegraded":"2023-11-17T06:29:41.107525+0000","last_fullsized":"2023-11-17T06:29:41.107525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037187+0000","last_change":"2023-11-17T06:29:39.007112+0000","last_active":"2023-11-17T06:29:41.037187+0000","last_peered":"2023-11-17T06:29:41.037187+0000","last_clean":"2023-11-17T06:29:41.037187+0000","last_became_active":"2023-11-17T06:29:39.006736+0000","last_became_peered":"2023-11-17T06:29:39.006736+0000","last_unstale":"2023-11-17T06:29:41.037187+0000","last_undegraded":"2023-11-17T06:29:41.037187+0000","last_fullsized":"2023-11-17T06:29:41.037187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038938+0000","last_change":"2023-11-17T06:29:40.059681+0000","last_active":"2023-11-17T06:29:41.038938+0000","last_peered":"2023-11-17T06:29:41.038938+0000","last_clean":"2023-11-17T06:29:41.038938+0000","last_became_active":"2023-11-17T06:29:40.059165+0000","last_became_peered":"2023-11-17T06:29:40.059165+0000","last_unstale":"2023-11-17T06:29:41.038938+0000","last_undegraded":"2023-11-17T06:29:41.038938+0000","last_fullsized":"2023-11-17T06:29:41.038938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:58.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107450+0000","last_change":"2023-11-17T06:29:39.015572+0000","last_active":"2023-11-17T06:29:41.107450+0000","last_peered":"2023-11-17T06:29:41.107450+0000","last_clean":"2023-11-17T06:29:41.107450+0000","last_became_active":"2023-11-17T06:29:39.015272+0000","last_became_peered":"2023-11-17T06:29:39.015272+0000","last_unstale":"2023-11-17T06:29:41.107450+0000","last_undegraded":"2023-11-17T06:29:41.107450+0000","last_fullsized":"2023-11-17T06:29:41.107450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036928+0000","last_change":"2023-11-17T06:29:40.054094+0000","last_active":"2023-11-17T06:29:41.036928+0000","last_peered":"2023-11-17T06:29:41.036928+0000","last_clean":"2023-11-17T06:29:41.036928+0000","last_became_active":"2023-11-17T06:29:40.053816+0000","last_became_peered":"2023-11-17T06:29:40.053816+0000","last_unstale":"2023-11-17T06:29:41.036928+0000","last_undegraded":"2023-11-17T06:29:41.036928+0000","last_fullsized":"2023-11-17T06:29:41.036928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152236+0000","last_change":"2023-11-17T06:29:39.019355+0000","last_active":"2023-11-17T06:29:41.152236+0000","last_peered":"2023-11-17T06:29:41.152236+0000","last_clean":"2023-11-17T06:29:41.152236+0000","last_became_active":"2023-11-17T06:29:39.019090+0000","last_became_peered":"2023-11-17T06:29:39.019090+0000","last_unstale":"2023-11-17T06:29:41.152236+0000","last_undegraded":"2023-11-17T06:29:41.152236+0000","last_fullsized":"2023-11-17T06:29:41.152236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:35.188435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107457+0000","last_change":"2023-11-17T06:29:40.043278+0000","last_active":"2023-11-17T06:29:41.107457+0000","last_peered":"2023-11-17T06:29:41.107457+0000","last_clean":"2023-11-17T06:29:41.107457+0000","last_became_active":"2023-11-17T06:29:40.043106+0000","last_became_peered":"2023-11-17T06:29:40.043106+0000","last_unstale":"2023-11-17T06:29:41.107457+0000","last_undegraded":"2023-11-17T06:29:41.107457+0000","last_fullsized":"2023-11-17T06:29:41.107457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107981+0000","last_change":"2023-11-17T06:29:39.020748+0000","last_active":"2023-11-17T06:29:41.107981+0000","last_peered":"2023-11-17T06:29:41.107981+0000","last_clean":"2023-11-17T06:29:41.107981+0000","last_became_active":"2023-11-17T06:29:39.020192+0000","last_became_peered":"2023-11-17T06:29:39.020192+0000","last_unstale":"2023-11-17T06:29:41.107981+0000","last_undegraded":"2023-11-17T06:29:41.107981+0000","last_fullsized":"2023-11-17T06:29:41.107981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189551+0000","last_change":"2023-11-17T06:29:40.044168+0000","last_active":"2023-11-17T06:29:41.189551+0000","last_peered":"2023-11-17T06:29:41.189551+0000","last_clean":"2023-11-17T06:29:41.189551+0000","last_became_active":"2023-11-17T06:29:40.043816+0000","last_became_peered":"2023-11-17T06:29:40.043816+0000","last_unstale":"2023-11-17T06:29:41.189551+0000","last_undegraded":"2023-11-17T06:29:41.189551+0000","last_fullsized":"2023-11-17T06:29:41.189551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187665+0000","last_change":"2023-11-17T06:29:39.014734+0000","last_active":"2023-11-17T06:29:41.187665+0000","last_peered":"2023-11-17T06:29:41.187665+0000","last_clean":"2023-11-17T06:29:41.187665+0000","last_became_active":"2023-11-17T06:29:39.014327+0000","last_became_peered":"2023-11-17T06:29:39.014327+0000","last_unstale":"2023-11-17T06:29:41.187665+0000","last_undegraded":"2023-11-17T06:29:41.187665+0000","last_fullsized":"2023-11-17T06:29:41.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.190089+0000","last_change":"2023-11-17T06:29:40.062903+0000","last_active":"2023-11-17T06:29:41.190089+0000","last_peered":"2023-11-17T06:29:41.190089+0000","last_clean":"2023-11-17T06:29:41.190089+0000","last_became_active":"2023-11-17T06:29:40.062579+0000","last_became_peered":"2023-11-17T06:29:40.062579+0000","last_unstale":"2023-11-17T06:29:41.190089+0000","last_undegraded":"2023-11-17T06:29:41.190089+0000","last_fullsized":"2023-11-17T06:29:41.190089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150984+0000","last_change":"2023-11-17T06:29:39.021850+0000","last_active":"2023-11-17T06:29:41.150984+0000","last_peered":"2023-11-17T06:29:41.150984+0000","last_clean":"2023-11-17T06:29:41.150984+0000","last_became_active":"2023-11-17T06:29:39.017210+0000","last_became_peered":"2023-11-17T06:29:39.017210+0000","last_unstale":"2023-11-17T06:29:41.150984+0000","last_undegraded":"2023-11-17T06:29:41.150984+0000","last_fullsized":"2023-11-17T06:29:41.150984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:26.995063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038808+0000","last_change":"2023-11-17T06:29:40.062837+0000","last_active":"2023-11-17T06:29:41.038808+0000","last_peered":"2023-11-17T06:29:41.038808+0000","last_clean":"2023-11-17T06:29:41.038808+0000","last_became_active":"2023-11-17T06:29:40.062553+0000","last_became_peered":"2023-11-17T06:29:40.062553+0000","last_unstale":"2023-11-17T06:29:41.038808+0000","last_undegraded":"2023-11-17T06:29:41.038808+0000","last_fullsized":"2023-11-17T06:29:41.038808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:20:05.317093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107283+0000","last_change":"2023-11-17T06:29:39.010652+0000","last_active":"2023-11-17T06:29:41.107283+0000","last_peered":"2023-11-17T06:29:41.107283+0000","last_clean":"2023-11-17T06:29:41.107283+0000","last_became_active":"2023-11-17T06:29:39.009663+0000","last_became_peered":"2023-11-17T06:29:39.009663+0000","last_unstale":"2023-11-17T06:29:41.107283+0000","last_undegraded":"2023-11-17T06:29:41.107283+0000","last_fullsized":"2023-11-17T06:29:41.107283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187492+0000","last_change":"2023-11-17T06:29:40.046969+0000","last_active":"2023-11-17T06:29:41.187492+0000","last_peered":"2023-11-17T06:29:41.187492+0000","last_clean":"2023-11-17T06:29:41.187492+0000","last_became_active":"2023-11-17T06:29:40.046400+0000","last_became_peered":"2023-11-17T06:29:40.046400+0000","last_unstale":"2023-11-17T06:29:41.187492+0000","last_undegraded":"2023-11-17T06:29:41.187492+0000","last_fullsized":"2023-11-17T06:29:41.187492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107727+0000","last_change":"2023-11-17T06:29:39.015476+0000","last_active":"2023-11-17T06:29:41.107727+0000","last_peered":"2023-11-17T06:29:41.107727+0000","last_clean":"2023-11-17T06:29:41.107727+0000","last_became_active":"2023-11-17T06:29:39.015166+0000","last_became_peered":"2023-11-17T06:29:39.015166+0000","last_unstale":"2023-11-17T06:29:41.107727+0000","last_undegraded":"2023-11-17T06:29:41.107727+0000","last_fullsized":"2023-11-17T06:29:41.107727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187769+0000","last_change":"2023-11-17T06:29:40.044575+0000","last_active":"2023-11-17T06:29:41.187769+0000","last_peered":"2023-11-17T06:29:41.187769+0000","last_clean":"2023-11-17T06:29:41.187769+0000","last_became_active":"2023-11-17T06:29:40.044313+0000","last_became_peered":"2023-11-17T06:29:40.044313+0000","last_unstale":"2023-11-17T06:29:41.187769+0000","last_undegraded":"2023-11-17T06:29:41.187769+0000","last_fullsized":"2023-11-17T06:29:41.187769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151785+0000","last_change":"2023-11-17T06:29:39.022524+0000","last_active":"2023-11-17T06:29:41.151785+0000","last_peered":"2023-11-17T06:29:41.151785+0000","last_clean":"2023-11-17T06:29:41.151785+0000","last_became_active":"2023-11-17T06:29:39.022245+0000","last_became_peered":"2023-11-17T06:29:39.022245+0000","last_unstale":"2023-11-17T06:29:41.151785+0000","last_undegraded":"2023-11-17T06:29:41.151785+0000","last_fullsized":"2023-11-17T06:29:41.151785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187140+0000","last_change":"2023-11-17T06:29:40.050948+0000","last_active":"2023-11-17T06:29:41.187140+0000","last_peered":"2023-11-17T06:29:41.187140+0000","last_clean":"2023-11-17T06:29:41.187140+0000","last_became_active":"2023-11-17T06:29:40.050407+0000","last_became_peered":"2023-11-17T06:29:40.050407+0000","last_unstale":"2023-11-17T06:29:41.187140+0000","last_undegraded":"2023-11-17T06:29:41.187140+0000","last_fullsized":"2023-11-17T06:29:41.187140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036601+0000","last_change":"2023-11-17T06:29:40.064292+0000","last_active":"2023-11-17T06:29:41.036601+0000","last_peered":"2023-11-17T06:29:41.036601+0000","last_clean":"2023-11-17T06:29:41.036601+0000","last_became_active":"2023-11-17T06:29:40.063950+0000","last_became_peered":"2023-11-17T06:29:40.063950+0000","last_unstale":"2023-11-17T06:29:41.036601+0000","last_undegraded":"2023-11-17T06:29:41.036601+0000","last_fullsized":"2023-11-17T06:29:41.036601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151542+0000","last_change":"2023-11-17T06:29:39.026270+0000","last_active":"2023-11-17T06:29:41.151542+0000","last_peered":"2023-11-17T06:29:41.151542+0000","last_clean":"2023-11-17T06:29:41.151542+0000","last_became_active":"2023-11-17T06:29:39.025930+0000","last_became_peered":"2023-11-17T06:29:39.025930+0000","last_unstale":"2023-11-17T06:29:41.151542+0000","last_undegraded":"2023-11-17T06:29:41.151542+0000","last_fullsized":"2023-11-17T06:29:41.151542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:02.074512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036867+0000","last_change":"2023-11-17T06:29:40.054287+0000","last_active":"2023-11-17T06:29:41.036867+0000","last_peered":"2023-11-17T06:29:41.036867+0000","last_clean":"2023-11-17T06:29:41.036867+0000","last_became_active":"2023-11-17T06:29:40.053760+0000","last_became_peered":"2023-11-17T06:29:40.053760+0000","last_unstale":"2023-11-17T06:29:41.036867+0000","last_undegraded":"2023-11-17T06:29:41.036867+0000","last_fullsized":"2023-11-17T06:29:41.036867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152006+0000","last_change":"2023-11-17T06:29:39.021077+0000","last_active":"2023-11-17T06:29:41.152006+0000","last_peered":"2023-11-17T06:29:41.152006+0000","last_clean":"2023-11-17T06:29:41.152006+0000","last_became_active":"2023-11-17T06:29:39.020821+0000","last_became_peered":"2023-11-17T06:29:39.020821+0000","last_unstale":"2023-11-17T06:29:41.152006+0000","last_undegraded":"2023-11-17T06:29:41.152006+0000","last_fullsized":"2023-11-17T06:29:41.152006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189999+0000","last_change":"2023-11-17T06:29:40.065696+0000","last_active":"2023-11-17T06:29:41.189999+0000","last_peered":"2023-11-17T06:29:41.189999+0000","last_clean":"2023-11-17T06:29:41.189999+0000","last_became_active":"2023-11-17T06:29:40.065459+0000","last_became_peered":"2023-11-17T06:29:40.065459+0000","last_unstale":"2023-11-17T06:29:41.189999+0000","last_undegraded":"2023-11-17T06:29:41.189999+0000","last_fullsized":"2023-11-17T06:29:41.189999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189626+0000","last_change":"2023-11-17T06:29:39.014916+0000","last_active":"2023-11-17T06:29:41.189626+0000","last_peered":"2023-11-17T06:29:41.189626+0000","last_clean":"2023-11-17T06:29:41.189626+0000","last_became_active":"2023-11-17T06:29:39.014625+0000","last_became_peered":"2023-11-17T06:29:39.014625+0000","last_unstale":"2023-11-17T06:29:41.189626+0000","last_undegraded":"2023-11-17T06:29:41.189626+0000","last_fullsized":"2023-11-17T06:29:41.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189444+0000","last_change":"2023-11-17T06:29:40.054935+0000","last_active":"2023-11-17T06:29:41.189444+0000","last_peered":"2023-11-17T06:29:41.189444+0000","last_clean":"2023-11-17T06:29:41.189444+0000","last_became_active":"2023-11-17T06:29:40.054651+0000","last_became_peered":"2023-11-17T06:29:40.054651+0000","last_unstale":"2023-11-17T06:29:41.189444+0000","last_undegraded":"2023-11-17T06:29:41.189444+0000","last_fullsized":"2023-11-17T06:29:41.189444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189996+0000","last_change":"2023-11-17T06:29:39.020080+0000","last_active":"2023-11-17T06:29:41.189996+0000","last_peered":"2023-11-17T06:29:41.189996+0000","last_clean":"2023-11-17T06:29:41.189996+0000","last_became_active":"2023-11-17T06:29:39.018857+0000","last_became_peered":"2023-11-17T06:29:39.018857+0000","last_unstale":"2023-11-17T06:29:41.189996+0000","last_undegraded":"2023-11-17T06:29:41.189996+0000","last_fullsized":"2023-11-17T06:29:41.189996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":80752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":80626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:29:44.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:29:44.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.552+0000 7f7cc4fc8700 1 Processor -- start 2023-11-17T06:29:44.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 -- start start 2023-11-17T06:29:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cc00cd7f0 0x7f7cc00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00cfda0 con 0x7f7cc00d15a0 2023-11-17T06:29:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cc4b0 con 0x7f7cc00cd7f0 2023-11-17T06:29:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cc4fc8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc006e410 con 0x7f7cc006fb90 2023-11-17T06:29:44.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cbffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cbffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:45874/0 (socket says 172.21.15.100:45874) 2023-11-17T06:29:44.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cbf7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cc00cd7f0 0x7f7cc00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.556+0000 7f7cbffff700 1 -- 172.21.15.100:0/212019214 learned_addr learned my addr 172.21.15.100:0/212019214 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:44.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbffff700 1 -- 172.21.15.100:0/212019214 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00cd7f0 msgr2=0x7f7cc00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:44.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbffff700 1 --2- 172.21.15.100:0/212019214 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00cd7f0 0x7f7cc00cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbffff700 1 -- 172.21.15.100:0/212019214 >> v1:172.21.15.119:6789/0 conn(0x7f7cc00d15a0 legacy=0x7f7cc00cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbffff700 1 -- 172.21.15.100:0/212019214 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc006e6f0 con 0x7f7cc006fb90 2023-11-17T06:29:44.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbe7fc700 1 -- 172.21.15.100:0/212019214 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890882970 0 0) 0x7f7cc00cfda0 con 0x7f7cc00d15a0 2023-11-17T06:29:44.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbffff700 1 --2- 172.21.15.100:0/212019214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009e50 tx=0x7f7cb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd60368779f4e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbe7fc700 1 -- 172.21.15.100:0/212019214 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800e070 con 0x7f7cc006fb90 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbe7fc700 1 -- 172.21.15.100:0/212019214 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb800b910 con 0x7f7cc006fb90 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cbe7fc700 1 -- 172.21.15.100:0/212019214 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800bcc0 con 0x7f7cc006fb90 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/212019214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 msgr2=0x7f7cc00cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/212019214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009e50 tx=0x7f7cb800b330 comp rx=0 tx=0).stop 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/212019214 shutdown_connections 2023-11-17T06:29:44.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/212019214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc006fb90 0x7f7cc00cf170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/212019214 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00cd7f0 0x7f7cc00cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/212019214 >> 172.21.15.100:0/212019214 conn(0x7f7cc009a180 msgr2=0x7f7cc00d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/212019214 shutdown_connections 2023-11-17T06:29:44.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.560+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/212019214 wait complete. 2023-11-17T06:29:44.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 Processor -- start 2023-11-17T06:29:44.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 -- start start 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00cd7f0 0x7f7cc00b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00d15a0 0x7f7cc00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00b43e0 con 0x7f7cc006fb90 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc015e800 con 0x7f7cc00d15a0 2023-11-17T06:29:44.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cc4fc8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00b4630 con 0x7f7cc00cd7f0 2023-11-17T06:29:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47308/0 (socket says 172.21.15.100:47308) 2023-11-17T06:29:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 -- 172.21.15.100:0/1563327497 learned_addr learned my addr 172.21.15.100:0/1563327497 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbffff700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00d15a0 0x7f7cc00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbeffd700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00cd7f0 0x7f7cc00b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 -- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00cd7f0 msgr2=0x7f7cc00b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00cd7f0 0x7f7cc00b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 -- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00d15a0 msgr2=0x7f7cc00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00d15a0 0x7f7cc00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 -- 172.21.15.100:0/1563327497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009b30 con 0x7f7cc006fb90 2023-11-17T06:29:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7cbf7fe700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000e840 tx=0x7f7cb000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00095a0 con 0x7f7cc006fb90 2023-11-17T06:29:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0013680 con 0x7f7cc006fb90 2023-11-17T06:29:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.564+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00139f0 con 0x7f7cc006fb90 2023-11-17T06:29:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.568+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00b4910 con 0x7f7cc006fb90 2023-11-17T06:29:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.568+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00b29e0 con 0x7f7cc006fb90 2023-11-17T06:29:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.568+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0065e90 con 0x7f7cc006fb90 2023-11-17T06:29:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.568+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7cb0013b50 con 0x7f7cc006fb90 2023-11-17T06:29:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.572+0000 7f7ca7fff700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 0x7f7cac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.572+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb0084040 con 0x7f7cc006fb90 2023-11-17T06:29:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.572+0000 7f7cbeffd700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 0x7f7cac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.572+0000 7f7cbeffd700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 0x7f7cac068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0159c30 tx=0x7f7cb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.576+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7cb0051550 con 0x7f7cc006fb90 2023-11-17T06:29:44.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.752+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cc00cc700 con 0x7f7cac066540 2023-11-17T06:29:44.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.768+0000 7f7ca7fff700 1 -- 172.21.15.100:0/1563327497 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264514 (secure 0 0 0) 0x7f7cb4001480 con 0x7f7cac066540 2023-11-17T06:29:44.779 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:44.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 msgr2=0x7f7cac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 0x7f7cac068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0159c30 tx=0x7f7cb4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 msgr2=0x7f7cc00b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000e840 tx=0x7f7cb000eb50 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 shutdown_connections 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00d15a0 0x7f7cc00b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00cd7f0 0x7f7cc00b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7cac066540 0x7f7cac068a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 --2- 172.21.15.100:0/1563327497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc006fb90 0x7f7cc00b39d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 >> 172.21.15.100:0/1563327497 conn(0x7f7cc009a180 msgr2=0x7f7cc00ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 shutdown_connections 2023-11-17T06:29:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:44.776+0000 7f7cc4fc8700 1 -- 172.21.15.100:0/1563327497 wait complete. 2023-11-17T06:29:44.783 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:29:44.805 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2023-11-17T06:29:43.264085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219200,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755520,"statfs":{"total":773094113280,"available":772869652480,"internally_reserved":0,"allocated":3088384,"data_stored":1830564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.288147"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152090+0000","last_change":"2023-11-17T06:29:40.063019+0000","last_active":"2023-11-17T06:29:41.152090+0000","last_peered":"2023-11-17T06:29:41.152090+0000","last_clean":"2023-11-17T06:29:41.152090+0000","last_became_active":"2023-11-17T06:29:40.062726+0000","last_became_peered":"2023-11-17T06:29:40.062726+0000","last_unstale":"2023-11-17T06:29:41.152090+0000","last_undegraded":"2023-11-17T06:29:41.152090+0000","last_fullsized":"2023-11-17T06:29:41.152090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107932+0000","last_change":"2023-11-17T06:29:40.059039+0000","last_active":"2023-11-17T06:29:41.107932+0000","last_peered":"2023-11-17T06:29:41.107932+0000","last_clean":"2023-11-17T06:29:41.107932+0000","last_became_active":"2023-11-17T06:29:40.058738+0000","last_became_peered":"2023-11-17T06:29:40.058738+0000","last_unstale":"2023-11-17T06:29:41.107932+0000","last_undegraded":"2023-11-17T06:29:41.107932+0000","last_fullsized":"2023-11-17T06:29:41.107932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189875+0000","last_change":"2023-11-17T06:29:40.036396+0000","last_active":"2023-11-17T06:29:41.189875+0000","last_peered":"2023-11-17T06:29:41.189875+0000","last_clean":"2023-11-17T06:29:41.189875+0000","last_became_active":"2023-11-17T06:29:40.034856+0000","last_became_peered":"2023-11-17T06:29:40.034856+0000","last_unstale":"2023-11-17T06:29:41.189875+0000","last_undegraded":"2023-11-17T06:29:41.189875+0000","last_fullsized":"2023-11-17T06:29:41.189875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036505+0000","last_change":"2023-11-17T06:29:40.054375+0000","last_active":"2023-11-17T06:29:41.036505+0000","last_peered":"2023-11-17T06:29:41.036505+0000","last_clean":"2023-11-17T06:29:41.036505+0000","last_became_active":"2023-11-17T06:29:40.054057+0000","last_became_peered":"2023-11-17T06:29:40.054057+0000","last_unstale":"2023-11-17T06:29:41.036505+0000","last_undegraded":"2023-11-17T06:29:41.036505+0000","last_fullsized":"2023-11-17T06:29:41.036505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151486+0000","last_change":"2023-11-17T06:29:40.043645+0000","last_active":"2023-11-17T06:29:41.151486+0000","last_peered":"2023-11-17T06:29:41.151486+0000","last_clean":"2023-11-17T06:29:41.151486+0000","last_became_active":"2023-11-17T06:29:40.043104+0000","last_became_peered":"2023-11-17T06:29:40.043104+0000","last_unstale":"2023-11-17T06:29:41.151486+0000","last_undegraded":"2023-11-17T06:29:41.151486+0000","last_fullsized":"2023-11-17T06:29:41.151486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036135+0000","last_change":"2023-11-17T06:29:40.058390+0000","last_active":"2023-11-17T06:29:41.036135+0000","last_peered":"2023-11-17T06:29:41.036135+0000","last_clean":"2023-11-17T06:29:41.036135+0000","last_became_active":"2023-11-17T06:29:40.058051+0000","last_became_peered":"2023-11-17T06:29:40.058051+0000","last_unstale":"2023-11-17T06:29:41.036135+0000","last_undegraded":"2023-11-17T06:29:41.036135+0000","last_fullsized":"2023-11-17T06:29:41.036135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151241+0000","last_change":"2023-11-17T06:29:40.033175+0000","last_active":"2023-11-17T06:29:41.151241+0000","last_peered":"2023-11-17T06:29:41.151241+0000","last_clean":"2023-11-17T06:29:41.151241+0000","last_became_active":"2023-11-17T06:29:40.032870+0000","last_became_peered":"2023-11-17T06:29:40.032870+0000","last_unstale":"2023-11-17T06:29:41.151241+0000","last_undegraded":"2023-11-17T06:29:41.151241+0000","last_fullsized":"2023-11-17T06:29:41.151241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187178+0000","last_change":"2023-11-17T06:29:40.067796+0000","last_active":"2023-11-17T06:29:41.187178+0000","last_peered":"2023-11-17T06:29:41.187178+0000","last_clean":"2023-11-17T06:29:41.187178+0000","last_became_active":"2023-11-17T06:29:40.067549+0000","last_became_peered":"2023-11-17T06:29:40.067549+0000","last_unstale":"2023-11-17T06:29:41.187178+0000","last_undegraded":"2023-11-17T06:29:41.187178+0000","last_fullsized":"2023-11-17T06:29:41.187178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152224+0000","last_change":"2023-11-17T06:29:40.053086+0000","last_active":"2023-11-17T06:29:41.152224+0000","last_peered":"2023-11-17T06:29:41.152224+0000","last_clean":"2023-11-17T06:29:41.152224+0000","last_became_active":"2023-11-17T06:29:40.052820+0000","last_became_peered":"2023-11-17T06:29:40.052820+0000","last_unstale":"2023-11-17T06:29:41.152224+0000","last_undegraded":"2023-11-17T06:29:41.152224+0000","last_fullsized":"2023-11-17T06:29:41.152224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:34:42.735002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187565+0000","last_change":"2023-11-17T06:29:40.067431+0000","last_active":"2023-11-17T06:29:41.187565+0000","last_peered":"2023-11-17T06:29:41.187565+0000","last_clean":"2023-11-17T06:29:41.187565+0000","last_became_active":"2023-11-17T06:29:40.067106+0000","last_became_peered":"2023-11-17T06:29:40.067106+0000","last_unstale":"2023-11-17T06:29:41.187565+0000","last_undegraded":"2023-11-17T06:29:41.187565+0000","last_fullsized":"2023-11-17T06:29:41.187565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187309+0000","last_change":"2023-11-17T06:29:40.069847+0000","last_active":"2023-11-17T06:29:41.187309+0000","last_peered":"2023-11-17T06:29:41.187309+0000","last_clean":"2023-11-17T06:29:41.187309+0000","last_became_active":"2023-11-17T06:29:40.069567+0000","last_became_peered":"2023-11-17T06:29:40.069567+0000","last_unstale":"2023-11-17T06:29:41.187309+0000","last_undegraded":"2023-11-17T06:29:41.187309+0000","last_fullsized":"2023-11-17T06:29:41.187309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039102+0000","last_change":"2023-11-17T06:29:40.055649+0000","last_active":"2023-11-17T06:29:41.039102+0000","last_peered":"2023-11-17T06:29:41.039102+0000","last_clean":"2023-11-17T06:29:41.039102+0000","last_became_active":"2023-11-17T06:29:40.054763+0000","last_became_peered":"2023-11-17T06:29:40.054763+0000","last_unstale":"2023-11-17T06:29:41.039102+0000","last_undegraded":"2023-11-17T06:29:41.039102+0000","last_fullsized":"2023-11-17T06:29:41.039102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187571+0000","last_change":"2023-11-17T06:29:40.056634+0000","last_active":"2023-11-17T06:29:41.187571+0000","last_peered":"2023-11-17T06:29:41.187571+0000","last_clean":"2023-11-17T06:29:41.187571+0000","last_became_active":"2023-11-17T06:29:40.055547+0000","last_became_peered":"2023-11-17T06:29:40.055547+0000","last_unstale":"2023-11-17T06:29:41.187571+0000","last_undegraded":"2023-11-17T06:29:41.187571+0000","last_fullsized":"2023-11-17T06:29:41.187571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189196+0000","last_change":"2023-11-17T06:29:40.038547+0000","last_active":"2023-11-17T06:29:41.189196+0000","last_peered":"2023-11-17T06:29:41.189196+0000","last_clean":"2023-11-17T06:29:41.189196+0000","last_became_active":"2023-11-17T06:29:40.038231+0000","last_became_peered":"2023-11-17T06:29:40.038231+0000","last_unstale":"2023-11-17T06:29:41.189196+0000","last_undegraded":"2023-11-17T06:29:41.189196+0000","last_fullsized":"2023-11-17T06:29:41.189196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107274+0000","last_change":"2023-11-17T06:29:40.051827+0000","last_active":"2023-11-17T06:29:41.107274+0000","last_peered":"2023-11-17T06:29:41.107274+0000","last_clean":"2023-11-17T06:29:41.107274+0000","last_became_active":"2023-11-17T06:29:40.051501+0000","last_became_peered":"2023-11-17T06:29:40.051501+0000","last_unstale":"2023-11-17T06:29:41.107274+0000","last_undegraded":"2023-11-17T06:29:41.107274+0000","last_fullsized":"2023-11-17T06:29:41.107274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036003+0000","last_change":"2023-11-17T06:29:40.059452+0000","last_active":"2023-11-17T06:29:41.036003+0000","last_peered":"2023-11-17T06:29:41.036003+0000","last_clean":"2023-11-17T06:29:41.036003+0000","last_became_active":"2023-11-17T06:29:40.059183+0000","last_became_peered":"2023-11-17T06:29:40.059183+0000","last_unstale":"2023-11-17T06:29:41.036003+0000","last_undegraded":"2023-11-17T06:29:41.036003+0000","last_fullsized":"2023-11-17T06:29:41.036003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036860+0000","last_change":"2023-11-17T06:29:40.042601+0000","last_active":"2023-11-17T06:29:41.036860+0000","last_peered":"2023-11-17T06:29:41.036860+0000","last_clean":"2023-11-17T06:29:41.036860+0000","last_became_active":"2023-11-17T06:29:40.042331+0000","last_became_peered":"2023-11-17T06:29:40.042331+0000","last_unstale":"2023-11-17T06:29:41.036860+0000","last_undegraded":"2023-11-17T06:29:41.036860+0000","last_fullsized":"2023-11-17T06:29:41.036860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034229+0000","last_change":"2023-11-17T06:29:40.060783+0000","last_active":"2023-11-17T06:29:41.034229+0000","last_peered":"2023-11-17T06:29:41.034229+0000","last_clean":"2023-11-17T06:29:41.034229+0000","last_became_active":"2023-11-17T06:29:40.060402+0000","last_became_peered":"2023-11-17T06:29:40.060402+0000","last_unstale":"2023-11-17T06:29:41.034229+0000","last_undegraded":"2023-11-17T06:29:41.034229+0000","last_fullsized":"2023-11-17T06:29:41.034229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152132+0000","last_change":"2023-11-17T06:29:40.036086+0000","last_active":"2023-11-17T06:29:41.152132+0000","last_peered":"2023-11-17T06:29:41.152132+0000","last_clean":"2023-11-17T06:29:41.152132+0000","last_became_active":"2023-11-17T06:29:40.035726+0000","last_became_peered":"2023-11-17T06:29:40.035726+0000","last_unstale":"2023-11-17T06:29:41.152132+0000","last_undegraded":"2023-11-17T06:29:41.152132+0000","last_fullsized":"2023-11-17T06:29:41.152132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:32:30.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:40.054009+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:40.053676+0000","last_became_peered":"2023-11-17T06:29:40.053676+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188829+0000","last_change":"2023-11-17T06:29:40.030845+0000","last_active":"2023-11-17T06:29:41.188829+0000","last_peered":"2023-11-17T06:29:41.188829+0000","last_clean":"2023-11-17T06:29:41.188829+0000","last_became_active":"2023-11-17T06:29:40.030543+0000","last_became_peered":"2023-11-17T06:29:40.030543+0000","last_unstale":"2023-11-17T06:29:41.188829+0000","last_undegraded":"2023-11-17T06:29:41.188829+0000","last_fullsized":"2023-11-17T06:29:41.188829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:58.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036380+0000","last_change":"2023-11-17T06:29:40.044683+0000","last_active":"2023-11-17T06:29:41.036380+0000","last_peered":"2023-11-17T06:29:41.036380+0000","last_clean":"2023-11-17T06:29:41.036380+0000","last_became_active":"2023-11-17T06:29:40.044388+0000","last_became_peered":"2023-11-17T06:29:40.044388+0000","last_unstale":"2023-11-17T06:29:41.036380+0000","last_undegraded":"2023-11-17T06:29:41.036380+0000","last_fullsized":"2023-11-17T06:29:41.036380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187189+0000","last_change":"2023-11-17T06:29:40.053205+0000","last_active":"2023-11-17T06:29:41.187189+0000","last_peered":"2023-11-17T06:29:41.187189+0000","last_clean":"2023-11-17T06:29:41.187189+0000","last_became_active":"2023-11-17T06:29:40.052089+0000","last_became_peered":"2023-11-17T06:29:40.052089+0000","last_unstale":"2023-11-17T06:29:41.187189+0000","last_undegraded":"2023-11-17T06:29:41.187189+0000","last_fullsized":"2023-11-17T06:29:41.187189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036256+0000","last_change":"2023-11-17T06:29:40.043201+0000","last_active":"2023-11-17T06:29:41.036256+0000","last_peered":"2023-11-17T06:29:41.036256+0000","last_clean":"2023-11-17T06:29:41.036256+0000","last_became_active":"2023-11-17T06:29:40.042925+0000","last_became_peered":"2023-11-17T06:29:40.042925+0000","last_unstale":"2023-11-17T06:29:41.036256+0000","last_undegraded":"2023-11-17T06:29:41.036256+0000","last_fullsized":"2023-11-17T06:29:41.036256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189502+0000","last_change":"2023-11-17T06:29:40.051636+0000","last_active":"2023-11-17T06:29:41.189502+0000","last_peered":"2023-11-17T06:29:41.189502+0000","last_clean":"2023-11-17T06:29:41.189502+0000","last_became_active":"2023-11-17T06:29:40.051367+0000","last_became_peered":"2023-11-17T06:29:40.051367+0000","last_unstale":"2023-11-17T06:29:41.189502+0000","last_undegraded":"2023-11-17T06:29:41.189502+0000","last_fullsized":"2023-11-17T06:29:41.189502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187655+0000","last_change":"2023-11-17T06:29:40.048676+0000","last_active":"2023-11-17T06:29:41.187655+0000","last_peered":"2023-11-17T06:29:41.187655+0000","last_clean":"2023-11-17T06:29:41.187655+0000","last_became_active":"2023-11-17T06:29:40.048373+0000","last_became_peered":"2023-11-17T06:29:40.048373+0000","last_unstale":"2023-11-17T06:29:41.187655+0000","last_undegraded":"2023-11-17T06:29:41.187655+0000","last_fullsized":"2023-11-17T06:29:41.187655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107920+0000","last_change":"2023-11-17T06:29:40.048999+0000","last_active":"2023-11-17T06:29:41.107920+0000","last_peered":"2023-11-17T06:29:41.107920+0000","last_clean":"2023-11-17T06:29:41.107920+0000","last_became_active":"2023-11-17T06:29:40.048673+0000","last_became_peered":"2023-11-17T06:29:40.048673+0000","last_unstale":"2023-11-17T06:29:41.107920+0000","last_undegraded":"2023-11-17T06:29:41.107920+0000","last_fullsized":"2023-11-17T06:29:41.107920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187923+0000","last_change":"2023-11-17T06:29:40.049137+0000","last_active":"2023-11-17T06:29:41.187923+0000","last_peered":"2023-11-17T06:29:41.187923+0000","last_clean":"2023-11-17T06:29:41.187923+0000","last_became_active":"2023-11-17T06:29:40.047540+0000","last_became_peered":"2023-11-17T06:29:40.047540+0000","last_unstale":"2023-11-17T06:29:41.187923+0000","last_undegraded":"2023-11-17T06:29:41.187923+0000","last_fullsized":"2023-11-17T06:29:41.187923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189050+0000","last_change":"2023-11-17T06:29:40.044520+0000","last_active":"2023-11-17T06:29:41.189050+0000","last_peered":"2023-11-17T06:29:41.189050+0000","last_clean":"2023-11-17T06:29:41.189050+0000","last_became_active":"2023-11-17T06:29:40.044262+0000","last_became_peered":"2023-11-17T06:29:40.044262+0000","last_unstale":"2023-11-17T06:29:41.189050+0000","last_undegraded":"2023-11-17T06:29:41.189050+0000","last_fullsized":"2023-11-17T06:29:41.189050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036714+0000","last_change":"2023-11-17T06:29:40.051605+0000","last_active":"2023-11-17T06:29:41.036714+0000","last_peered":"2023-11-17T06:29:41.036714+0000","last_clean":"2023-11-17T06:29:41.036714+0000","last_became_active":"2023-11-17T06:29:40.051341+0000","last_became_peered":"2023-11-17T06:29:40.051341+0000","last_unstale":"2023-11-17T06:29:41.036714+0000","last_undegraded":"2023-11-17T06:29:41.036714+0000","last_fullsized":"2023-11-17T06:29:41.036714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034092+0000","last_change":"2023-11-17T06:29:40.033266+0000","last_active":"2023-11-17T06:29:41.034092+0000","last_peered":"2023-11-17T06:29:41.034092+0000","last_clean":"2023-11-17T06:29:41.034092+0000","last_became_active":"2023-11-17T06:29:40.032947+0000","last_became_peered":"2023-11-17T06:29:40.032947+0000","last_unstale":"2023-11-17T06:29:41.034092+0000","last_undegraded":"2023-11-17T06:29:41.034092+0000","last_fullsized":"2023-11-17T06:29:41.034092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187145+0000","last_change":"2023-11-17T06:29:40.061167+0000","last_active":"2023-11-17T06:29:41.187145+0000","last_peered":"2023-11-17T06:29:41.187145+0000","last_clean":"2023-11-17T06:29:41.187145+0000","last_became_active":"2023-11-17T06:29:40.060764+0000","last_became_peered":"2023-11-17T06:29:40.060764+0000","last_unstale":"2023-11-17T06:29:41.187145+0000","last_undegraded":"2023-11-17T06:29:41.187145+0000","last_fullsized":"2023-11-17T06:29:41.187145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038784+0000","last_change":"2023-11-17T06:29:40.049645+0000","last_active":"2023-11-17T06:29:41.038784+0000","last_peered":"2023-11-17T06:29:41.038784+0000","last_clean":"2023-11-17T06:29:41.038784+0000","last_became_active":"2023-11-17T06:29:40.049273+0000","last_became_peered":"2023-11-17T06:29:40.049273+0000","last_unstale":"2023-11-17T06:29:41.038784+0000","last_undegraded":"2023-11-17T06:29:41.038784+0000","last_fullsized":"2023-11-17T06:29:41.038784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:55:28.543526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187800+0000","last_change":"2023-11-17T06:29:39.017855+0000","last_active":"2023-11-17T06:29:41.187800+0000","last_peered":"2023-11-17T06:29:41.187800+0000","last_clean":"2023-11-17T06:29:41.187800+0000","last_became_active":"2023-11-17T06:29:39.017537+0000","last_became_peered":"2023-11-17T06:29:39.017537+0000","last_unstale":"2023-11-17T06:29:41.187800+0000","last_undegraded":"2023-11-17T06:29:41.187800+0000","last_fullsized":"2023-11-17T06:29:41.187800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188971+0000","last_change":"2023-11-17T06:29:40.055514+0000","last_active":"2023-11-17T06:29:41.188971+0000","last_peered":"2023-11-17T06:29:41.188971+0000","last_clean":"2023-11-17T06:29:41.188971+0000","last_became_active":"2023-11-17T06:29:40.055200+0000","last_became_peered":"2023-11-17T06:29:40.055200+0000","last_unstale":"2023-11-17T06:29:41.188971+0000","last_undegraded":"2023-11-17T06:29:41.188971+0000","last_fullsized":"2023-11-17T06:29:41.188971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:40.599968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187590+0000","last_change":"2023-11-17T06:29:39.020908+0000","last_active":"2023-11-17T06:29:41.187590+0000","last_peered":"2023-11-17T06:29:41.187590+0000","last_clean":"2023-11-17T06:29:41.187590+0000","last_became_active":"2023-11-17T06:29:39.020586+0000","last_became_peered":"2023-11-17T06:29:39.020586+0000","last_unstale":"2023-11-17T06:29:41.187590+0000","last_undegraded":"2023-11-17T06:29:41.187590+0000","last_fullsized":"2023-11-17T06:29:41.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187260+0000","last_change":"2023-11-17T06:29:39.021831+0000","last_active":"2023-11-17T06:29:41.187260+0000","last_peered":"2023-11-17T06:29:41.187260+0000","last_clean":"2023-11-17T06:29:41.187260+0000","last_became_active":"2023-11-17T06:29:39.019316+0000","last_became_peered":"2023-11-17T06:29:39.019316+0000","last_unstale":"2023-11-17T06:29:41.187260+0000","last_undegraded":"2023-11-17T06:29:41.187260+0000","last_fullsized":"2023-11-17T06:29:41.187260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187226+0000","last_change":"2023-11-17T06:29:40.045533+0000","last_active":"2023-11-17T06:29:41.187226+0000","last_peered":"2023-11-17T06:29:41.187226+0000","last_clean":"2023-11-17T06:29:41.187226+0000","last_became_active":"2023-11-17T06:29:40.045114+0000","last_became_peered":"2023-11-17T06:29:40.045114+0000","last_unstale":"2023-11-17T06:29:41.187226+0000","last_undegraded":"2023-11-17T06:29:41.187226+0000","last_fullsized":"2023-11-17T06:29:41.187226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036436+0000","last_change":"2023-11-17T06:29:39.017157+0000","last_active":"2023-11-17T06:29:41.036436+0000","last_peered":"2023-11-17T06:29:41.036436+0000","last_clean":"2023-11-17T06:29:41.036436+0000","last_became_active":"2023-11-17T06:29:39.016730+0000","last_became_peered":"2023-11-17T06:29:39.016730+0000","last_unstale":"2023-11-17T06:29:41.036436+0000","last_undegraded":"2023-11-17T06:29:41.036436+0000","last_fullsized":"2023-11-17T06:29:41.036436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107184+0000","last_change":"2023-11-17T06:29:40.049925+0000","last_active":"2023-11-17T06:29:41.107184+0000","last_peered":"2023-11-17T06:29:41.107184+0000","last_clean":"2023-11-17T06:29:41.107184+0000","last_became_active":"2023-11-17T06:29:40.049606+0000","last_became_peered":"2023-11-17T06:29:40.049606+0000","last_unstale":"2023-11-17T06:29:41.107184+0000","last_undegraded":"2023-11-17T06:29:41.107184+0000","last_fullsized":"2023-11-17T06:29:41.107184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187631+0000","last_change":"2023-11-17T06:29:39.022881+0000","last_active":"2023-11-17T06:29:41.187631+0000","last_peered":"2023-11-17T06:29:41.187631+0000","last_clean":"2023-11-17T06:29:41.187631+0000","last_became_active":"2023-11-17T06:29:39.022626+0000","last_became_peered":"2023-11-17T06:29:39.022626+0000","last_unstale":"2023-11-17T06:29:41.187631+0000","last_undegraded":"2023-11-17T06:29:41.187631+0000","last_fullsized":"2023-11-17T06:29:41.187631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036999+0000","last_change":"2023-11-17T06:29:40.064114+0000","last_active":"2023-11-17T06:29:41.036999+0000","last_peered":"2023-11-17T06:29:41.036999+0000","last_clean":"2023-11-17T06:29:41.036999+0000","last_became_active":"2023-11-17T06:29:40.063813+0000","last_became_peered":"2023-11-17T06:29:40.063813+0000","last_unstale":"2023-11-17T06:29:41.036999+0000","last_undegraded":"2023-11-17T06:29:41.036999+0000","last_fullsized":"2023-11-17T06:29:41.036999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037198+0000","last_change":"2023-11-17T06:29:39.021771+0000","last_active":"2023-11-17T06:29:41.037198+0000","last_peered":"2023-11-17T06:29:41.037198+0000","last_clean":"2023-11-17T06:29:41.037198+0000","last_became_active":"2023-11-17T06:29:39.020672+0000","last_became_peered":"2023-11-17T06:29:39.020672+0000","last_unstale":"2023-11-17T06:29:41.037198+0000","last_undegraded":"2023-11-17T06:29:41.037198+0000","last_fullsized":"2023-11-17T06:29:41.037198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:51.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189905+0000","last_change":"2023-11-17T06:29:40.034173+0000","last_active":"2023-11-17T06:29:41.189905+0000","last_peered":"2023-11-17T06:29:41.189905+0000","last_clean":"2023-11-17T06:29:41.189905+0000","last_became_active":"2023-11-17T06:29:40.033194+0000","last_became_peered":"2023-11-17T06:29:40.033194+0000","last_unstale":"2023-11-17T06:29:41.189905+0000","last_undegraded":"2023-11-17T06:29:41.189905+0000","last_fullsized":"2023-11-17T06:29:41.189905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107726+0000","last_change":"2023-11-17T06:29:39.017388+0000","last_active":"2023-11-17T06:29:41.107726+0000","last_peered":"2023-11-17T06:29:41.107726+0000","last_clean":"2023-11-17T06:29:41.107726+0000","last_became_active":"2023-11-17T06:29:39.017072+0000","last_became_peered":"2023-11-17T06:29:39.017072+0000","last_unstale":"2023-11-17T06:29:41.107726+0000","last_undegraded":"2023-11-17T06:29:41.107726+0000","last_fullsized":"2023-11-17T06:29:41.107726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039292+0000","last_change":"2023-11-17T06:29:40.047302+0000","last_active":"2023-11-17T06:29:41.039292+0000","last_peered":"2023-11-17T06:29:41.039292+0000","last_clean":"2023-11-17T06:29:41.039292+0000","last_became_active":"2023-11-17T06:29:40.043674+0000","last_became_peered":"2023-11-17T06:29:40.043674+0000","last_unstale":"2023-11-17T06:29:41.039292+0000","last_undegraded":"2023-11-17T06:29:41.039292+0000","last_fullsized":"2023-11-17T06:29:41.039292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:39.017824+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:39.016946+0000","last_became_peered":"2023-11-17T06:29:39.016946+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.049717+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.048800+0000","last_became_peered":"2023-11-17T06:29:40.048800+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189065+0000","last_change":"2023-11-17T06:29:39.015752+0000","last_active":"2023-11-17T06:29:41.189065+0000","last_peered":"2023-11-17T06:29:41.189065+0000","last_clean":"2023-11-17T06:29:41.189065+0000","last_became_active":"2023-11-17T06:29:39.015186+0000","last_became_peered":"2023-11-17T06:29:39.015186+0000","last_unstale":"2023-11-17T06:29:41.189065+0000","last_undegraded":"2023-11-17T06:29:41.189065+0000","last_fullsized":"2023-11-17T06:29:41.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189437+0000","last_change":"2023-11-17T06:29:40.031730+0000","last_active":"2023-11-17T06:29:41.189437+0000","last_peered":"2023-11-17T06:29:41.189437+0000","last_clean":"2023-11-17T06:29:41.189437+0000","last_became_active":"2023-11-17T06:29:40.031393+0000","last_became_peered":"2023-11-17T06:29:40.031393+0000","last_unstale":"2023-11-17T06:29:41.189437+0000","last_undegraded":"2023-11-17T06:29:41.189437+0000","last_fullsized":"2023-11-17T06:29:41.189437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037146+0000","last_change":"2023-11-17T06:29:39.018521+0000","last_active":"2023-11-17T06:29:41.037146+0000","last_peered":"2023-11-17T06:29:41.037146+0000","last_clean":"2023-11-17T06:29:41.037146+0000","last_became_active":"2023-11-17T06:29:39.016769+0000","last_became_peered":"2023-11-17T06:29:39.016769+0000","last_unstale":"2023-11-17T06:29:41.037146+0000","last_undegraded":"2023-11-17T06:29:41.037146+0000","last_fullsized":"2023-11-17T06:29:41.037146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:24.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151548+0000","last_change":"2023-11-17T06:29:40.058720+0000","last_active":"2023-11-17T06:29:41.151548+0000","last_peered":"2023-11-17T06:29:41.151548+0000","last_clean":"2023-11-17T06:29:41.151548+0000","last_became_active":"2023-11-17T06:29:40.057027+0000","last_became_peered":"2023-11-17T06:29:40.057027+0000","last_unstale":"2023-11-17T06:29:41.151548+0000","last_undegraded":"2023-11-17T06:29:41.151548+0000","last_fullsized":"2023-11-17T06:29:41.151548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187287+0000","last_change":"2023-11-17T06:29:39.019273+0000","last_active":"2023-11-17T06:29:41.187287+0000","last_peered":"2023-11-17T06:29:41.187287+0000","last_clean":"2023-11-17T06:29:41.187287+0000","last_became_active":"2023-11-17T06:29:39.017424+0000","last_became_peered":"2023-11-17T06:29:39.017424+0000","last_unstale":"2023-11-17T06:29:41.187287+0000","last_undegraded":"2023-11-17T06:29:41.187287+0000","last_fullsized":"2023-11-17T06:29:41.187287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187172+0000","last_change":"2023-11-17T06:29:40.052673+0000","last_active":"2023-11-17T06:29:41.187172+0000","last_peered":"2023-11-17T06:29:41.187172+0000","last_clean":"2023-11-17T06:29:41.187172+0000","last_became_active":"2023-11-17T06:29:40.052360+0000","last_became_peered":"2023-11-17T06:29:40.052360+0000","last_unstale":"2023-11-17T06:29:41.187172+0000","last_undegraded":"2023-11-17T06:29:41.187172+0000","last_fullsized":"2023-11-17T06:29:41.187172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033791+0000","last_change":"2023-11-17T06:29:39.012145+0000","last_active":"2023-11-17T06:29:41.033791+0000","last_peered":"2023-11-17T06:29:41.033791+0000","last_clean":"2023-11-17T06:29:41.033791+0000","last_became_active":"2023-11-17T06:29:39.011840+0000","last_became_peered":"2023-11-17T06:29:39.011840+0000","last_unstale":"2023-11-17T06:29:41.033791+0000","last_undegraded":"2023-11-17T06:29:41.033791+0000","last_fullsized":"2023-11-17T06:29:41.033791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:14:03.642188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151184+0000","last_change":"2023-11-17T06:29:40.047955+0000","last_active":"2023-11-17T06:29:41.151184+0000","last_peered":"2023-11-17T06:29:41.151184+0000","last_clean":"2023-11-17T06:29:41.151184+0000","last_became_active":"2023-11-17T06:29:40.047530+0000","last_became_peered":"2023-11-17T06:29:40.047530+0000","last_unstale":"2023-11-17T06:29:41.151184+0000","last_undegraded":"2023-11-17T06:29:41.151184+0000","last_fullsized":"2023-11-17T06:29:41.151184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039359+0000","last_change":"2023-11-17T06:29:39.015633+0000","last_active":"2023-11-17T06:29:41.039359+0000","last_peered":"2023-11-17T06:29:41.039359+0000","last_clean":"2023-11-17T06:29:41.039359+0000","last_became_active":"2023-11-17T06:29:39.015301+0000","last_became_peered":"2023-11-17T06:29:39.015301+0000","last_unstale":"2023-11-17T06:29:41.039359+0000","last_undegraded":"2023-11-17T06:29:41.039359+0000","last_fullsized":"2023-11-17T06:29:41.039359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152124+0000","last_change":"2023-11-17T06:29:40.056743+0000","last_active":"2023-11-17T06:29:41.152124+0000","last_peered":"2023-11-17T06:29:41.152124+0000","last_clean":"2023-11-17T06:29:41.152124+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152124+0000","last_undegraded":"2023-11-17T06:29:41.152124+0000","last_fullsized":"2023-11-17T06:29:41.152124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:48:00.372978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034190+0000","last_change":"2023-11-17T06:29:39.018457+0000","last_active":"2023-11-17T06:29:41.034190+0000","last_peered":"2023-11-17T06:29:41.034190+0000","last_clean":"2023-11-17T06:29:41.034190+0000","last_became_active":"2023-11-17T06:29:39.014204+0000","last_became_peered":"2023-11-17T06:29:39.014204+0000","last_unstale":"2023-11-17T06:29:41.034190+0000","last_undegraded":"2023-11-17T06:29:41.034190+0000","last_fullsized":"2023-11-17T06:29:41.034190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152267+0000","last_change":"2023-11-17T06:29:40.056354+0000","last_active":"2023-11-17T06:29:41.152267+0000","last_peered":"2023-11-17T06:29:41.152267+0000","last_clean":"2023-11-17T06:29:41.152267+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152267+0000","last_undegraded":"2023-11-17T06:29:41.152267+0000","last_fullsized":"2023-11-17T06:29:41.152267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:13:49.943175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107824+0000","last_change":"2023-11-17T06:29:39.006221+0000","last_active":"2023-11-17T06:29:41.107824+0000","last_peered":"2023-11-17T06:29:41.107824+0000","last_clean":"2023-11-17T06:29:41.107824+0000","last_became_active":"2023-11-17T06:29:39.005712+0000","last_became_peered":"2023-11-17T06:29:39.005712+0000","last_unstale":"2023-11-17T06:29:41.107824+0000","last_undegraded":"2023-11-17T06:29:41.107824+0000","last_fullsized":"2023-11-17T06:29:41.107824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037120+0000","last_change":"2023-11-17T06:29:40.054044+0000","last_active":"2023-11-17T06:29:41.037120+0000","last_peered":"2023-11-17T06:29:41.037120+0000","last_clean":"2023-11-17T06:29:41.037120+0000","last_became_active":"2023-11-17T06:29:40.050897+0000","last_became_peered":"2023-11-17T06:29:40.050897+0000","last_unstale":"2023-11-17T06:29:41.037120+0000","last_undegraded":"2023-11-17T06:29:41.037120+0000","last_fullsized":"2023-11-17T06:29:41.037120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033921+0000","last_change":"2023-11-17T06:29:39.018173+0000","last_active":"2023-11-17T06:29:41.033921+0000","last_peered":"2023-11-17T06:29:41.033921+0000","last_clean":"2023-11-17T06:29:41.033921+0000","last_became_active":"2023-11-17T06:29:39.017909+0000","last_became_peered":"2023-11-17T06:29:39.017909+0000","last_unstale":"2023-11-17T06:29:41.033921+0000","last_undegraded":"2023-11-17T06:29:41.033921+0000","last_fullsized":"2023-11-17T06:29:41.033921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:57.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.067949+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.065233+0000","last_became_peered":"2023-11-17T06:29:40.065233+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-17T06:29:40.021755+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:29:40.021755+0000","last_peered":"2023-11-17T06:29:40.021755+0000","last_clean":"2023-11-17T06:29:40.021755+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:29:40.021755+0000","last_undegraded":"2023-11-17T06:29:40.021755+0000","last_fullsized":"2023-11-17T06:29:40.021755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.035967+0000","last_change":"2023-11-17T06:29:39.012948+0000","last_active":"2023-11-17T06:29:41.035967+0000","last_peered":"2023-11-17T06:29:41.035967+0000","last_clean":"2023-11-17T06:29:41.035967+0000","last_became_active":"2023-11-17T06:29:39.012399+0000","last_became_peered":"2023-11-17T06:29:39.012399+0000","last_unstale":"2023-11-17T06:29:41.035967+0000","last_undegraded":"2023-11-17T06:29:41.035967+0000","last_fullsized":"2023-11-17T06:29:41.035967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:04.513942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187413+0000","last_change":"2023-11-17T06:29:40.067314+0000","last_active":"2023-11-17T06:29:41.187413+0000","last_peered":"2023-11-17T06:29:41.187413+0000","last_clean":"2023-11-17T06:29:41.187413+0000","last_became_active":"2023-11-17T06:29:40.067024+0000","last_became_peered":"2023-11-17T06:29:40.067024+0000","last_unstale":"2023-11-17T06:29:41.187413+0000","last_undegraded":"2023-11-17T06:29:41.187413+0000","last_fullsized":"2023-11-17T06:29:41.187413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150983+0000","last_change":"2023-11-17T06:29:39.018265+0000","last_active":"2023-11-17T06:29:41.150983+0000","last_peered":"2023-11-17T06:29:41.150983+0000","last_clean":"2023-11-17T06:29:41.150983+0000","last_became_active":"2023-11-17T06:29:39.017921+0000","last_became_peered":"2023-11-17T06:29:39.017921+0000","last_unstale":"2023-11-17T06:29:41.150983+0000","last_undegraded":"2023-11-17T06:29:41.150983+0000","last_fullsized":"2023-11-17T06:29:41.150983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:21.174865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188592+0000","last_change":"2023-11-17T06:29:40.058305+0000","last_active":"2023-11-17T06:29:41.188592+0000","last_peered":"2023-11-17T06:29:41.188592+0000","last_clean":"2023-11-17T06:29:41.188592+0000","last_became_active":"2023-11-17T06:29:40.058045+0000","last_became_peered":"2023-11-17T06:29:40.058045+0000","last_unstale":"2023-11-17T06:29:41.188592+0000","last_undegraded":"2023-11-17T06:29:41.188592+0000","last_fullsized":"2023-11-17T06:29:41.188592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:48.722666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033924+0000","last_change":"2023-11-17T06:29:39.009964+0000","last_active":"2023-11-17T06:29:41.033924+0000","last_peered":"2023-11-17T06:29:41.033924+0000","last_clean":"2023-11-17T06:29:41.033924+0000","last_became_active":"2023-11-17T06:29:39.007573+0000","last_became_peered":"2023-11-17T06:29:39.007573+0000","last_unstale":"2023-11-17T06:29:41.033924+0000","last_undegraded":"2023-11-17T06:29:41.033924+0000","last_fullsized":"2023-11-17T06:29:41.033924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:00:22.924749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107525+0000","last_change":"2023-11-17T06:29:40.038796+0000","last_active":"2023-11-17T06:29:41.107525+0000","last_peered":"2023-11-17T06:29:41.107525+0000","last_clean":"2023-11-17T06:29:41.107525+0000","last_became_active":"2023-11-17T06:29:40.038469+0000","last_became_peered":"2023-11-17T06:29:40.038469+0000","last_unstale":"2023-11-17T06:29:41.107525+0000","last_undegraded":"2023-11-17T06:29:41.107525+0000","last_fullsized":"2023-11-17T06:29:41.107525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037187+0000","last_change":"2023-11-17T06:29:39.007112+0000","last_active":"2023-11-17T06:29:41.037187+0000","last_peered":"2023-11-17T06:29:41.037187+0000","last_clean":"2023-11-17T06:29:41.037187+0000","last_became_active":"2023-11-17T06:29:39.006736+0000","last_became_peered":"2023-11-17T06:29:39.006736+0000","last_unstale":"2023-11-17T06:29:41.037187+0000","last_undegraded":"2023-11-17T06:29:41.037187+0000","last_fullsized":"2023-11-17T06:29:41.037187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038938+0000","last_change":"2023-11-17T06:29:40.059681+0000","last_active":"2023-11-17T06:29:41.038938+0000","last_peered":"2023-11-17T06:29:41.038938+0000","last_clean":"2023-11-17T06:29:41.038938+0000","last_became_active":"2023-11-17T06:29:40.059165+0000","last_became_peered":"2023-11-17T06:29:40.059165+0000","last_unstale":"2023-11-17T06:29:41.038938+0000","last_undegraded":"2023-11-17T06:29:41.038938+0000","last_fullsized":"2023-11-17T06:29:41.038938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:58.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107450+0000","last_change":"2023-11-17T06:29:39.015572+0000","last_active":"2023-11-17T06:29:41.107450+0000","last_peered":"2023-11-17T06:29:41.107450+0000","last_clean":"2023-11-17T06:29:41.107450+0000","last_became_active":"2023-11-17T06:29:39.015272+0000","last_became_peered":"2023-11-17T06:29:39.015272+0000","last_unstale":"2023-11-17T06:29:41.107450+0000","last_undegraded":"2023-11-17T06:29:41.107450+0000","last_fullsized":"2023-11-17T06:29:41.107450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036928+0000","last_change":"2023-11-17T06:29:40.054094+0000","last_active":"2023-11-17T06:29:41.036928+0000","last_peered":"2023-11-17T06:29:41.036928+0000","last_clean":"2023-11-17T06:29:41.036928+0000","last_became_active":"2023-11-17T06:29:40.053816+0000","last_became_peered":"2023-11-17T06:29:40.053816+0000","last_unstale":"2023-11-17T06:29:41.036928+0000","last_undegraded":"2023-11-17T06:29:41.036928+0000","last_fullsized":"2023-11-17T06:29:41.036928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152236+0000","last_change":"2023-11-17T06:29:39.019355+0000","last_active":"2023-11-17T06:29:41.152236+0000","last_peered":"2023-11-17T06:29:41.152236+0000","last_clean":"2023-11-17T06:29:41.152236+0000","last_became_active":"2023-11-17T06:29:39.019090+0000","last_became_peered":"2023-11-17T06:29:39.019090+0000","last_unstale":"2023-11-17T06:29:41.152236+0000","last_undegraded":"2023-11-17T06:29:41.152236+0000","last_fullsized":"2023-11-17T06:29:41.152236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:35.188435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107457+0000","last_change":"2023-11-17T06:29:40.043278+0000","last_active":"2023-11-17T06:29:41.107457+0000","last_peered":"2023-11-17T06:29:41.107457+0000","last_clean":"2023-11-17T06:29:41.107457+0000","last_became_active":"2023-11-17T06:29:40.043106+0000","last_became_peered":"2023-11-17T06:29:40.043106+0000","last_unstale":"2023-11-17T06:29:41.107457+0000","last_undegraded":"2023-11-17T06:29:41.107457+0000","last_fullsized":"2023-11-17T06:29:41.107457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107981+0000","last_change":"2023-11-17T06:29:39.020748+0000","last_active":"2023-11-17T06:29:41.107981+0000","last_peered":"2023-11-17T06:29:41.107981+0000","last_clean":"2023-11-17T06:29:41.107981+0000","last_became_active":"2023-11-17T06:29:39.020192+0000","last_became_peered":"2023-11-17T06:29:39.020192+0000","last_unstale":"2023-11-17T06:29:41.107981+0000","last_undegraded":"2023-11-17T06:29:41.107981+0000","last_fullsized":"2023-11-17T06:29:41.107981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189551+0000","last_change":"2023-11-17T06:29:40.044168+0000","last_active":"2023-11-17T06:29:41.189551+0000","last_peered":"2023-11-17T06:29:41.189551+0000","last_clean":"2023-11-17T06:29:41.189551+0000","last_became_active":"2023-11-17T06:29:40.043816+0000","last_became_peered":"2023-11-17T06:29:40.043816+0000","last_unstale":"2023-11-17T06:29:41.189551+0000","last_undegraded":"2023-11-17T06:29:41.189551+0000","last_fullsized":"2023-11-17T06:29:41.189551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187665+0000","last_change":"2023-11-17T06:29:39.014734+0000","last_active":"2023-11-17T06:29:41.187665+0000","last_peered":"2023-11-17T06:29:41.187665+0000","last_clean":"2023-11-17T06:29:41.187665+0000","last_became_active":"2023-11-17T06:29:39.014327+0000","last_became_peered":"2023-11-17T06:29:39.014327+0000","last_unstale":"2023-11-17T06:29:41.187665+0000","last_undegraded":"2023-11-17T06:29:41.187665+0000","last_fullsized":"2023-11-17T06:29:41.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.190089+0000","last_change":"2023-11-17T06:29:40.062903+0000","last_active":"2023-11-17T06:29:41.190089+0000","last_peered":"2023-11-17T06:29:41.190089+0000","last_clean":"2023-11-17T06:29:41.190089+0000","last_became_active":"2023-11-17T06:29:40.062579+0000","last_became_peered":"2023-11-17T06:29:40.062579+0000","last_unstale":"2023-11-17T06:29:41.190089+0000","last_undegraded":"2023-11-17T06:29:41.190089+0000","last_fullsized":"2023-11-17T06:29:41.190089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150984+0000","last_change":"2023-11-17T06:29:39.021850+0000","last_active":"2023-11-17T06:29:41.150984+0000","last_peered":"2023-11-17T06:29:41.150984+0000","last_clean":"2023-11-17T06:29:41.150984+0000","last_became_active":"2023-11-17T06:29:39.017210+0000","last_became_peered":"2023-11-17T06:29:39.017210+0000","last_unstale":"2023-11-17T06:29:41.150984+0000","last_undegraded":"2023-11-17T06:29:41.150984+0000","last_fullsized":"2023-11-17T06:29:41.150984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:26.995063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038808+0000","last_change":"2023-11-17T06:29:40.062837+0000","last_active":"2023-11-17T06:29:41.038808+0000","last_peered":"2023-11-17T06:29:41.038808+0000","last_clean":"2023-11-17T06:29:41.038808+0000","last_became_active":"2023-11-17T06:29:40.062553+0000","last_became_peered":"2023-11-17T06:29:40.062553+0000","last_unstale":"2023-11-17T06:29:41.038808+0000","last_undegraded":"2023-11-17T06:29:41.038808+0000","last_fullsized":"2023-11-17T06:29:41.038808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:20:05.317093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107283+0000","last_change":"2023-11-17T06:29:39.010652+0000","last_active":"2023-11-17T06:29:41.107283+0000","last_peered":"2023-11-17T06:29:41.107283+0000","last_clean":"2023-11-17T06:29:41.107283+0000","last_became_active":"2023-11-17T06:29:39.009663+0000","last_became_peered":"2023-11-17T06:29:39.009663+0000","last_unstale":"2023-11-17T06:29:41.107283+0000","last_undegraded":"2023-11-17T06:29:41.107283+0000","last_fullsized":"2023-11-17T06:29:41.107283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187492+0000","last_change":"2023-11-17T06:29:40.046969+0000","last_active":"2023-11-17T06:29:41.187492+0000","last_peered":"2023-11-17T06:29:41.187492+0000","last_clean":"2023-11-17T06:29:41.187492+0000","last_became_active":"2023-11-17T06:29:40.046400+0000","last_became_peered":"2023-11-17T06:29:40.046400+0000","last_unstale":"2023-11-17T06:29:41.187492+0000","last_undegraded":"2023-11-17T06:29:41.187492+0000","last_fullsized":"2023-11-17T06:29:41.187492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107727+0000","last_change":"2023-11-17T06:29:39.015476+0000","last_active":"2023-11-17T06:29:41.107727+0000","last_peered":"2023-11-17T06:29:41.107727+0000","last_clean":"2023-11-17T06:29:41.107727+0000","last_became_active":"2023-11-17T06:29:39.015166+0000","last_became_peered":"2023-11-17T06:29:39.015166+0000","last_unstale":"2023-11-17T06:29:41.107727+0000","last_undegraded":"2023-11-17T06:29:41.107727+0000","last_fullsized":"2023-11-17T06:29:41.107727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187769+0000","last_change":"2023-11-17T06:29:40.044575+0000","last_active":"2023-11-17T06:29:41.187769+0000","last_peered":"2023-11-17T06:29:41.187769+0000","last_clean":"2023-11-17T06:29:41.187769+0000","last_became_active":"2023-11-17T06:29:40.044313+0000","last_became_peered":"2023-11-17T06:29:40.044313+0000","last_unstale":"2023-11-17T06:29:41.187769+0000","last_undegraded":"2023-11-17T06:29:41.187769+0000","last_fullsized":"2023-11-17T06:29:41.187769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151785+0000","last_change":"2023-11-17T06:29:39.022524+0000","last_active":"2023-11-17T06:29:41.151785+0000","last_peered":"2023-11-17T06:29:41.151785+0000","last_clean":"2023-11-17T06:29:41.151785+0000","last_became_active":"2023-11-17T06:29:39.022245+0000","last_became_peered":"2023-11-17T06:29:39.022245+0000","last_unstale":"2023-11-17T06:29:41.151785+0000","last_undegraded":"2023-11-17T06:29:41.151785+0000","last_fullsized":"2023-11-17T06:29:41.151785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187140+0000","last_change":"2023-11-17T06:29:40.050948+0000","last_active":"2023-11-17T06:29:41.187140+0000","last_peered":"2023-11-17T06:29:41.187140+0000","last_clean":"2023-11-17T06:29:41.187140+0000","last_became_active":"2023-11-17T06:29:40.050407+0000","last_became_peered":"2023-11-17T06:29:40.050407+0000","last_unstale":"2023-11-17T06:29:41.187140+0000","last_undegraded":"2023-11-17T06:29:41.187140+0000","last_fullsized":"2023-11-17T06:29:41.187140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036601+0000","last_change":"2023-11-17T06:29:40.064292+0000","last_active":"2023-11-17T06:29:41.036601+0000","last_peered":"2023-11-17T06:29:41.036601+0000","last_clean":"2023-11-17T06:29:41.036601+0000","last_became_active":"2023-11-17T06:29:40.063950+0000","last_became_peered":"2023-11-17T06:29:40.063950+0000","last_unstale":"2023-11-17T06:29:41.036601+0000","last_undegraded":"2023-11-17T06:29:41.036601+0000","last_fullsized":"2023-11-17T06:29:41.036601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151542+0000","last_change":"2023-11-17T06:29:39.026270+0000","last_active":"2023-11-17T06:29:41.151542+0000","last_peered":"2023-11-17T06:29:41.151542+0000","last_clean":"2023-11-17T06:29:41.151542+0000","last_became_active":"2023-11-17T06:29:39.025930+0000","last_became_peered":"2023-11-17T06:29:39.025930+0000","last_unstale":"2023-11-17T06:29:41.151542+0000","last_undegraded":"2023-11-17T06:29:41.151542+0000","last_fullsized":"2023-11-17T06:29:41.151542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:02.074512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036867+0000","last_change":"2023-11-17T06:29:40.054287+0000","last_active":"2023-11-17T06:29:41.036867+0000","last_peered":"2023-11-17T06:29:41.036867+0000","last_clean":"2023-11-17T06:29:41.036867+0000","last_became_active":"2023-11-17T06:29:40.053760+0000","last_became_peered":"2023-11-17T06:29:40.053760+0000","last_unstale":"2023-11-17T06:29:41.036867+0000","last_undegraded":"2023-11-17T06:29:41.036867+0000","last_fullsized":"2023-11-17T06:29:41.036867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152006+0000","last_change":"2023-11-17T06:29:39.021077+0000","last_active":"2023-11-17T06:29:41.152006+0000","last_peered":"2023-11-17T06:29:41.152006+0000","last_clean":"2023-11-17T06:29:41.152006+0000","last_became_active":"2023-11-17T06:29:39.020821+0000","last_became_peered":"2023-11-17T06:29:39.020821+0000","last_unstale":"2023-11-17T06:29:41.152006+0000","last_undegraded":"2023-11-17T06:29:41.152006+0000","last_fullsized":"2023-11-17T06:29:41.152006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189999+0000","last_change":"2023-11-17T06:29:40.065696+0000","last_active":"2023-11-17T06:29:41.189999+0000","last_peered":"2023-11-17T06:29:41.189999+0000","last_clean":"2023-11-17T06:29:41.189999+0000","last_became_active":"2023-11-17T06:29:40.065459+0000","last_became_peered":"2023-11-17T06:29:40.065459+0000","last_unstale":"2023-11-17T06:29:41.189999+0000","last_undegraded":"2023-11-17T06:29:41.189999+0000","last_fullsized":"2023-11-17T06:29:41.189999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189626+0000","last_change":"2023-11-17T06:29:39.014916+0000","last_active":"2023-11-17T06:29:41.189626+0000","last_peered":"2023-11-17T06:29:41.189626+0000","last_clean":"2023-11-17T06:29:41.189626+0000","last_became_active":"2023-11-17T06:29:39.014625+0000","last_became_peered":"2023-11-17T06:29:39.014625+0000","last_unstale":"2023-11-17T06:29:41.189626+0000","last_undegraded":"2023-11-17T06:29:41.189626+0000","last_fullsized":"2023-11-17T06:29:41.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189444+0000","last_change":"2023-11-17T06:29:40.054935+0000","last_active":"2023-11-17T06:29:41.189444+0000","last_peered":"2023-11-17T06:29:41.189444+0000","last_clean":"2023-11-17T06:29:41.189444+0000","last_became_active":"2023-11-17T06:29:40.054651+0000","last_became_peered":"2023-11-17T06:29:40.054651+0000","last_unstale":"2023-11-17T06:29:41.189444+0000","last_undegraded":"2023-11-17T06:29:41.189444+0000","last_fullsized":"2023-11-17T06:29:41.189444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189996+0000","last_change":"2023-11-17T06:29:39.020080+0000","last_active":"2023-11-17T06:29:41.189996+0000","last_peered":"2023-11-17T06:29:41.189996+0000","last_clean":"2023-11-17T06:29:41.189996+0000","last_became_active":"2023-11-17T06:29:39.018857+0000","last_became_peered":"2023-11-17T06:29:39.018857+0000","last_unstale":"2023-11-17T06:29:41.189996+0000","last_undegraded":"2023-11-17T06:29:41.189996+0000","last_fullsized":"2023-11-17T06:29:41.189996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":80752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":80626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:29:44.810 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-17T06:29:44.810 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-17T06:29:44.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-17T06:29:44.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-17T06:29:44.811 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-17T06:29:45.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 Processor -- start 2023-11-17T06:29:45.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 -- start start 2023-11-17T06:29:45.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd4800b1150 0x7fd4800cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd4800cf8a0 0x7fd48015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480070ad0 con 0x7fd48015b0a0 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd480071f20 con 0x7fd4800cf8a0 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd48673c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800721a0 con 0x7fd4800b1150 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd47ffff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd48015b0a0 0x7fd4800b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54380/0 (socket says 172.21.15.100:54380) 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd47ffff700 1 -- 172.21.15.100:0/2358727737 learned_addr learned my addr 172.21.15.100:0/2358727737 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd484cd9700 1 --2- 172.21.15.100:0/2358727737 >> v2:172.21.15.100:3300/0 conn(0x7fd4800cf8a0 0x7fd48015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd47f7fe700 1 --2- 172.21.15.100:0/2358727737 >> v2:172.21.15.119:3300/0 conn(0x7fd4800b1150 0x7fd4800cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd484cd9700 1 -- 172.21.15.100:0/2358727737 >> v2:172.21.15.119:3300/0 conn(0x7fd4800b1150 msgr2=0x7fd4800cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd484cd9700 1 --2- 172.21.15.100:0/2358727737 >> v2:172.21.15.119:3300/0 conn(0x7fd4800b1150 0x7fd4800cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd484cd9700 1 -- 172.21.15.100:0/2358727737 >> v1:172.21.15.100:6789/0 conn(0x7fd48015b0a0 legacy=0x7fd4800b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd47effd700 1 -- 172.21.15.100:0/2358727737 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165820254 0 0) 0x7fd480070ad0 con 0x7fd48015b0a0 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.032+0000 7fd484cd9700 1 -- 172.21.15.100:0/2358727737 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480072480 con 0x7fd4800cf8a0 2023-11-17T06:29:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd484cd9700 1 --2- 172.21.15.100:0/2358727737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800cf8a0 0x7fd48015ed30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4800b5090 tx=0x7fd478009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97855c898ae98336 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd47effd700 1 -- 172.21.15.100:0/2358727737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478011830 con 0x7fd4800cf8a0 2023-11-17T06:29:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd47effd700 1 -- 172.21.15.100:0/2358727737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd478011990 con 0x7fd4800cf8a0 2023-11-17T06:29:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd47effd700 1 -- 172.21.15.100:0/2358727737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478011d20 con 0x7fd4800cf8a0 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 -- 172.21.15.100:0/2358727737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800cf8a0 msgr2=0x7fd48015ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 --2- 172.21.15.100:0/2358727737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800cf8a0 0x7fd48015ed30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4800b5090 tx=0x7fd478009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 -- 172.21.15.100:0/2358727737 shutdown_connections 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 --2- 172.21.15.100:0/2358727737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800cf8a0 0x7fd48015ed30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 --2- 172.21.15.100:0/2358727737 >> v2:172.21.15.119:3300/0 conn(0x7fd4800b1150 0x7fd4800cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 -- 172.21.15.100:0/2358727737 >> 172.21.15.100:0/2358727737 conn(0x7fd48006a270 msgr2=0x7fd48006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 -- 172.21.15.100:0/2358727737 shutdown_connections 2023-11-17T06:29:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.036+0000 7fd48673c700 1 -- 172.21.15.100:0/2358727737 wait complete. 2023-11-17T06:29:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 Processor -- start 2023-11-17T06:29:45.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 -- start start 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 0x7fd4800c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd48015b0a0 0x7fd4800c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c5a90 con 0x7fd4800b1150 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c49f0 con 0x7fd4800cf8a0 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd48673c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c4cd0 con 0x7fd48015b0a0 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47318/0 (socket says 172.21.15.100:47318) 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 -- 172.21.15.100:0/2523370507 learned_addr learned my addr 172.21.15.100:0/2523370507 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47f7fe700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 0x7fd4800c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd484cd9700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd48015b0a0 0x7fd4800c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 -- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd48015b0a0 msgr2=0x7fd4800c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd48015b0a0 0x7fd4800c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 -- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 msgr2=0x7fd4800c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 0x7fd4800c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47ffff700 1 -- 172.21.15.100:0/2523370507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780094b0 con 0x7fd4800b1150 2023-11-17T06:29:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.040+0000 7fd47f7fe700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 0x7fd4800c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd47ffff700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c4e0 tx=0x7fd47000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470004ca0 con 0x7fd4800b1150 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470004e20 con 0x7fd4800b1150 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470007310 con 0x7fd4800b1150 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800c4fb0 con 0x7fd4800b1150 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4800c5570 con 0x7fd4800b1150 2023-11-17T06:29:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.044+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48004eea0 con 0x7fd4800b1150 2023-11-17T06:29:45.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.048+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd470007470 con 0x7fd4800b1150 2023-11-17T06:29:45.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.048+0000 7fd47cff9700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 0x7fd46c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.048+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd470083bc0 con 0x7fd4800b1150 2023-11-17T06:29:45.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.048+0000 7fd47f7fe700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 0x7fd46c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.048+0000 7fd47f7fe700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 0x7fd46c068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd48015a0c0 tx=0x7fd47400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.056+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd470050f10 con 0x7fd4800b1150 2023-11-17T06:29:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.268+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd4800cc240 con 0x7fd4800b1150 2023-11-17T06:29:45.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.276+0000 7fd47cff9700 1 -- 172.21.15.100:0/2523370507 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164436 (secure 0 0 0) 0x7fd470007720 con 0x7fd4800b1150 2023-11-17T06:29:45.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.280+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 msgr2=0x7fd46c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.280+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 0x7fd46c068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd48015a0c0 tx=0x7fd47400b040 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.280+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 msgr2=0x7fd480152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.280+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c4e0 tx=0x7fd47000c7f0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 shutdown_connections 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd48015b0a0 0x7fd4800c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4800cf8a0 0x7fd4800c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd46c066540 0x7fd46c068a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 --2- 172.21.15.100:0/2523370507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4800b1150 0x7fd480152fb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 >> 172.21.15.100:0/2523370507 conn(0x7fd48006a270 msgr2=0x7fd48006ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:45.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 shutdown_connections 2023-11-17T06:29:45.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.284+0000 7fd48673c700 1 -- 172.21.15.100:0/2523370507 wait complete. 2023-11-17T06:29:45.310 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2885095167},{"type":"v1","addr":"172.21.15.100:6833","nonce":2885095167}]},"active_addr":"172.21.15.100:6833/2885095167","active_change":"2023-11-17T06:28:35.227668+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1211245302}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1764748186}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3670643377}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":542619828}]}]} 2023-11-17T06:29:45.313 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-17T06:29:45.313 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-17T06:29:45.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.484+0000 7fdbc0543700 1 Processor -- start 2023-11-17T06:29:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.484+0000 7fdbc0543700 1 -- start start 2023-11-17T06:29:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbc0543700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb80ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbc0543700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdbb80cc580 0x7fdbb80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbc0543700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb8161000 con 0x7fdbb80cd420 2023-11-17T06:29:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbc0543700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80cf180 con 0x7fdbb80cc580 2023-11-17T06:29:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbc0543700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80cd800 con 0x7fdbb80b1150 2023-11-17T06:29:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdbb80cc580 0x7fdbb80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdbb80cc580 0x7fdbb80cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47332/0 (socket says 172.21.15.100:47332) 2023-11-17T06:29:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 -- 172.21.15.100:0/939066114 learned_addr learned my addr 172.21.15.100:0/939066114 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbe2df700 1 --1- 172.21.15.100:0/939066114 >> v1:172.21.15.100:6789/0 conn(0x7fdbb80cd420 0x7fdbb80b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54386/0 (socket says 172.21.15.100:54386) 2023-11-17T06:29:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbdade700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb80ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 -- 172.21.15.100:0/939066114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 msgr2=0x7fdbb80ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb80ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 -- 172.21.15.100:0/939066114 >> v1:172.21.15.100:6789/0 conn(0x7fdbb80cd420 legacy=0x7fdbb80b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 -- 172.21.15.100:0/939066114 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8157f00 con 0x7fdbb80cc580 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbeae0700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80cec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009e50 tx=0x7fdbb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfcea7e8d1b8792 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbd2dd700 1 -- 172.21.15.100:0/939066114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000e070 con 0x7fdbb80cc580 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbd2dd700 1 -- 172.21.15.100:0/939066114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000b910 con 0x7fdbb80cc580 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.488+0000 7fdbbd2dd700 1 -- 172.21.15.100:0/939066114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000bcc0 con 0x7fdbb80cc580 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- 172.21.15.100:0/939066114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 msgr2=0x7fdbb80cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80cec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009e50 tx=0x7fdbb000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- 172.21.15.100:0/939066114 shutdown_connections 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80cec40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 --2- 172.21.15.100:0/939066114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb80ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- 172.21.15.100:0/939066114 >> 172.21.15.100:0/939066114 conn(0x7fdbb806a270 msgr2=0x7fdbb806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- 172.21.15.100:0/939066114 shutdown_connections 2023-11-17T06:29:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- 172.21.15.100:0/939066114 wait complete. 2023-11-17T06:29:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 Processor -- start 2023-11-17T06:29:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.492+0000 7fdbc0543700 1 -- start start 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 0x7fdbb80c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb815a440 con 0x7fdbb80cc580 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8159060 con 0x7fdbb80cd420 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb815a860 con 0x7fdbb80b1150 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47346/0 (socket says 172.21.15.100:47346) 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 -- 172.21.15.100:0/113673392 learned_addr learned my addr 172.21.15.100:0/113673392 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbe2df700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbeae0700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 0x7fdbb80c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 -- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 msgr2=0x7fdbb815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 -- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 msgr2=0x7fdbb80c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 0x7fdbb80c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 -- 172.21.15.100:0/113673392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0009b30 con 0x7fdbb80cc580 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbeae0700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 0x7fdbb80c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbbdade700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e9a0 tx=0x7fdba800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8009720 con 0x7fdbb80cc580 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba800c850 con 0x7fdbb80cc580 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb8159aa0 con 0x7fdbb80cc580 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800cbe0 con 0x7fdbb80cc580 2023-11-17T06:29:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.496+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb815a060 con 0x7fdbb80cc580 2023-11-17T06:29:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.500+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb815a580 con 0x7fdbb80cc580 2023-11-17T06:29:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.500+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdba800cd40 con 0x7fdbb80cc580 2023-11-17T06:29:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.504+0000 7fdbaeffd700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 0x7fdb9c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.504+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdba8084010 con 0x7fdbb80cc580 2023-11-17T06:29:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.504+0000 7fdbbe2df700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 0x7fdb9c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.504+0000 7fdbbe2df700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 0x7fdb9c0689d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000f60 tx=0x7fdbb4007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.508+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbb815a580 con 0x7fdbb80cc580 2023-11-17T06:29:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.684+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbb815a580 con 0x7fdbb80cc580 2023-11-17T06:29:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbaeffd700 1 -- 172.21.15.100:0/113673392 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fdbb815a580 con 0x7fdbb80cc580 2023-11-17T06:29:45.691 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:45.691 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 msgr2=0x7fdb9c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 0x7fdb9c0689d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000f60 tx=0x7fdbb4007d30 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 msgr2=0x7fdbb80c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e9a0 tx=0x7fdba800ed60 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 shutdown_connections 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbb80cd420 0x7fdbb80c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb9c066510 0x7fdb9c0689d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbb80cc580 0x7fdbb80c3d30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 --2- 172.21.15.100:0/113673392 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbb80b1150 0x7fdbb815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 >> 172.21.15.100:0/113673392 conn(0x7fdbb806a270 msgr2=0x7fdbb806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 shutdown_connections 2023-11-17T06:29:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.688+0000 7fdbc0543700 1 -- 172.21.15.100:0/113673392 wait complete. 2023-11-17T06:29:45.715 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-17T06:29:45.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:45.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.892+0000 7f7d02d3c700 1 Processor -- start 2023-11-17T06:29:45.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.892+0000 7f7d02d3c700 1 -- start start 2023-11-17T06:29:45.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d02d3c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cfc0b2370 0x7f7cfc0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d02d3c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cfc0b8850 0x7f7cfc0d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d02d3c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc0b65a0 con 0x7f7cfc0cf9e0 2023-11-17T06:29:45.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d02d3c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b9010 con 0x7f7cfc0b8850 2023-11-17T06:29:45.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d02d3c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc15d610 con 0x7f7cfc0b2370 2023-11-17T06:29:45.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d01d3a700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7cfc0cf9e0 0x7f7cfc0cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54400/0 (socket says 172.21.15.100:54400) 2023-11-17T06:29:45.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d01d3a700 1 -- 172.21.15.100:0/3295655717 learned_addr learned my addr 172.21.15.100:0/3295655717 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:45.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 --2- 172.21.15.100:0/3295655717 >> v2:172.21.15.100:3300/0 conn(0x7f7cfc0b8850 0x7f7cfc0d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d01539700 1 --2- 172.21.15.100:0/3295655717 >> v2:172.21.15.119:3300/0 conn(0x7f7cfc0b2370 0x7f7cfc0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d00d38700 1 -- 172.21.15.100:0/3295655717 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672957414 0 0) 0x7f7cfc0b65a0 con 0x7f7cfc0cf9e0 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d00d38700 1 -- 172.21.15.100:0/3295655717 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80035d0 con 0x7f7cfc0cf9e0 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 -- 172.21.15.100:0/3295655717 >> v2:172.21.15.119:3300/0 conn(0x7f7cfc0b2370 msgr2=0x7f7cfc0b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 --2- 172.21.15.100:0/3295655717 >> v2:172.21.15.119:3300/0 conn(0x7f7cfc0b2370 0x7f7cfc0b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 -- 172.21.15.100:0/3295655717 >> v1:172.21.15.100:6789/0 conn(0x7f7cfc0cf9e0 legacy=0x7f7cfc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 -- 172.21.15.100:0/3295655717 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0b8d30 con 0x7f7cfc0b8850 2023-11-17T06:29:45.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d0253b700 1 --2- 172.21.15.100:0/3295655717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc0d1fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0d3f60 tx=0x7f7cf4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef553d0d4ce55609 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d00d38700 1 -- 172.21.15.100:0/3295655717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011830 con 0x7f7cfc0b8850 2023-11-17T06:29:45.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d00d38700 1 -- 172.21.15.100:0/3295655717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4011990 con 0x7f7cfc0b8850 2023-11-17T06:29:45.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.896+0000 7f7d00d38700 1 -- 172.21.15.100:0/3295655717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011d20 con 0x7f7cfc0b8850 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- 172.21.15.100:0/3295655717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 msgr2=0x7f7cfc0d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/3295655717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc0d1fb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0d3f60 tx=0x7f7cf4009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- 172.21.15.100:0/3295655717 shutdown_connections 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/3295655717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc0d1fb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/3295655717 >> v2:172.21.15.119:3300/0 conn(0x7f7cfc0b2370 0x7f7cfc0b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- 172.21.15.100:0/3295655717 >> 172.21.15.100:0/3295655717 conn(0x7f7cfc0d2fd0 msgr2=0x7f7cfc0d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:45.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- 172.21.15.100:0/3295655717 shutdown_connections 2023-11-17T06:29:45.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- 172.21.15.100:0/3295655717 wait complete. 2023-11-17T06:29:45.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 Processor -- start 2023-11-17T06:29:45.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.900+0000 7f7d02d3c700 1 -- start start 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cfc0b2370 0x7f7cfc0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cfc0cf9e0 0x7f7cfc0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b3cd0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0cd050 con 0x7f7cfc0b2370 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b30c0 con 0x7f7cfc0cf9e0 2023-11-17T06:29:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47370/0 (socket says 172.21.15.100:47370) 2023-11-17T06:29:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 -- 172.21.15.100:0/2859664444 learned_addr learned my addr 172.21.15.100:0/2859664444 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01d3a700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cfc0b2370 0x7f7cfc0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d0253b700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cfc0cf9e0 0x7f7cfc0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 -- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cfc0cf9e0 msgr2=0x7f7cfc0b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cfc0cf9e0 0x7f7cfc0b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 -- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cfc0b2370 msgr2=0x7f7cfc0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cfc0b2370 0x7f7cfc0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 -- 172.21.15.100:0/2859664444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40094b0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d01539700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e840 tx=0x7f7cec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0095a0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00c690 con 0x7f7cfc0b8850 2023-11-17T06:29:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc0b33a0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00ca00 con 0x7f7cfc0b8850 2023-11-17T06:29:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.904+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc0b3960 con 0x7f7cfc0b8850 2023-11-17T06:29:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.908+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc066ad0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.908+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7cec00cb60 con 0x7f7cfc0b8850 2023-11-17T06:29:45.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.908+0000 7f7cf27fc700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 0x7f7ce00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:45.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.908+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cec083ef0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.908+0000 7f7d01d3a700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 0x7f7ce00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.912+0000 7f7d01d3a700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 0x7f7ce00689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8001560 tx=0x7f7cf8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:45.916+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7cec0512d0 con 0x7f7cfc0b8850 2023-11-17T06:29:45.978 INFO:tasks.ceph.mds.b.smithi119.stderr:2023-11-17T06:29:45.976+0000 7fe434e85700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:29:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.092+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cfc065e90 con 0x7f7cfc0b8850 2023-11-17T06:29:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7cf27fc700 1 -- 172.21.15.100:0/2859664444 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f7cec0548f0 con 0x7f7cfc0b8850 2023-11-17T06:29:46.099 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:46.099 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 msgr2=0x7f7ce00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 0x7f7ce00689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8001560 tx=0x7f7cf8009040 comp rx=0 tx=0).stop 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 msgr2=0x7f7cfc156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e840 tx=0x7f7cec00ec00 comp rx=0 tx=0).stop 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 shutdown_connections 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cfc0cf9e0 0x7f7cfc0b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066510 0x7f7ce00689d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cfc0b8850 0x7f7cfc156ed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 --2- 172.21.15.100:0/2859664444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cfc0b2370 0x7f7cfc0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 >> 172.21.15.100:0/2859664444 conn(0x7f7cfc0d2fd0 msgr2=0x7f7cfc15c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 shutdown_connections 2023-11-17T06:29:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.096+0000 7f7d02d3c700 1 -- 172.21.15.100:0/2859664444 wait complete. 2023-11-17T06:29:46.125 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-17T06:29:46.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-17T06:29:46.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-17T06:29:46.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-17T06:29:46.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-17T06:29:46.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-17T06:29:46.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-17T06:29:46.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-17T06:29:46.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 Processor -- start 2023-11-17T06:29:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 -- start start 2023-11-17T06:29:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 0x7f3e680cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 0x7f3e680cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e680ce300 con 0x7f3e68161a50 2023-11-17T06:29:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e680cb790 con 0x7f3e680b1150 2023-11-17T06:29:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.356+0000 7f3e7003c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680cdb30 con 0x7f3e68161670 2023-11-17T06:29:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6e5d9700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 0x7f3e680cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6e5d9700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 0x7f3e680cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33872/0 (socket says 172.21.15.100:33872) 2023-11-17T06:29:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6e5d9700 1 -- 172.21.15.100:0/1119736295 learned_addr learned my addr 172.21.15.100:0/1119736295 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 --2- 172.21.15.100:0/1119736295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 0x7f3e680cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7fbeeffff700 1 Processor -- start 2023-11-17T06:29:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 -- 172.21.15.100:0/1119736295 >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 msgr2=0x7f3e680cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 --2- 172.21.15.100:0/1119736295 >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 0x7f3e680cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 -- 172.21.15.100:0/1119736295 >> v1:172.21.15.119:6789/0 conn(0x7f3e68161a50 legacy=0x7f3e680b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 -- 172.21.15.100:0/1119736295 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680ce500 con 0x7f3e68161670 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6ddd8700 1 --2- 172.21.15.100:0/1119736295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 0x7f3e680cd500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009d90 tx=0x7f3e5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bdac4a0bfe5774 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6cdd6700 1 -- 172.21.15.100:0/1119736295 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00e070 con 0x7f3e68161670 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6cdd6700 1 -- 172.21.15.100:0/1119736295 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00bb20 con 0x7f3e68161670 2023-11-17T06:29:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7fbeeffff700 1 -- start start 2023-11-17T06:29:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e6cdd6700 1 -- 172.21.15.100:0/1119736295 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00e070 con 0x7f3e68161670 2023-11-17T06:29:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f7ae2d2e700 1 Processor -- start 2023-11-17T06:29:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f3e7003c700 1 -- 172.21.15.100:0/1119736295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 msgr2=0x7f3e680cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7f7ae2d2e700 1 -- start start 2023-11-17T06:29:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7fbeeffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbef01592a0 0x7fbef00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.360+0000 7fbeeffff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbef006bb60 0x7fbef00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeeffff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00c9d10 con 0x7fbef01592a0 2023-11-17T06:29:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeeffff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00c43c0 con 0x7fbef006bb60 2023-11-17T06:29:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeeffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c40c0 con 0x7fbef00cb240 2023-11-17T06:29:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 --2- 172.21.15.100:0/1119736295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 0x7f3e680cd500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009d90 tx=0x7f3e5c00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeee7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbef006bb60 0x7fbef00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbef006bb60 0x7fbef00ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33876/0 (socket says 172.21.15.100:33876) 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 -- 172.21.15.100:0/2420484695 learned_addr learned my addr 172.21.15.100:0/2420484695 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 -- 172.21.15.100:0/1119736295 shutdown_connections 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 --2- 172.21.15.100:0/1119736295 >> v2:172.21.15.119:3300/0 conn(0x7f3e680b1150 0x7f3e680cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 --2- 172.21.15.100:0/1119736295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e68161670 0x7f3e680cd500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 -- 172.21.15.100:0/1119736295 >> 172.21.15.100:0/1119736295 conn(0x7f3e6806a270 msgr2=0x7f3e6806a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 Processor -- start 2023-11-17T06:29:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 -- start start 2023-11-17T06:29:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fded975b700 1 Processor -- start 2023-11-17T06:29:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 -- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 msgr2=0x7fbef00cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 -- 172.21.15.100:0/2420484695 >> v2:172.21.15.100:3300/0 conn(0x7fbef01592a0 msgr2=0x7fbef00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/2420484695 >> v2:172.21.15.100:3300/0 conn(0x7fbef01592a0 0x7fbef00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fded975b700 1 -- start start 2023-11-17T06:29:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 -- 172.21.15.100:0/1119736295 shutdown_connections 2023-11-17T06:29:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae2d2e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7adc159310 0x7f7adc0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f3e7003c700 1 -- 172.21.15.100:0/1119736295 wait complete. 2023-11-17T06:29:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae2d2e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7adc0c5460 0x7f7adc06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae1d2c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7adc159310 0x7f7adc0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fb02bfff700 1 Processor -- start 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fb02bfff700 1 -- start start 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 0x7f22e00cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e01660d0 con 0x7f22e00b5e20 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e00d2e30 con 0x7f22e0161630 2023-11-17T06:29:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f22e56c2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00d1f60 con 0x7f22e00d1780 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae1d2c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7adc159310 0x7f7adc0c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33886/0 (socket says 172.21.15.100:33886) 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae1d2c700 1 -- 172.21.15.100:0/1592439731 learned_addr learned my addr 172.21.15.100:0/1592439731 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae2d2e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc06c4c0 con 0x7f7adc0c5910 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc06c7a0 con 0x7f7adc0c5460 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc06ca80 con 0x7f7adc159310 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7f7ae152b700 1 --2- 172.21.15.100:0/1592439731 >> v2:172.21.15.100:3300/0 conn(0x7f7adc0c5460 0x7f7adc06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.364+0000 7fded975b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fded40cdbe0 0x7fded415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22dffff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f22e0161630 0x7f22e00d2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43766/0 (socket says 172.21.15.100:43766) 2023-11-17T06:29:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22dffff700 1 -- 172.21.15.100:0/2148918412 learned_addr learned my addr 172.21.15.100:0/2148918412 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded975b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fded40b1150 0x7fded4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/2148918412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 0x7f22e00cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb02c0717b0 0x7fb02c169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02bfff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c070ee0 con 0x7fb02c16e570 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02bfff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0705b0 con 0x7fb02c0717b0 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02bfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c070890 con 0x7fb02c0b2280 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22deffd700 1 -- 172.21.15.100:0/2148918412 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400862115 0 0) 0x7f22d8001110 con 0x7f22e0161630 2023-11-17T06:29:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22deffd700 1 -- 172.21.15.100:0/2148918412 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22cc0035d0 con 0x7f22e0161630 2023-11-17T06:29:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeef7fe700 1 -- 172.21.15.100:0/2420484695 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00c9f60 con 0x7fbef006bb60 2023-11-17T06:29:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae1d2c700 1 -- 172.21.15.100:0/1592439731 >> v2:172.21.15.100:3300/0 conn(0x7f7adc0c5460 msgr2=0x7f7adc06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae1d2c700 1 --2- 172.21.15.100:0/1592439731 >> v2:172.21.15.100:3300/0 conn(0x7f7adc0c5460 0x7f7adc06a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae1d2c700 1 -- 172.21.15.100:0/1592439731 >> v1:172.21.15.100:6789/0 conn(0x7f7adc0c5910 legacy=0x7f7adc15d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae1d2c700 1 -- 172.21.15.100:0/1592439731 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc06cd60 con 0x7f7adc159310 2023-11-17T06:29:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded975b700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40cb630 con 0x7fded40cdfc0 2023-11-17T06:29:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded975b700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40cb8b0 con 0x7fded40cdbe0 2023-11-17T06:29:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded975b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40cbb90 con 0x7fded40b1150 2023-11-17T06:29:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e7003c700 1 Processor -- start 2023-11-17T06:29:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e7003c700 1 -- start start 2023-11-17T06:29:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22e4ec1700 1 -- 172.21.15.100:0/2148918412 >> v1:172.21.15.119:6789/0 conn(0x7f22e0161630 legacy=0x7f22e00d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22e4ec1700 1 -- 172.21.15.100:0/2148918412 >> v1:172.21.15.100:6789/0 conn(0x7f22e00b5e20 legacy=0x7f22e00d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fded40b1150 0x7fded4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef00ccdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbef00caaa0 tx=0x7fbee4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333b9ade4f7b57ab server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fded40b1150 0x7fded4070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33902/0 (socket says 172.21.15.100:33902) 2023-11-17T06:29:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 -- 172.21.15.100:0/2132637938 learned_addr learned my addr 172.21.15.100:0/2132637938 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02affd700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb02c16e570 0x7fb02c0b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43770/0 (socket says 172.21.15.100:43770) 2023-11-17T06:29:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02affd700 1 -- 172.21.15.100:0/359878556 learned_addr learned my addr 172.21.15.100:0/359878556 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f22e4ec1700 1 -- 172.21.15.100:0/2148918412 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0161a10 con 0x7f22e00d1780 2023-11-17T06:29:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 --2- 172.21.15.100:0/359878556 >> v2:172.21.15.119:3300/0 conn(0x7fb02c0717b0 0x7fb02c169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae1d2c700 1 --2- 172.21.15.100:0/1592439731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc159310 0x7f7adc0c9440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0b4ea0 tx=0x7f7ad800ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb5cda75cca4a78d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeedffb700 1 -- 172.21.15.100:0/2420484695 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4011830 con 0x7fbef006bb60 2023-11-17T06:29:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeedffb700 1 -- 172.21.15.100:0/2420484695 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4011990 con 0x7fbef006bb60 2023-11-17T06:29:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeedffb700 1 -- 172.21.15.100:0/2420484695 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4011d20 con 0x7fbef006bb60 2023-11-17T06:29:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae0d2a700 1 -- 172.21.15.100:0/1592439731 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8008df0 con 0x7f7adc159310 2023-11-17T06:29:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 -- 172.21.15.100:0/2132637938 >> v2:172.21.15.100:3300/0 conn(0x7fded40cdbe0 msgr2=0x7fded415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 --2- 172.21.15.100:0/2132637938 >> v2:172.21.15.100:3300/0 conn(0x7fded40cdbe0 0x7fded415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 -- 172.21.15.100:0/2132637938 >> v1:172.21.15.100:6789/0 conn(0x7fded40cdfc0 legacy=0x7fded40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae0d2a700 1 -- 172.21.15.100:0/1592439731 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad800a0d0 con 0x7f7adc159310 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae0d2a700 1 -- 172.21.15.100:0/1592439731 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800a480 con 0x7f7adc159310 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 -- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 msgr2=0x7fb02c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 --2- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 -- 172.21.15.100:0/359878556 >> v1:172.21.15.119:6789/0 conn(0x7fb02c16e570 legacy=0x7fb02c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 -- 172.21.15.100:0/359878556 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c070b70 con 0x7fb02c0717b0 2023-11-17T06:29:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e7003c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e680b1150 0x7f3e68152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e7003c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e68161670 0x7f3e68153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fded37fe700 1 -- 172.21.15.100:0/2132637938 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40cbe70 con 0x7fded40b1150 2023-11-17T06:29:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e7003c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68161a50 0x7f3e680b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fb02b7fe700 1 --2- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c0717b0 0x7fb02c169dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e44af9965b8bcc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 -- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 msgr2=0x7fbef00ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 --2- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef00ccdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbef00caaa0 tx=0x7fbee4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 -- 172.21.15.100:0/2420484695 shutdown_connections 2023-11-17T06:29:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 --2- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef00ccdc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e6d5d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e68161670 0x7f3e68153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 --2- 172.21.15.100:0/2420484695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 --2- 172.21.15.100:0/2420484695 >> v2:172.21.15.100:3300/0 conn(0x7fbef01592a0 0x7fbef00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7fbeeffff700 1 -- 172.21.15.100:0/2420484695 >> 172.21.15.100:0/2420484695 conn(0x7fbef00cecb0 msgr2=0x7fbef00cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f3e6d5d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e68161670 0x7f3e68153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47388/0 (socket says 172.21.15.100:47388) 2023-11-17T06:29:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6ddd8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e680b1150 0x7f3e68152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6ddd8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e680b1150 0x7f3e68152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:45966/0 (socket says 172.21.15.100:45966) 2023-11-17T06:29:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fbeeffff700 1 -- 172.21.15.100:0/2420484695 shutdown_connections 2023-11-17T06:29:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6d5d7700 1 -- 172.21.15.100:0/3104696857 learned_addr learned my addr 172.21.15.100:0/3104696857 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681483e0 con 0x7f3e68161670 2023-11-17T06:29:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68147340 con 0x7f3e68161a50 2023-11-17T06:29:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68161a50 0x7f3e680b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68147620 con 0x7f3e680b1150 2023-11-17T06:29:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/2148918412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 0x7f22e00cf770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009dc0 tx=0x7f22d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=213c433d71d44c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fbeeffff700 1 -- 172.21.15.100:0/2420484695 wait complete. 2023-11-17T06:29:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc159310 msgr2=0x7f7adc0c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.368+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/1592439731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc159310 0x7f7adc0c9440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0b4ea0 tx=0x7f7ad800ac80 comp rx=0 tx=0).stop 2023-11-17T06:29:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded37fe700 1 --2- 172.21.15.100:0/2132637938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40b1150 0x7fded4070df0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fded4072390 tx=0x7fdecc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d673cfd340d6788 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 shutdown_connections 2023-11-17T06:29:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/1592439731 >> v2:172.21.15.100:3300/0 conn(0x7f7adc0c5460 0x7f7adc06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/1592439731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc159310 0x7f7adc0c9440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22deffd700 1 -- 172.21.15.100:0/2148918412 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000e070 con 0x7f22e00d1780 2023-11-17T06:29:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 >> 172.21.15.100:0/1592439731 conn(0x7f7adc0cecb0 msgr2=0x7f7adc0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22deffd700 1 -- 172.21.15.100:0/2148918412 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d000bb20 con 0x7f22e00d1780 2023-11-17T06:29:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22deffd700 1 -- 172.21.15.100:0/2148918412 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000be90 con 0x7f22e00d1780 2023-11-17T06:29:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded1ffb700 1 -- 172.21.15.100:0/2132637938 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00e070 con 0x7fded40b1150 2023-11-17T06:29:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded1ffb700 1 -- 172.21.15.100:0/2132637938 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc003a40 con 0x7fded40b1150 2023-11-17T06:29:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded1ffb700 1 -- 172.21.15.100:0/2132637938 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc003dd0 con 0x7fded40b1150 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 shutdown_connections 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/1592439731 wait complete. 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 -- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e680b1150 msgr2=0x7f3e68152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e680b1150 0x7f3e68152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 -- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e68161670 msgr2=0x7f3e68153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb029ffb700 1 -- 172.21.15.100:0/359878556 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400e070 con 0x7fb02c0717b0 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb029ffb700 1 -- 172.21.15.100:0/359878556 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024003a40 con 0x7fb02c0717b0 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb029ffb700 1 -- 172.21.15.100:0/359878556 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024003df0 con 0x7fb02c0717b0 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e68161670 0x7f3e68153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c009a70 con 0x7f3e68161a50 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 -- 172.21.15.100:0/2132637938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40b1150 msgr2=0x7fded4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 --2- 172.21.15.100:0/2132637938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40b1150 0x7fded4070df0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fded4072390 tx=0x7fdecc00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 -- 172.21.15.100:0/2148918412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 msgr2=0x7f22e00cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 --2- 172.21.15.100:0/2148918412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 0x7f22e00cf770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009dc0 tx=0x7f22d000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 -- 172.21.15.100:0/2148918412 shutdown_connections 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 --2- 172.21.15.100:0/2148918412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e00d1780 0x7f22e00cf770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 -- 172.21.15.100:0/2148918412 >> 172.21.15.100:0/2148918412 conn(0x7f22e00d2fd0 msgr2=0x7f22e00d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e6e5d9700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68161a50 0x7f3e680b3810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e680cda60 tx=0x7f3e6000eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 -- 172.21.15.100:0/2132637938 shutdown_connections 2023-11-17T06:29:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 --2- 172.21.15.100:0/2132637938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40b1150 0x7fded4070df0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 -- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c0717b0 msgr2=0x7fb02c169dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 --2- 172.21.15.100:0/2132637938 >> v2:172.21.15.100:3300/0 conn(0x7fded40cdbe0 0x7fded415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 -- 172.21.15.100:0/2132637938 >> 172.21.15.100:0/2132637938 conn(0x7fded406a270 msgr2=0x7fded406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60013680 con 0x7f3e68161a50 2023-11-17T06:29:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 --2- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c0717b0 0x7fb02c169dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02400b330 comp rx=0 tx=0).stop 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e600137e0 con 0x7f3e68161a50 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 -- 172.21.15.100:0/359878556 shutdown_connections 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 --2- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c0717b0 0x7fb02c169dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 --2- 172.21.15.100:0/359878556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 -- 172.21.15.100:0/359878556 >> 172.21.15.100:0/359878556 conn(0x7fb02c06e6a0 msgr2=0x7fb02c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 -- 172.21.15.100:0/2148918412 shutdown_connections 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f22e56c2700 1 -- 172.21.15.100:0/2148918412 wait complete. 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e68147900 con 0x7f3e68161a50 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e68147ec0 con 0x7f3e68161a50 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 -- 172.21.15.100:0/359878556 shutdown_connections 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fb02bfff700 1 -- 172.21.15.100:0/359878556 wait complete. 2023-11-17T06:29:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fbeeffff700 1 Processor -- start 2023-11-17T06:29:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7f7ae2d2e700 1 Processor -- start 2023-11-17T06:29:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 -- 172.21.15.100:0/2132637938 shutdown_connections 2023-11-17T06:29:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.372+0000 7fded975b700 1 -- 172.21.15.100:0/2132637938 wait complete. 2023-11-17T06:29:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 -- start start 2023-11-17T06:29:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 -- start start 2023-11-17T06:29:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60013b50 con 0x7f3e68161a50 2023-11-17T06:29:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e680c98f0 con 0x7f3e68161a50 2023-11-17T06:29:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fb02bfff700 1 Processor -- start 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f22e56c2700 1 Processor -- start 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01592a0 0x7fbef0070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef0156300 con 0x7fbef01592a0 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01f4e30 con 0x7fbef006bb60 2023-11-17T06:29:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01556f0 con 0x7fbef00cb240 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7adc0c5460 0x7f7adc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 0x7f7adc1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7adc159310 0x7f7adc159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc15c600 con 0x7f7adc159310 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc1556d0 con 0x7f7adc0c5910 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae2d2e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc1559b0 con 0x7f7adc0c5460 2023-11-17T06:29:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fb02bfff700 1 -- start start 2023-11-17T06:29:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f22e56c2700 1 -- start start 2023-11-17T06:29:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae252d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7adc159310 0x7f7adc159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fded975b700 1 Processor -- start 2023-11-17T06:29:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fded975b700 1 -- start start 2023-11-17T06:29:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeeffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeeffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33932/0 (socket says 172.21.15.100:33932) 2023-11-17T06:29:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeeeffd700 1 -- 172.21.15.100:0/3364689765 learned_addr learned my addr 172.21.15.100:0/3364689765 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae152b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 0x7f7adc1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fea6d00f700 1 Processor -- start 2023-11-17T06:29:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae1d2c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7adc0c5460 0x7f7adc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeee7fc700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fea6d00f700 1 -- start start 2023-11-17T06:29:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae152b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 0x7f7adc1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33934/0 (socket says 172.21.15.100:33934) 2023-11-17T06:29:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae152b700 1 -- 172.21.15.100:0/3761556146 learned_addr learned my addr 172.21.15.100:0/3761556146 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7f7ae252d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7adc159310 0x7f7adc159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47398/0 (socket says 172.21.15.100:47398) 2023-11-17T06:29:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.376+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01592a0 0x7fbef0070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb02c0717b0 0x7fb02c089880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e00b5e20 0x7f22e00cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e00d1780 0x7f22e00ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e0161630 0x7f22e00cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c1593a0 0x7fb02c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e00b5e20 0x7f22e00cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0152f40 con 0x7f22e00d1780 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00b6340 con 0x7f22e00b5e20 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e00b5e20 0x7f22e00cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33948/0 (socket says 172.21.15.100:33948) 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dffff700 1 -- 172.21.15.100:0/1725037525 learned_addr learned my addr 172.21.15.100:0/1725037525 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cc640 con 0x7f22e0161630 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 -- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 msgr2=0x7fbef014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef006bb60 0x7fbef014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 -- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01592a0 msgr2=0x7fbef0070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01592a0 0x7fbef0070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4009570 con 0x7fbef00cb240 2023-11-17T06:29:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0a8ec0 con 0x7fb02c0717b0 2023-11-17T06:29:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0a9110 con 0x7fb02c1593a0 2023-11-17T06:29:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 0x7fded4157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02bfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0a93f0 con 0x7fb02c0b2280 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:45998/0 (socket says 172.21.15.100:45998) 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02a7fc700 1 -- 172.21.15.100:0/4053154651 learned_addr learned my addr 172.21.15.100:0/4053154651 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c1593a0 0x7fb02c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e0161630 0x7f22e00cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22df7fe700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e00d1780 0x7f22e00ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6d00f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea6806a980 0x7fea6815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded40cdbe0 0x7fded42029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6d00f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb02c0717b0 0x7fb02c089880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6d00f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6815a100 con 0x7fea680c99d0 2023-11-17T06:29:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 0x7fded4157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeee7fc700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00c75b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e780 tx=0x7fbee000ea90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae152b700 1 -- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7adc0c5460 msgr2=0x7f7adc15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae152b700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7adc0c5460 0x7f7adc15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae152b700 1 -- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7adc159310 msgr2=0x7f7adc159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae152b700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7adc159310 0x7f7adc159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae152b700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8008050 con 0x7f7adc0c5910 2023-11-17T06:29:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 -- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e00b5e20 msgr2=0x7f22e00cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e00b5e20 0x7f22e00cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 -- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e00d1780 msgr2=0x7f22e00ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e00d1780 0x7f22e00ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009a70 con 0x7f22e0161630 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6d00f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea68159b20 con 0x7fea6806a980 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6d00f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea68159d90 con 0x7fea680c9570 2023-11-17T06:29:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6659c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6659c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46012/0 (socket says 172.21.15.100:46012) 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea6659c700 1 -- 172.21.15.100:0/2764889702 learned_addr learned my addr 172.21.15.100:0/2764889702 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0013780 con 0x7fbef00cb240 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40cdfc0 0x7fded4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c9830 con 0x7fded40cdbe0 2023-11-17T06:29:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4202f00 con 0x7fded40cdfc0 2023-11-17T06:29:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded975b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c8c20 con 0x7fded40b1150 2023-11-17T06:29:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 -- 172.21.15.100:0/4053154651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 msgr2=0x7fb02c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 -- 172.21.15.100:0/4053154651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c1593a0 msgr2=0x7fb02c0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f7ae1d2c700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7adc0c5460 0x7f7adc15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 0x7fded4157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46002/0 (socket says 172.21.15.100:46002) 2023-11-17T06:29:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c1593a0 0x7fb02c0a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb024009a70 con 0x7fb02c0717b0 2023-11-17T06:29:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded2ffd700 1 -- 172.21.15.100:0/4078660642 learned_addr learned my addr 172.21.15.100:0/4078660642 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e60013cb0 con 0x7f3e68161a50 2023-11-17T06:29:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02a7fc700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2280 0x7fb02c0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee0010040 con 0x7fbef00cb240 2023-11-17T06:29:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0013ae0 con 0x7fbef00cb240 2023-11-17T06:29:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fded37fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40cdfc0 0x7fded4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fea66d9d700 1 --2- 172.21.15.100:0/2764889702 >> v2:172.21.15.119:3300/0 conn(0x7fea6806a980 0x7fea6815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22e4ec1700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e0161630 0x7f22e00cae30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22d0016000 tx=0x7f22d0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fbeeffff700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef01559d0 con 0x7fbef00cb240 2023-11-17T06:29:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7fb02affd700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb02c0717b0 0x7fb02c089880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4e0 tx=0x7fb02000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0012630 con 0x7f22e0161630 2023-11-17T06:29:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0004980 con 0x7f22e0161630 2023-11-17T06:29:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.380+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0012990 con 0x7f22e0161630 2023-11-17T06:29:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 -- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40cdfc0 msgr2=0x7fded4155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40cdfc0 0x7fded4155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fbeeffff700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef0155f90 con 0x7fbef00cb240 2023-11-17T06:29:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 -- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded40cdbe0 msgr2=0x7fded42029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded40cdbe0 0x7fded42029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc009b30 con 0x7fded40b1150 2023-11-17T06:29:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ae152b700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 0x7f7adc1596f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009470 tx=0x7f7ad0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded37fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded40cdfc0 0x7fded4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6659c700 1 -- 172.21.15.100:0/2764889702 >> v2:172.21.15.119:3300/0 conn(0x7fea6806a980 msgr2=0x7fea6815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6659c700 1 --2- 172.21.15.100:0/2764889702 >> v2:172.21.15.119:3300/0 conn(0x7fea6806a980 0x7fea6815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6659c700 1 -- 172.21.15.100:0/2764889702 >> v1:172.21.15.119:6789/0 conn(0x7fea680c99d0 legacy=0x7fea6815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6659c700 1 -- 172.21.15.100:0/2764889702 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680ca180 con 0x7fea680c9570 2023-11-17T06:29:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000de70 con 0x7f7adc0c5910 2023-11-17T06:29:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad000d350 con 0x7f7adc0c5910 2023-11-17T06:29:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0005b20 con 0x7f7adc0c5910 2023-11-17T06:29:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020004ca0 con 0x7fb02c0717b0 2023-11-17T06:29:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc155c90 con 0x7f7adc0c5910 2023-11-17T06:29:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc156250 con 0x7f7adc0c5910 2023-11-17T06:29:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e667fc700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3e4c066540 0x7f3e4c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e00cc920 con 0x7f22e0161630 2023-11-17T06:29:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e00b6870 con 0x7f22e0161630 2023-11-17T06:29:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbef00c3d20 con 0x7fbef00cb240 2023-11-17T06:29:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e60083c00 con 0x7f3e68161a50 2023-11-17T06:29:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0a96d0 con 0x7fb02c0717b0 2023-11-17T06:29:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6659c700 1 --2- 172.21.15.100:0/2764889702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009910 tx=0x7fea5c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80c78bd3566fb52 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7adc06c050 con 0x7f7adc0c5910 2023-11-17T06:29:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded2ffd700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 0x7fded4157760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdec800b550 tx=0x7fdec800b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c089dc0 con 0x7fb02c0717b0 2023-11-17T06:29:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e667fc700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7f3e4c06e760 0x7f3e4c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e4c071230 con 0x7f3e4c06e760 2023-11-17T06:29:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e60088240 con 0x7f3e68161a50 2023-11-17T06:29:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea65d9b700 1 -- 172.21.15.100:0/2764889702 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011830 con 0x7fea680c9570 2023-11-17T06:29:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea65d9b700 1 -- 172.21.15.100:0/2764889702 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c011990 con 0x7fea680c9570 2023-11-17T06:29:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8011830 con 0x7fded40b1150 2023-11-17T06:29:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f3e6d5d7700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7f3e4c06e760 0x7f3e4c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22e01657a0 con 0x7f22e0161630 2023-11-17T06:29:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8011990 con 0x7fded40b1150 2023-11-17T06:29:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40c8f00 con 0x7fded40b1150 2023-11-17T06:29:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8011d40 con 0x7fded40b1150 2023-11-17T06:29:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020004e00 con 0x7fb02c0717b0 2023-11-17T06:29:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200072d0 con 0x7fb02c0717b0 2023-11-17T06:29:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded40c94c0 con 0x7fded40b1150 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 -- 172.21.15.100:0/2764889702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 msgr2=0x7fea680b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 --2- 172.21.15.100:0/2764889702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009910 tx=0x7fea5c009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 -- 172.21.15.100:0/2764889702 shutdown_connections 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 --2- 172.21.15.100:0/2764889702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b0b20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 --2- 172.21.15.100:0/2764889702 >> v2:172.21.15.119:3300/0 conn(0x7fea6806a980 0x7fea6815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7fea6d00f700 1 -- 172.21.15.100:0/2764889702 >> 172.21.15.100:0/2764889702 conn(0x7fea680737e0 msgr2=0x7fea6806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f3e6d5d7700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7f3e4c06e760 0x7f3e4c070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fea6d00f700 1 -- 172.21.15.100:0/2764889702 shutdown_connections 2023-11-17T06:29:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fea6d00f700 1 -- 172.21.15.100:0/2764889702 wait complete. 2023-11-17T06:29:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f3e6ddd8700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3e4c066540 0x7f3e4c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbee0013c40 con 0x7fbef00cb240 2023-11-17T06:29:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.384+0000 7f6e6e876700 1 Processor -- start 2023-11-17T06:29:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ad0014070 con 0x7f7adc0c5910 2023-11-17T06:29:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== osd.0 v2:172.21.15.100:6801/1609678627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3e4c071230 con 0x7f3e4c06e760 2023-11-17T06:29:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f3e6ddd8700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3e4c066540 0x7f3e4c068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c014040 tx=0x7f3e5c011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 -- start start 2023-11-17T06:29:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbedc066540 0x7fbedc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fded415b410 con 0x7fded40b1150 2023-11-17T06:29:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbee00840e0 con 0x7fbef00cb240 2023-11-17T06:29:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ac00665e0 0x7f7ac0068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fbedc06e6e0 0x7fbedc070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbedc0711b0 con 0x7fbedc06e6e0 2023-11-17T06:29:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ad00844f0 con 0x7f7adc0c5910 2023-11-17T06:29:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee0084530 con 0x7fbef00cb240 2023-11-17T06:29:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6e68161890 0x7f6e680d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6e680b2410 0x7f6e680d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22d0012af0 con 0x7f22e0161630 2023-11-17T06:29:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fbedc06e6e0 0x7fbedc070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7f7ac006e800 0x7f7ac0070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ac00712d0 con 0x7f7ac006e800 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad00848a0 con 0x7f7adc0c5910 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f7ae1d2c700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ac00665e0 0x7f7ac0068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680cd880 con 0x7f6e68161890 2023-11-17T06:29:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680ce120 con 0x7f6e680b2410 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6e876700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680d1770 con 0x7f6e680d1340 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7f6e6ce13700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e6ce13700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46016/0 (socket says 172.21.15.100:46016) 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e6ce13700 1 -- 172.21.15.100:0/3970798237 learned_addr learned my addr 172.21.15.100:0/3970798237 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 --2- 172.21.15.100:0/3970798237 >> v2:172.21.15.100:3300/0 conn(0x7f6e68161890 0x7f6e680d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e677fe700 1 --2- 172.21.15.100:0/3970798237 >> v2:172.21.15.119:3300/0 conn(0x7f6e680b2410 0x7f6e680d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f7ae252d700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7f7ac006e800 0x7f7ac0070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.388+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb00c000fc0 con 0x7fb02c0717b0 2023-11-17T06:29:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fbeef7fe700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fbedc06e6e0 0x7fbedc070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dcff9700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f22c00665e0 0x7f22c0068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f7ae1d2c700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ac00665e0 0x7f7ac0068aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000c00 tx=0x7f7ad800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22d00862b0 con 0x7f22e0161630 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dffff700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f22c00665e0 0x7f22c0068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dcff9700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7f22c006e800 0x7f22c0070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22c00712d0 con 0x7f22c006e800 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22d00888d0 con 0x7f22e0161630 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fbeeeffd700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbedc066540 0x7fbedc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 -- 172.21.15.100:0/3970798237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 msgr2=0x7f6e680b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 --2- 172.21.15.100:0/3970798237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 -- 172.21.15.100:0/3970798237 >> v2:172.21.15.119:3300/0 conn(0x7f6e680b2410 msgr2=0x7f6e680d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 --2- 172.21.15.100:0/3970798237 >> v2:172.21.15.119:3300/0 conn(0x7f6e680b2410 0x7f6e680d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 -- 172.21.15.100:0/3970798237 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680d0650 con 0x7f6e68161890 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fbeeeffd700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbedc066540 0x7fbedc068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbee800e250 tx=0x7fbee800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f6e67fff700 1 --2- 172.21.15.100:0/3970798237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680d0070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e68071ff0 tx=0x7f6e58009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c55a8d38627665a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22df7fe700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7f22c006e800 0x7f22c0070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== osd.3 v2:172.21.15.100:6800/2990712957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbedc0711b0 con 0x7fbedc06e6e0 2023-11-17T06:29:46.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdec801a400 con 0x7fded40b1150 2023-11-17T06:29:46.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb020007430 con 0x7fb02c0717b0 2023-11-17T06:29:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22dffff700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f22c00665e0 0x7f22c0068aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22d8001370 tx=0x7f22d8007d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f7ae252d700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7f7ac006e800 0x7f7ac0070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdec0066510 0x7fdec00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7f22df7fe700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7f22c006e800 0x7f22c0070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdec8083ef0 con 0x7fded40b1150 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb018066510 0x7fb0180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb020083a40 con 0x7fb02c0717b0 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fb01806e6b0 0x7fb018070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb018071180 con 0x7fb01806e6b0 2023-11-17T06:29:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb020050e20 con 0x7fb02c0717b0 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fded27fc700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdec0066510 0x7fdec00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7fdec006e730 0x7fdec0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdec0071200 con 0x7fdec006e730 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.392+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec8086510 con 0x7fded40b1150 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e66ffd700 1 -- 172.21.15.100:0/3970798237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58011830 con 0x7f6e68161890 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e66ffd700 1 -- 172.21.15.100:0/3970798237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58011990 con 0x7f6e68161890 2023-11-17T06:29:46.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e66ffd700 1 -- 172.21.15.100:0/3970798237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58011d20 con 0x7f6e68161890 2023-11-17T06:29:46.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 Processor -- start 2023-11-17T06:29:46.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fded37fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7fdec006e730 0x7fdec0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fded27fc700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdec0066510 0x7fdec00689d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fded40b4cc0 tx=0x7fdec4006c70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 -- start start 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== osd.2 v2:172.21.15.100:6824/177771602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f22c00712d0 con 0x7f22c006e800 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 -- 172.21.15.100:0/3970798237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 msgr2=0x7f6e680d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 --2- 172.21.15.100:0/3970798237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680d0070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e68071ff0 tx=0x7f6e58009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 -- 172.21.15.100:0/3970798237 shutdown_connections 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 --2- 172.21.15.100:0/3970798237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 --2- 172.21.15.100:0/3970798237 >> v2:172.21.15.119:3300/0 conn(0x7f6e680b2410 0x7f6e680d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 --2- 172.21.15.100:0/3970798237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680d0070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 -- 172.21.15.100:0/3970798237 >> 172.21.15.100:0/3970798237 conn(0x7f6e6806b500 msgr2=0x7f6e6806b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 -- 172.21.15.100:0/3970798237 shutdown_connections 2023-11-17T06:29:46.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fded37fe700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7fdec006e730 0x7fdec0070b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6806a980 0x7fea6815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea680c99d0 0x7fea6815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68160520 con 0x7fea680c99d0 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68160790 con 0x7fea6806a980 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6d00f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea68160a70 con 0x7fea680c9570 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== osd.4 v2:172.21.15.119:6824/3894860840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7ac00712d0 con 0x7f7ac006e800 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea680c99d0 0x7fea6815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46018/0 (socket says 172.21.15.100:46018) 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 -- 172.21.15.100:0/1472302115 learned_addr learned my addr 172.21.15.100:0/1472302115 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7f6e6e876700 1 -- 172.21.15.100:0/3970798237 wait complete. 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fb02b7fe700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fb01806e6b0 0x7fb018070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fb02b7fe700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fb01806e6b0 0x7fb018070ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fb02a7fc700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb018066510 0x7fb0180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea66d9d700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6806a980 0x7fea6815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 -- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6806a980 msgr2=0x7fea6815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6806a980 0x7fea6815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 -- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea680c99d0 msgr2=0x7fea6815f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea680c99d0 0x7fea6815f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.396+0000 7fea6659c700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009570 con 0x7fea680c9570 2023-11-17T06:29:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== osd.1 v2:172.21.15.100:6804/897523512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb018071180 con 0x7fb01806e6b0 2023-11-17T06:29:46.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea6759e700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea680c99d0 0x7fea6815f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== osd.5 v2:172.21.15.119:6810/2475678651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdec0071200 con 0x7fdec006e730 2023-11-17T06:29:46.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea66d9d700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6806a980 0x7fea6815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 Processor -- start 2023-11-17T06:29:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea6659c700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b1b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea68159ed0 tx=0x7fea5c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 -- start start 2023-11-17T06:29:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fb02a7fc700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb018066510 0x7fb0180689d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb02c15cdd0 tx=0x7fb01c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c01bb90 con 0x7fea680c9570 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c01bcf0 con 0x7fea680c9570 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c025640 con 0x7fea680c9570 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea68160d50 con 0x7fea680c9570 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea680c7ee0 con 0x7fea680c9570 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 0x7f6e680b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea6804eea0 con 0x7fea680c9570 2023-11-17T06:29:46.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 0x7f6e680b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 0x7f6e680b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34004/0 (socket says 172.21.15.100:34004) 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b41e0 con 0x7f6e68161890 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b3350 con 0x7f6e680b2410 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e6e876700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b35d0 con 0x7f6e680d1340 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e67fff700 1 -- 172.21.15.100:0/120459713 learned_addr learned my addr 172.21.15.100:0/120459713 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.400+0000 7f6e677fe700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e6ce13700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 -- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 msgr2=0x7f6e680b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea5c023070 con 0x7fea680c9570 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e680d1340 0x7f6e680b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 -- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 msgr2=0x7f6e680b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580094b0 con 0x7f6e680b2410 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e6ce13700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e68161890 0x7f6e680b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e67fff700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 0x7f6e680b5750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009b70 tx=0x7f6e58004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58004300 con 0x7f6e680b2410 2023-11-17T06:29:46.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5801f070 con 0x7f6e680b2410 2023-11-17T06:29:46.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e6e876700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e680b38b0 con 0x7f6e680b2410 2023-11-17T06:29:46.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e6e876700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e680b3e70 con 0x7f6e680b2410 2023-11-17T06:29:46.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580036c0 con 0x7f6e680b2410 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7fea4f7fe700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea540665e0 0x7fea54068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.404+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea5c085760 con 0x7fea680c9570 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.408+0000 7fea4f7fe700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7fea5406e800 0x7fea54070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.408+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea540712d0 con 0x7fea5406e800 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.408+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea5c085b10 con 0x7fea680c9570 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.408+0000 7fea66d9d700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea540665e0 0x7fea54068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7fea6759e700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7fea5406e800 0x7fea54070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7fea66d9d700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea540665e0 0x7fea54068aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea58009af0 tx=0x7fea58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7fea6759e700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7fea5406e800 0x7fea54070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e58021030 con 0x7f6e680b2410 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e680cddb0 con 0x7f6e680b2410 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6e54066510 0x7f6e540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e58084fd0 con 0x7f6e680b2410 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e677fe700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6e54066510 0x7f6e540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6e5406e6b0 0x7f6e54070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e54071180 con 0x7f6e5406e6b0 2023-11-17T06:29:46.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e580875b0 con 0x7f6e680b2410 2023-11-17T06:29:46.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fea540712d0 con 0x7fea5406e800 2023-11-17T06:29:46.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e6ce13700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6e5406e6b0 0x7f6e54070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.412+0000 7f6e677fe700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6e54066510 0x7f6e540689d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e680c9b40 tx=0x7f6e5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.416+0000 7f6e6ce13700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6e5406e6b0 0x7f6e54070ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.416+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== osd.7 v2:172.21.15.119:6808/609004044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6e54071180 con 0x7f6e5406e6b0 2023-11-17T06:29:46.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22e01654c0 con 0x7f22c006e800 2023-11-17T06:29:46.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e680c9610 con 0x7f3e4c06e760 2023-11-17T06:29:46.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f3e667fc700 1 -- 172.21.15.100:0/3104696857 <== osd.0 v2:172.21.15.100:6801/1609678627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e54001540 con 0x7f3e4c06e760 2023-11-17T06:29:46.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f22dcff9700 1 -- 172.21.15.100:0/1725037525 <== osd.2 v2:172.21.15.100:6824/177771602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22c8001540 con 0x7f22c006e800 2023-11-17T06:29:46.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7f3e4c06e760 msgr2=0x7f3e4c070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.420+0000 7f3e7003c700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7f3e4c06e760 0x7f3e4c070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7f22c006e800 msgr2=0x7f22c0070c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7f22c006e800 0x7f22c0070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3e4c066540 msgr2=0x7f3e4c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3e4c066540 0x7f3e4c068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c014040 tx=0x7f3e5c011000 comp rx=0 tx=0).stop 2023-11-17T06:29:46.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68161a50 msgr2=0x7f3e680b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 --2- 172.21.15.100:0/3104696857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68161a50 0x7f3e680b3810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e680cda60 tx=0x7f3e6000eaa0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f22c00665e0 msgr2=0x7f22c0068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f22c00665e0 0x7f22c0068aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22d8001370 tx=0x7f22d8007d20 comp rx=0 tx=0).stop 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e0161630 msgr2=0x7f22e00cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 --2- 172.21.15.100:0/1725037525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22e0161630 0x7f22e00cae30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22d0016000 tx=0x7f22d0004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e4ec1700 1 -- 172.21.15.100:0/1725037525 reap_dead start 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 shutdown_connections 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 >> 172.21.15.100:0/1725037525 conn(0x7f22e00d2fd0 msgr2=0x7f22e006b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e6e5d9700 1 -- 172.21.15.100:0/3104696857 reap_dead start 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 shutdown_connections 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 shutdown_connections 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 >> 172.21.15.100:0/3104696857 conn(0x7f3e6806a270 msgr2=0x7f3e680702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 shutdown_connections 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f3e7003c700 1 -- 172.21.15.100:0/3104696857 wait complete. 2023-11-17T06:29:46.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f22e56c2700 1 -- 172.21.15.100:0/1725037525 wait complete. 2023-11-17T06:29:46.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbef00ca240 con 0x7fbedc06e6e0 2023-11-17T06:29:46.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.424+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7adc067d70 con 0x7f7ac006e800 2023-11-17T06:29:46.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb00c002d60 con 0x7fb01806e6b0 2023-11-17T06:29:46.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ace7fc700 1 -- 172.21.15.100:0/3761556146 <== osd.4 v2:172.21.15.119:6824/3894860840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7adc067d70 con 0x7f7ac006e800 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fbed77fe700 1 -- 172.21.15.100:0/3364689765 <== osd.3 v2:172.21.15.100:6800/2990712957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbee4011630 con 0x7fbedc06e6e0 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7f7ac006e800 msgr2=0x7f7ac0070c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7f7ac006e800 0x7f7ac0070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ac00665e0 msgr2=0x7f7ac0068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ac00665e0 0x7f7ac0068aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000c00 tx=0x7f7ad800a000 comp rx=0 tx=0).stop 2023-11-17T06:29:46.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 msgr2=0x7f7adc1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 --2- 172.21.15.100:0/3761556146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7adc0c5910 0x7f7adc1596f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009470 tx=0x7f7ad0009780 comp rx=0 tx=0).stop 2023-11-17T06:29:46.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb0137fe700 1 -- 172.21.15.100:0/4053154651 <== osd.1 v2:172.21.15.100:6804/897523512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb00c002d60 con 0x7fb01806e6b0 2023-11-17T06:29:46.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae252d700 1 -- 172.21.15.100:0/3761556146 reap_dead start 2023-11-17T06:29:46.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 shutdown_connections 2023-11-17T06:29:46.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 >> 172.21.15.100:0/3761556146 conn(0x7f7adc0cecb0 msgr2=0x7f7adc0ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fb01806e6b0 msgr2=0x7fb018070ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fb01806e6b0 0x7fb018070ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 shutdown_connections 2023-11-17T06:29:46.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7f7ae2d2e700 1 -- 172.21.15.100:0/3761556146 wait complete. 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fded40cc150 con 0x7fdec006e730 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb018066510 msgr2=0x7fb0180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb018066510 0x7fb0180689d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb02c15cdd0 tx=0x7fb01c009240 comp rx=0 tx=0).stop 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb02c0717b0 msgr2=0x7fb02c089880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 --2- 172.21.15.100:0/4053154651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb02c0717b0 0x7fb02c089880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4e0 tx=0x7fb02000c7f0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02b7fe700 1 -- 172.21.15.100:0/4053154651 reap_dead start 2023-11-17T06:29:46.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 shutdown_connections 2023-11-17T06:29:46.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.428+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 >> 172.21.15.100:0/4053154651 conn(0x7fb02c06e6a0 msgr2=0x7fb02c16d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fbedc06e6e0 msgr2=0x7fbedc070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fdebb7fe700 1 -- 172.21.15.100:0/4078660642 <== osd.5 v2:172.21.15.119:6810/2475678651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdecc00bb80 con 0x7fdec006e730 2023-11-17T06:29:46.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fbedc06e6e0 0x7fbedc070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbedc066540 msgr2=0x7fbedc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbedc066540 0x7fbedc068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbee800e250 tx=0x7fbee800b040 comp rx=0 tx=0).stop 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 msgr2=0x7fbef00c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 --2- 172.21.15.100:0/3364689765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbef00cb240 0x7fbef00c75b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e780 tx=0x7fbee000ea90 comp rx=0 tx=0).stop 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbeef7fe700 1 -- 172.21.15.100:0/3364689765 reap_dead start 2023-11-17T06:29:46.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7fdec006e730 msgr2=0x7fdec0070b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7fdec006e730 0x7fdec0070b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdec0066510 msgr2=0x7fdec00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdec0066510 0x7fdec00689d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fded40b4cc0 tx=0x7fdec4006c70 comp rx=0 tx=0).stop 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 msgr2=0x7fded4157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 --2- 172.21.15.100:0/4078660642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded40b1150 0x7fded4157760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdec800b550 tx=0x7fdec800b860 comp rx=0 tx=0).stop 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded37fe700 1 -- 172.21.15.100:0/4078660642 reap_dead start 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 shutdown_connections 2023-11-17T06:29:46.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 >> 172.21.15.100:0/3364689765 conn(0x7fbef00cecb0 msgr2=0x7fbef0071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 shutdown_connections 2023-11-17T06:29:46.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 >> 172.21.15.100:0/4078660642 conn(0x7fded406a270 msgr2=0x7fded4154390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 shutdown_connections 2023-11-17T06:29:46.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 shutdown_connections 2023-11-17T06:29:46.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fb02bfff700 1 -- 172.21.15.100:0/4053154651 wait complete. 2023-11-17T06:29:46.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 shutdown_connections 2023-11-17T06:29:46.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fbed57fa700 1 -- 172.21.15.100:0/3364689765 wait complete. 2023-11-17T06:29:46.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.432+0000 7fded975b700 1 -- 172.21.15.100:0/4078660642 wait complete. 2023-11-17T06:29:46.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.448+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea68160f70 con 0x7fea5406e800 2023-11-17T06:29:46.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.448+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e680cdad0 con 0x7f6e5406e6b0 2023-11-17T06:29:46.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.448+0000 7fea4f7fe700 1 -- 172.21.15.100:0/1472302115 <== osd.6 v2:172.21.15.119:6800/1264916422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea68160f70 con 0x7fea5406e800 2023-11-17T06:29:46.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.448+0000 7f6e64ff9700 1 -- 172.21.15.100:0/120459713 <== osd.7 v2:172.21.15.119:6808/609004044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e6000f040 con 0x7f6e5406e6b0 2023-11-17T06:29:46.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6e5406e6b0 msgr2=0x7f6e54070ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6e5406e6b0 0x7f6e54070ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6e54066510 msgr2=0x7f6e540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6e54066510 0x7f6e540689d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e680c9b40 tx=0x7f6e5c008040 comp rx=0 tx=0).stop 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 msgr2=0x7f6e680b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 --2- 172.21.15.100:0/120459713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e680b2410 0x7f6e680b5750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009b70 tx=0x7f6e58004770 comp rx=0 tx=0).stop 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e6ce13700 1 -- 172.21.15.100:0/120459713 reap_dead start 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 shutdown_connections 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 >> 172.21.15.100:0/120459713 conn(0x7f6e6806b500 msgr2=0x7f6e680cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 shutdown_connections 2023-11-17T06:29:46.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7f6e4e7fc700 1 -- 172.21.15.100:0/120459713 wait complete. 2023-11-17T06:29:46.482 INFO:teuthology.orchestra.run.smithi100.stdout:55834574864 2023-11-17T06:29:46.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-17T06:29:46.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7fea5406e800 msgr2=0x7fea54070c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7fea5406e800 0x7fea54070c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea540665e0 msgr2=0x7fea54068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fea540665e0 0x7fea54068aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea58009af0 tx=0x7fea58008040 comp rx=0 tx=0).stop 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 msgr2=0x7fea680b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6d00f700 1 --2- 172.21.15.100:0/1472302115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea680c9570 0x7fea680b1b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea68159ed0 tx=0x7fea5c004770 comp rx=0 tx=0).stop 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.452+0000 7fea6759e700 1 -- 172.21.15.100:0/1472302115 reap_dead start 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:46.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.456+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 shutdown_connections 2023-11-17T06:29:46.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.456+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 >> 172.21.15.100:0/1472302115 conn(0x7fea680737e0 msgr2=0x7fea68071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-17T06:29:46.486 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:46.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-17T06:29:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.456+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 shutdown_connections 2023-11-17T06:29:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.456+0000 7fea6d00f700 1 -- 172.21.15.100:0/1472302115 wait complete. 2023-11-17T06:29:46.487 INFO:teuthology.orchestra.run.smithi100.stdout:55834574865 2023-11-17T06:29:46.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-17T06:29:46.488 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:46.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-17T06:29:46.489 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:46.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-17T06:29:46.490 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:46.491 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-17T06:29:46.491 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:46.492 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-17T06:29:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.760+0000 7f74dce14700 1 Processor -- start 2023-11-17T06:29:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.760+0000 7f74dce14700 1 -- start start 2023-11-17T06:29:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74dce14700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74d00e6750 0x7f74d0006d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74dce14700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 0x7f74d0057a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74dce14700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0057600 con 0x7f74d003ee90 2023-11-17T06:29:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74dce14700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00572d0 con 0x7f74d00e6750 2023-11-17T06:29:46.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74dce14700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00075b0 con 0x7f74d00546e0 2023-11-17T06:29:46.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7fe2dd7f4700 1 Processor -- start 2023-11-17T06:29:46.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f7bcd738700 1 Processor -- start 2023-11-17T06:29:46.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f7bcd738700 1 -- start start 2023-11-17T06:29:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7fb5dbb4b700 1 Processor -- start 2023-11-17T06:29:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 0x7f74d0057a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d77fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74d00e6750 0x7f74d0006d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 0x7f74d0057a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46030/0 (socket says 172.21.15.100:46030) 2023-11-17T06:29:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d7fff700 1 -- 172.21.15.100:0/61938029 learned_addr learned my addr 172.21.15.100:0/61938029 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7fe2dd7f4700 1 -- start start 2023-11-17T06:29:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7fb5dbb4b700 1 -- start start 2023-11-17T06:29:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d77fe700 1 -- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 msgr2=0x7f74d0057a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d77fe700 1 --2- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 0x7f74d0057a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d77fe700 1 -- 172.21.15.100:0/61938029 >> v1:172.21.15.119:6789/0 conn(0x7f74d003ee90 legacy=0x7f74d0053fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f74d77fe700 1 -- 172.21.15.100:0/61938029 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0007890 con 0x7f74d00e6750 2023-11-17T06:29:46.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.764+0000 7f7bcd738700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7bc81616d0 0x7f7bc80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74d77fe700 1 --2- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00e6750 0x7f74d0006d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009850 tx=0x7f74cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911889857f797177 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bcd738700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8165ef0 con 0x7f7bc80c5d70 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bcd738700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc80b4c50 con 0x7f7bc80b4810 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bcd738700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc81652e0 con 0x7f7bc81616d0 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc67fc700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7bc80b4810 0x7f7bc80c5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43810/0 (socket says 172.21.15.100:43810) 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc67fc700 1 -- 172.21.15.100:0/3189984020 learned_addr learned my addr 172.21.15.100:0/3189984020 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/3189984020 >> v2:172.21.15.119:3300/0 conn(0x7f7bc81616d0 0x7f7bc80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74d67fc700 1 -- 172.21.15.100:0/61938029 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011830 con 0x7f74d00e6750 2023-11-17T06:29:46.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74d67fc700 1 -- 172.21.15.100:0/61938029 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc011990 con 0x7f74d00e6750 2023-11-17T06:29:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74d67fc700 1 -- 172.21.15.100:0/61938029 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011d40 con 0x7f74d00e6750 2023-11-17T06:29:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dd7f4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe2d003ee90 0x7fe2d0053fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033139762 0 0) 0x7f7bc80b4c50 con 0x7f7bc80b4810 2023-11-17T06:29:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb00035d0 con 0x7f7bc80b4810 2023-11-17T06:29:46.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227897571 0 0) 0x7f7bc8165ef0 con 0x7f7bc80c5d70 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d7fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe2d00e6750 0x7fe2d0006d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54438/0 (socket says 172.21.15.100:54438) 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dd7f4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe2d0054510 0x7fe2d0057a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d7fff700 1 -- 172.21.15.100:0/1125477413 learned_addr learned my addr 172.21.15.100:0/1125477413 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d0057600 con 0x7fe2d00e6750 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d0054920 con 0x7fe2d0054510 2023-11-17T06:29:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00572d0 con 0x7fe2d003ee90 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc80b4c50 con 0x7f7bc80c5d70 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668469927 0 0) 0x7f7bc80b4c50 con 0x7f7bc80c5d70 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 >> v2:172.21.15.119:3300/0 conn(0x7f7bc81616d0 msgr2=0x7f7bc80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 --2- 172.21.15.100:0/3189984020 >> v2:172.21.15.119:3300/0 conn(0x7f7bc81616d0 0x7f7bc80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 >> v1:172.21.15.119:6789/0 conn(0x7f7bc80b4810 legacy=0x7f7bc80c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc81655c0 con 0x7f7bc80c5d70 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f7bc0001920 con 0x7f7bc80c5d70 2023-11-17T06:29:46.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 >> v1:172.21.15.100:6789/0 conn(0x7f7bc80c5d70 legacy=0x7f7bc80d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 -- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00e6750 msgr2=0x7f74d0006d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 --2- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00e6750 0x7f74d0006d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009850 tx=0x7f74cc009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 0x7f7bb0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bb0004870 0x7f7bb0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0005230 0x7f7bb000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81652e0 con 0x7f7bb0003c50 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000c160 con 0x7f7bb0004870 2023-11-17T06:29:46.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000c320 con 0x7f7bb0005230 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 -- 172.21.15.100:0/61938029 shutdown_connections 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 --2- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d00546e0 0x7f74d0057a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 --2- 172.21.15.100:0/61938029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00e6750 0x7f74d0006d60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 -- 172.21.15.100:0/61938029 >> 172.21.15.100:0/61938029 conn(0x7f74d0059200 msgr2=0x7f74d0059610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/1125477413 >> v2:172.21.15.119:3300/0 conn(0x7fe2d003ee90 0x7fe2d0053fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2dcff3700 1 --2- 172.21.15.100:0/1125477413 >> v2:172.21.15.100:3300/0 conn(0x7fe2d0054510 0x7fe2d0057a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 0x7f7bb0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 -- 172.21.15.100:0/61938029 shutdown_connections 2023-11-17T06:29:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d6ffd700 1 -- 172.21.15.100:0/1125477413 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197069444 0 0) 0x7fe2d0057600 con 0x7fe2d00e6750 2023-11-17T06:29:46.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d6ffd700 1 -- 172.21.15.100:0/1125477413 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c80035d0 con 0x7fe2d00e6750 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f74dce14700 1 -- 172.21.15.100:0/61938029 wait complete. 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d77fe700 1 -- 172.21.15.100:0/1125477413 >> v2:172.21.15.100:3300/0 conn(0x7fe2d0054510 msgr2=0x7fe2d0057a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/1125477413 >> v2:172.21.15.100:3300/0 conn(0x7fe2d0054510 0x7fe2d0057a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d77fe700 1 -- 172.21.15.100:0/1125477413 >> v1:172.21.15.100:6789/0 conn(0x7fe2d00e6750 legacy=0x7fe2d0006d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fe2d77fe700 1 -- 172.21.15.100:0/1125477413 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00075b0 con 0x7fe2d003ee90 2023-11-17T06:29:46.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7f7bc7fff700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0005230 0x7f7bb000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fb5dbb4b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5d41629f0 0x7fb5d40d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fdd4f04a700 1 Processor -- start 2023-11-17T06:29:46.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/1125477413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d003ee90 0x7fe2d0053fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00537e0 tx=0x7fe2c4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46c47e990196326a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0005230 msgr2=0x7f7bb000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bb0004870 0x7f7bb0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0005230 0x7f7bb000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bb0004870 msgr2=0x7f7bb0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bb0004870 0x7f7bb0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/3189984020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80b4c50 con 0x7f7bb0003c50 2023-11-17T06:29:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc7fff700 1 -- 172.21.15.100:0/3189984020 reap_dead start 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5da0e8700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb5d40b9960 0x7fb5d4165350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54440/0 (socket says 172.21.15.100:54440) 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5dbb4b700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40d2680 con 0x7fb5d40b9960 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5dbb4b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40d7840 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5dbb4b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40d7b20 con 0x7fb5d41629f0 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5da0e8700 1 -- 172.21.15.100:0/2883444081 learned_addr learned my addr 172.21.15.100:0/2883444081 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bb0004870 0x7f7bb0004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d98e7700 1 --2- 172.21.15.100:0/2883444081 >> v2:172.21.15.119:3300/0 conn(0x7fb5d41629f0 0x7fb5d40d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2d6ffd700 1 -- 172.21.15.100:0/1125477413 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4011830 con 0x7fe2d003ee90 2023-11-17T06:29:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2d6ffd700 1 -- 172.21.15.100:0/1125477413 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c4011990 con 0x7fe2d003ee90 2023-11-17T06:29:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2d6ffd700 1 -- 172.21.15.100:0/1125477413 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4011830 con 0x7fe2d003ee90 2023-11-17T06:29:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 0x7f7bb0004050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009b70 tx=0x7f7bb00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbf58e8afcfaef0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.768+0000 7fdd4f04a700 1 -- start start 2023-11-17T06:29:46.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d88e5700 1 -- 172.21.15.100:0/2883444081 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922708386 0 0) 0x7fb5cc001490 con 0x7fb5d40b9960 2023-11-17T06:29:46.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d88e5700 1 -- 172.21.15.100:0/2883444081 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c00035d0 con 0x7fb5d40b9960 2023-11-17T06:29:46.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fafb236e700 1 Processor -- start 2023-11-17T06:29:46.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f74dce14700 1 Processor -- start 2023-11-17T06:29:46.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e6c0 con 0x7f7bb0003c50 2023-11-17T06:29:46.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800e820 con 0x7f7bb0003c50 2023-11-17T06:29:46.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f7bc5ffb700 1 -- 172.21.15.100:0/3189984020 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800eb90 con 0x7f7bb0003c50 2023-11-17T06:29:46.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4f04a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd480cc880 0x7fdd480ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fafb236e700 1 -- start start 2023-11-17T06:29:46.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d98e7700 1 -- 172.21.15.100:0/2883444081 >> v1:172.21.15.119:6789/0 conn(0x7fb5d40d4dc0 legacy=0x7fb5d40b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d98e7700 1 -- 172.21.15.100:0/2883444081 >> v1:172.21.15.100:6789/0 conn(0x7fb5d40b9960 legacy=0x7fb5d4165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d98e7700 1 -- 172.21.15.100:0/2883444081 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40d7e00 con 0x7fb5d41629f0 2023-11-17T06:29:46.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7f74dce14700 1 -- start start 2023-11-17T06:29:46.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4f04a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd480c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4e048700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd480cc880 0x7fdd480ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4e048700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd480cc880 0x7fdd480ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47486/0 (socket says 172.21.15.100:47486) 2023-11-17T06:29:46.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d98e7700 1 --2- 172.21.15.100:0/2883444081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d41629f0 0x7fb5d40d1d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009850 tx=0x7fb5d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7166a75d4f52f618 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4d847700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdd480c4060 0x7fdd480c44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54450/0 (socket says 172.21.15.100:54450) 2023-11-17T06:29:46.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4e048700 1 -- 172.21.15.100:0/3906926551 learned_addr learned my addr 172.21.15.100:0/3906926551 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fb5d88e5700 1 -- 172.21.15.100:0/2883444081 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0004230 con 0x7fb5d41629f0 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 -- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 msgr2=0x7f7bb0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 0x7f7bb0004050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009b70 tx=0x7f7bb00058a0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d003ee90 0x7f74d00e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d00e6750 0x7f74d00d8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d004e5c0 con 0x7f74d00e6750 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00dad20 con 0x7f74d00546e0 2023-11-17T06:29:46.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74dce14700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d004e2e0 con 0x7f74d003ee90 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480cd570 con 0x7fdd480c4060 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e849700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4806cf30 con 0x7fdd480cc880 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4806c3f0 con 0x7fdd480ca680 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d003ee90 msgr2=0x7fe2d0053fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.772+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/1125477413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d003ee90 0x7fe2d0053fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00537e0 tx=0x7fe2c4009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5d88e5700 1 -- 172.21.15.100:0/2883444081 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0004390 con 0x7fb5d41629f0 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5d88e5700 1 -- 172.21.15.100:0/2883444081 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00036c0 con 0x7fb5d41629f0 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafac0b1150 0x7fafac070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0cb630 con 0x7fafac0cdfc0 2023-11-17T06:29:46.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0cb8b0 con 0x7fafac0b1150 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cbb90 con 0x7fafac0cdbe0 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 shutdown_connections 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e048700 1 -- 172.21.15.100:0/3906926551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 msgr2=0x7fdd480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e048700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e048700 1 -- 172.21.15.100:0/3906926551 >> v1:172.21.15.100:6789/0 conn(0x7fdd480c4060 legacy=0x7fdd480c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e048700 1 -- 172.21.15.100:0/3906926551 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480cd1a0 con 0x7fdd480cc880 2023-11-17T06:29:46.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e849700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd480c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46052/0 (socket says 172.21.15.100:46052) 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 -- 172.21.15.100:0/3189984020 shutdown_connections 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 --2- 172.21.15.100:0/3189984020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb0003c50 0x7f7bb0004050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 -- 172.21.15.100:0/3189984020 >> 172.21.15.100:0/3189984020 conn(0x7f7bc80cf2d0 msgr2=0x7f7bc80cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 -- 172.21.15.100:0/3189984020 shutdown_connections 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f7bcd738700 1 -- 172.21.15.100:0/3189984020 wait complete. 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 -- 172.21.15.100:0/3097119141 learned_addr learned my addr 172.21.15.100:0/3097119141 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 -- 172.21.15.100:0/3097119141 >> v2:172.21.15.100:3300/0 conn(0x7fafac0b1150 msgr2=0x7fafac070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 --2- 172.21.15.100:0/3097119141 >> v2:172.21.15.100:3300/0 conn(0x7fafac0b1150 0x7fafac070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 -- 172.21.15.100:0/3097119141 >> v1:172.21.15.100:6789/0 conn(0x7fafac0cdfc0 legacy=0x7fafac0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 -- 172.21.15.100:0/3097119141 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0cbe70 con 0x7fafac0cdbe0 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34050/0 (socket says 172.21.15.100:34050) 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 -- 172.21.15.100:0/3346257156 learned_addr learned my addr 172.21.15.100:0/3346257156 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d77fe700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d003ee90 0x7f74d00e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 -- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d003ee90 msgr2=0x7f74d00e2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d003ee90 0x7f74d00e2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 -- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d00e6750 msgr2=0x7f74d00d8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d00e6750 0x7f74d00d8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 -- 172.21.15.100:0/3346257156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0094b0 con 0x7f74d00546e0 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/1125477413 >> v2:172.21.15.100:3300/0 conn(0x7fe2d0054510 0x7fe2d0057a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/1125477413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d003ee90 0x7fe2d0053fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 >> 172.21.15.100:0/1125477413 conn(0x7fe2d0059200 msgr2=0x7fe2d0059610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 shutdown_connections 2023-11-17T06:29:46.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/2883444081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d41629f0 msgr2=0x7fb5d40d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/2883444081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d41629f0 0x7fb5d40d1d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009850 tx=0x7fb5d0009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/2883444081 shutdown_connections 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/2883444081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d41629f0 0x7fb5d40d1d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/2883444081 >> 172.21.15.100:0/2883444081 conn(0x7fb5d40737e0 msgr2=0x7fb5d406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/1125477413 wait complete. 2023-11-17T06:29:46.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fdd4e048700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480cc880 0x7fdd480ccc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009940 tx=0x7fdd38009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514072d4f7658a83 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/2883444081 shutdown_connections 2023-11-17T06:29:46.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafabfff700 1 --2- 172.21.15.100:0/3097119141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009910 tx=0x7faf9c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a716ddbb03ae20 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafaaffd700 1 -- 172.21.15.100:0/3097119141 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c004230 con 0x7fafac0cdbe0 2023-11-17T06:29:46.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7f74d6ffd700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c500 tx=0x7f74c400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafaaffd700 1 -- 172.21.15.100:0/3097119141 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c004390 con 0x7fafac0cdbe0 2023-11-17T06:29:46.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafaaffd700 1 -- 172.21.15.100:0/3097119141 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c009e60 con 0x7fafac0cdbe0 2023-11-17T06:29:46.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 -- 172.21.15.100:0/3097119141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 msgr2=0x7fafac15aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 Processor -- start 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fafb236e700 1 --2- 172.21.15.100:0/3097119141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009910 tx=0x7faf9c009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 -- 172.21.15.100:0/3097119141 shutdown_connections 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 --2- 172.21.15.100:0/3097119141 >> v2:172.21.15.100:3300/0 conn(0x7fafac0b1150 0x7fafac070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 --2- 172.21.15.100:0/3097119141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac15aed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 -- 172.21.15.100:0/3097119141 >> 172.21.15.100:0/3097119141 conn(0x7fafac06a270 msgr2=0x7fafac06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 -- start start 2023-11-17T06:29:46.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fe2dd7f4700 1 Processor -- start 2023-11-17T06:29:46.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 -- 172.21.15.100:0/3097119141 shutdown_connections 2023-11-17T06:29:46.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 -- 172.21.15.100:0/3097119141 wait complete. 2023-11-17T06:29:46.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fdd4d046700 1 -- 172.21.15.100:0/3906926551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011830 con 0x7fdd480cc880 2023-11-17T06:29:46.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f7bcd738700 1 Processor -- start 2023-11-17T06:29:46.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fdd4d046700 1 -- 172.21.15.100:0/3906926551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38011990 con 0x7fdd480cc880 2023-11-17T06:29:46.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.776+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/2883444081 wait complete. 2023-11-17T06:29:46.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 Processor -- start 2023-11-17T06:29:46.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f7bcd738700 1 -- start start 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fdd4d046700 1 -- 172.21.15.100:0/3906926551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011d20 con 0x7fdd480cc880 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40052d0 con 0x7f74d00546e0 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4005430 con 0x7f74d00546e0 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40055a0 con 0x7f74d00546e0 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d00da6d0 con 0x7f74d00546e0 2023-11-17T06:29:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d00e2bc0 con 0x7f74d00546e0 2023-11-17T06:29:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 0x7f5ff00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 -- start start 2023-11-17T06:29:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00d0400 con 0x7f5ff00cff70 2023-11-17T06:29:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00d2640 con 0x7f5ff015d2d0 2023-11-17T06:29:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5ff57c1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00ce340 con 0x7f5ff00d2170 2023-11-17T06:29:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f7bcd738700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5feffff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5ff015d2d0 0x7f5ff00d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43826/0 (socket says 172.21.15.100:43826) 2023-11-17T06:29:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5feffff700 1 -- 172.21.15.100:0/2570657356 learned_addr learned my addr 172.21.15.100:0/2570657356 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d40b9960 0x7fb5d41f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5d41629f0 0x7fb5d4200ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40d01b0 con 0x7fb5d41629f0 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40b83c0 con 0x7fb5d40b9960 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fb5dbb4b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d42004d0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f5fef7fe700 1 --2- 172.21.15.100:0/2570657356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 0x7f5ff00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7f7bcd738700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 0x7f7bc815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fafb236e700 1 Processor -- start 2023-11-17T06:29:46.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bcd738700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc806f5a0 0x7f7bc806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46082/0 (socket says 172.21.15.100:46082) 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 -- 172.21.15.100:0/1119454566 learned_addr learned my addr 172.21.15.100:0/1119454566 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bc6ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bc6ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46092/0 (socket says 172.21.15.100:46092) 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/1922056895 learned_addr learned my addr 172.21.15.100:0/1922056895 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480cc880 msgr2=0x7fdd480ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fdd4f04a700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480cc880 0x7fdd480ccc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009940 tx=0x7fdd38009c50 comp rx=0 tx=0).stop 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fe2dd7f4700 1 -- start start 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.780+0000 7fe2dd7f4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dd7f4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 0x7fe2d0178750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5feeffd700 1 -- 172.21.15.100:0/2570657356 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616223057 0 0) 0x7f5ff00d2640 con 0x7f5ff015d2d0 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5feeffd700 1 -- 172.21.15.100:0/2570657356 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd80035d0 con 0x7f5ff015d2d0 2023-11-17T06:29:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dd7f4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 0x7fe2d0178c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5da0e8700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5d41629f0 0x7fb5d4200ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5fef7fe700 1 -- 172.21.15.100:0/2570657356 >> v1:172.21.15.119:6789/0 conn(0x7f5ff015d2d0 legacy=0x7f5ff00d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5fef7fe700 1 -- 172.21.15.100:0/2570657356 >> v1:172.21.15.100:6789/0 conn(0x7f5ff00cff70 legacy=0x7f5ff00b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fafb236e700 1 -- start start 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46104/0 (socket says 172.21.15.100:46104) 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 -- 172.21.15.100:0/4212158047 learned_addr learned my addr 172.21.15.100:0/4212158047 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01791d0 con 0x7fe2d00e6750 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 -- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d40b9960 msgr2=0x7fb5d41f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d40b9960 0x7fb5d41f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 -- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5d41629f0 msgr2=0x7fb5d4200ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5d41629f0 0x7fb5d4200ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 -- 172.21.15.100:0/1119454566 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00094b0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d004d290 con 0x7fe2d0054510 2023-11-17T06:29:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5fef7fe700 1 -- 172.21.15.100:0/2570657356 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00d2920 con 0x7f5ff00d2170 2023-11-17T06:29:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5d90e6700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c580 tx=0x7fb5c400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d004d570 con 0x7fe2d003ee90 2023-11-17T06:29:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8005310 con 0x7f74d00546e0 2023-11-17T06:29:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 shutdown_connections 2023-11-17T06:29:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd480c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 --2- 172.21.15.100:0/3906926551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480cc880 0x7fdd480ccc60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 >> 172.21.15.100:0/3906926551 conn(0x7fdd480cb730 msgr2=0x7fdd480cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74c40038e0 con 0x7f74d00546e0 2023-11-17T06:29:46.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5fef7fe700 1 --2- 172.21.15.100:0/2570657356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 0x7f5ff00cfa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009880 tx=0x7f5fe4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56897db35f128fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40054e0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 0x7fe2d0178750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40036a0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4003a30 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d42007b0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5feeffd700 1 -- 172.21.15.100:0/2570657356 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4011830 con 0x7f5ff00d2170 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5feeffd700 1 -- 172.21.15.100:0/2570657356 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4011990 con 0x7f5ff00d2170 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5feeffd700 1 -- 172.21.15.100:0/2570657356 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4011d20 con 0x7f5ff00d2170 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d41f9ca0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 -- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 msgr2=0x7fe2d0178750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2dcff3700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 0x7fe2d0178c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 0x7f7bc815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc806ff90 con 0x7f7bc806f5a0 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc815dbd0 con 0x7f7bc81f7830 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc815deb0 con 0x7f7bb0003c50 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 shutdown_connections 2023-11-17T06:29:46.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f7bc7fff700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc806f5a0 0x7f7bc806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fdd4f04a700 1 -- 172.21.15.100:0/3906926551 wait complete. 2023-11-17T06:29:46.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 0x7fe2d0178750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f74c3fff700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 0x7f74bc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 -- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 msgr2=0x7fe2d0178c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74c40830b0 con 0x7f74d00546e0 2023-11-17T06:29:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 0x7fe2d0178c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5db1663700 1 Processor -- start 2023-11-17T06:29:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7fe2d7fff700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40094b0 con 0x7fe2d003ee90 2023-11-17T06:29:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f74d77fe700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 0x7f74bc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.784+0000 7f5db1663700 1 -- start start 2023-11-17T06:29:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 msgr2=0x7f7bc815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 0x7f7bc815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc806f5a0 msgr2=0x7f7bc806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc806f5a0 0x7f7bc806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc815e190 con 0x7f7bb0003c50 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 0x7f7bc815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bc6ffd700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800e4b0 tx=0x7f7bb80047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f74d77fe700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 0x7f74bc068a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0090b0 tx=0x7f74cc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2dcff3700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 0x7fe2d0178c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 0x7fe2d0178750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2d7fff700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c4d0 tx=0x7fe2cc00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47546/0 (socket says 172.21.15.100:47546) 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 -- 172.21.15.100:0/1493385993 learned_addr learned my addr 172.21.15.100:0/1493385993 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 0x7fafac1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f4cf0 con 0x7fafac0b1150 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f6370 con 0x7fafac0cdfc0 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f43c0 con 0x7fafac0cdbe0 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafab7fe700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb090b700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 0x7fafac1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 -- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 msgr2=0x7fafac0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8021070 con 0x7f7bb0003c50 2023-11-17T06:29:46.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 Processor -- start 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 -- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 msgr2=0x7fafac1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 0x7fafac1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009570 con 0x7fafac0b1150 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb090b700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 0x7fafac1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80045b0 con 0x7f7bb0003c50 2023-11-17T06:29:46.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc815e470 con 0x7f7bb0003c50 2023-11-17T06:29:46.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 -- start start 2023-11-17T06:29:46.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e6c0 con 0x7f7bb0003c50 2023-11-17T06:29:46.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafabfff700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf9c004000 tx=0x7faf9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc815e750 con 0x7f7bb0003c50 2023-11-17T06:29:46.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d40d02f0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc005d90 con 0x7fe2d003ee90 2023-11-17T06:29:46.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0070d0 con 0x7fe2d003ee90 2023-11-17T06:29:46.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc007480 con 0x7fe2d003ee90 2023-11-17T06:29:46.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d004d850 con 0x7fe2d003ee90 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5ff57c1700 1 -- 172.21.15.100:0/2570657356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 msgr2=0x7f5ff00cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5ff57c1700 1 --2- 172.21.15.100:0/2570657356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 0x7f5ff00cfa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009880 tx=0x7f5fe4009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00bd00 con 0x7fafac0b1150 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c01f070 con 0x7fafac0b1150 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c003900 con 0x7fafac0b1150 2023-11-17T06:29:46.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480c4060 0x7fdd481f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5ff57c1700 1 -- 172.21.15.100:0/2570657356 shutdown_connections 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5ff57c1700 1 --2- 172.21.15.100:0/2570657356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00d2170 0x7f5ff00cfa30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5ff57c1700 1 -- 172.21.15.100:0/2570657356 >> 172.21.15.100:0/2570657356 conn(0x7f5ff006b390 msgr2=0x7f5ff006b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5db1663700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dac160a40 0x7f5dac0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5db1663700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dac0b41b0 0x7f5dac0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5db1663700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0ceba0 con 0x7f5dac0d0660 2023-11-17T06:29:46.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5db1663700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac0b2790 con 0x7f5dac0b41b0 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5db1663700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac160e20 con 0x7f5dac160a40 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd48163110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 0x7fdd481f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481f8190 con 0x7fdd480c4060 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481f8470 con 0x7fdd480cc880 2023-11-17T06:29:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4f04a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481f8750 con 0x7fdd480ca680 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4d847700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd48163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4d847700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd48163110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46122/0 (socket says 172.21.15.100:46122) 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4d847700 1 -- 172.21.15.100:0/2873899257 learned_addr learned my addr 172.21.15.100:0/2873899257 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fdd4e849700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 0x7fdd481f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5daaffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dac160a40 0x7f5dac0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5daaffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dac160a40 0x7f5dac0cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34098/0 (socket says 172.21.15.100:34098) 2023-11-17T06:29:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7f5daaffd700 1 -- 172.21.15.100:0/1239240570 learned_addr learned my addr 172.21.15.100:0/1239240570 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac1f46a0 con 0x7fafac0b1150 2023-11-17T06:29:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac1f2400 con 0x7fafac0b1150 2023-11-17T06:29:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d004de10 con 0x7fe2d003ee90 2023-11-17T06:29:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5daaffd700 1 -- 172.21.15.100:0/1239240570 >> v2:172.21.15.100:3300/0 conn(0x7f5dac0b41b0 msgr2=0x7f5dac0d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5daaffd700 1 --2- 172.21.15.100:0/1239240570 >> v2:172.21.15.100:3300/0 conn(0x7f5dac0b41b0 0x7f5dac0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5daaffd700 1 -- 172.21.15.100:0/1239240570 >> v1:172.21.15.119:6789/0 conn(0x7f5dac0d0660 legacy=0x7f5dac0d0fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5daaffd700 1 -- 172.21.15.100:0/1239240570 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0cedf0 con 0x7f5dac160a40 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5daaffd700 1 --2- 172.21.15.100:0/1239240570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac160a40 0x7f5dac0cfac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06dbd0 tx=0x7f5da4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f52fa1243f58bb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.788+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5c4003b90 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fb5ca7fc700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 0x7fb5b8068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5c40831e0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc815deb0 con 0x7f7bb0003c50 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7bb8003900 con 0x7f7bb0003c50 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 -- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 msgr2=0x7fdd48163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd48163110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 -- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480c4060 msgr2=0x7fdd481f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480c4060 0x7fdd481f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 -- 172.21.15.100:0/2873899257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400094b0 con 0x7fdd480cc880 2023-11-17T06:29:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fdd4e849700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 0x7fdd481f9230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e8e0 tx=0x7fdd4000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2cc0075e0 con 0x7fe2d003ee90 2023-11-17T06:29:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0055250 con 0x7fe2d003ee90 2023-11-17T06:29:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5ff57c1700 1 -- 172.21.15.100:0/2570657356 shutdown_connections 2023-11-17T06:29:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fb5d98e7700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 0x7fb5b8068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faf9c021030 con 0x7fafac0b1150 2023-11-17T06:29:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f7baf7fe700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 0x7f7bb4068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bb8085320 con 0x7f7bb0003c50 2023-11-17T06:29:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fe2d4ff9700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 0x7fe2bc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 0x7f7bb4068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fb5d98e7700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 0x7fb5b8068aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5d415be70 tx=0x7fb5d0010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.792+0000 7f5ff57c1700 1 -- 172.21.15.100:0/2570657356 wait complete. 2023-11-17T06:29:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5ff57c1700 1 Processor -- start 2023-11-17T06:29:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fafa8ff9700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 0x7faf8c068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf9c085400 con 0x7fafac0b1150 2023-11-17T06:29:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac04eea0 con 0x7fafac0b1150 2023-11-17T06:29:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5da9ffb700 1 -- 172.21.15.100:0/1239240570 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4004230 con 0x7f5dac160a40 2023-11-17T06:29:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5da9ffb700 1 -- 172.21.15.100:0/1239240570 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4004390 con 0x7f5dac160a40 2023-11-17T06:29:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5da9ffb700 1 -- 172.21.15.100:0/1239240570 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40036c0 con 0x7f5dac160a40 2023-11-17T06:29:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74c40506a0 con 0x7f74d00546e0 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000eee0 con 0x7fdd480cc880 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4000c850 con 0x7fdd480cc880 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000cc00 con 0x7fdd480cc880 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd4f04a700 1 -- 172.21.15.100:0/2873899257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd38009570 con 0x7fdd480cc880 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd4f04a700 1 -- 172.21.15.100:0/2873899257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd481f8d10 con 0x7fdd480cc880 2023-11-17T06:29:46.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f7bc67fc700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 0x7f7bb4068aa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80cd100 tx=0x7f7bbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 0x7fe2bc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fafab7fe700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 0x7faf8c068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5db1663700 1 -- 172.21.15.100:0/1239240570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac160a40 msgr2=0x7f5dac0cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5db1663700 1 --2- 172.21.15.100:0/1239240570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac160a40 0x7f5dac0cfac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06dbd0 tx=0x7f5da4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fafab7fe700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 0x7faf8c068aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafac15b270 tx=0x7faf9400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24005310 con 0x7fdd480cc880 2023-11-17T06:29:46.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7fe2d77fe700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 0x7fe2bc068a20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009fd0 tx=0x7fe2c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.796+0000 7f5ff57c1700 1 -- start start 2023-11-17T06:29:46.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 -- 172.21.15.100:0/1239240570 shutdown_connections 2023-11-17T06:29:46.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 --2- 172.21.15.100:0/1239240570 >> v2:172.21.15.100:3300/0 conn(0x7f5dac0b41b0 0x7f5dac0d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 --2- 172.21.15.100:0/1239240570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac160a40 0x7f5dac0cfac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 -- 172.21.15.100:0/1239240570 >> 172.21.15.100:0/1239240570 conn(0x7f5dac0d30b0 msgr2=0x7f5dac0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:46.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd40013470 con 0x7fdd480cc880 2023-11-17T06:29:46.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 -- 172.21.15.100:0/1239240570 shutdown_connections 2023-11-17T06:29:46.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 -- 172.21.15.100:0/1239240570 wait complete. 2023-11-17T06:29:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7fdd3effd700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 0x7fdd2c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd40083e30 con 0x7fdd480cc880 2023-11-17T06:29:46.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5d40d02f0 con 0x7fb5d40d4dc0 2023-11-17T06:29:46.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7fdd4e048700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 0x7fdd2c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46134/0 (socket says 172.21.15.100:46134) 2023-11-17T06:29:46.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff00d2170 0x7f5ff00cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff015d2d0 0x7f5ff00b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0156d10 con 0x7f5ff00d2170 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 -- 172.21.15.100:0/3353765670 learned_addr learned my addr 172.21.15.100:0/3353765670 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00cbd40 con 0x7f5ff015d2d0 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5fef7fe700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff00d2170 0x7f5ff00cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff57c1700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00cc020 con 0x7f5ff00cff70 2023-11-17T06:29:46.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 Processor -- start 2023-11-17T06:29:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5ff4fc0700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff015d2d0 0x7f5ff00b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5db1663700 1 -- start start 2023-11-17T06:29:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 -- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff015d2d0 msgr2=0x7f5ff00b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff015d2d0 0x7f5ff00b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 -- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff00d2170 msgr2=0x7f5ff00cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff00d2170 0x7f5ff00cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.800+0000 7f5feffff700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40094b0 con 0x7f5ff00cff70 2023-11-17T06:29:46.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7fdd4e048700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 0x7fdd2c068a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000c00 tx=0x7fdd38010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac0b41b0 0x7f5dac1f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 0x7f5dac0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac1e6bc0 con 0x7f5dac0d0660 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac153900 con 0x7f5dac0b41b0 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac1e6570 con 0x7f5dac160a40 2023-11-17T06:29:46.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5feffff700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c4b0 tx=0x7f5fe000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5dab7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 0x7f5dac0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5dab7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 0x7f5dac0b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46148/0 (socket says 172.21.15.100:46148) 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47572/0 (socket says 172.21.15.100:47572) 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac0b41b0 0x7f5dac1f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5dab7fe700 1 -- 172.21.15.100:0/3041698649 learned_addr learned my addr 172.21.15.100:0/3041698649 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 -- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 msgr2=0x7f5dac0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 0x7f5dac0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 -- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac0b41b0 msgr2=0x7f5dac1f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac0b41b0 0x7f5dac1f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 -- 172.21.15.100:0/3041698649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009570 con 0x7f5dac0d0660 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5daa7fc700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00bd50 tx=0x7f5d9c00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2cc0548e0 con 0x7fe2d003ee90 2023-11-17T06:29:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0004ca0 con 0x7f5ff00cff70 2023-11-17T06:29:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00cbb0 con 0x7f5dac0d0660 2023-11-17T06:29:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5ff57c1700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff00cc300 con 0x7f5ff00cff70 2023-11-17T06:29:46.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5ff57c1700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff00cc8c0 con 0x7f5ff00cff70 2023-11-17T06:29:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00cd30 con 0x7f5dac0d0660 2023-11-17T06:29:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c014680 con 0x7f5dac0d0660 2023-11-17T06:29:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 -- 172.21.15.100:0/3041698649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac1e6850 con 0x7f5dac0d0660 2023-11-17T06:29:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd40051320 con 0x7fdd480cc880 2023-11-17T06:29:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7f5db1663700 1 -- 172.21.15.100:0/3041698649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac153be0 con 0x7f5dac0d0660 2023-11-17T06:29:46.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.804+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf9c0528f0 con 0x7fafac0b1150 2023-11-17T06:29:46.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7bb8052810 con 0x7f7bb0003c50 2023-11-17T06:29:46.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd0005310 con 0x7f5ff00cff70 2023-11-17T06:29:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d84005310 con 0x7f5dac0d0660 2023-11-17T06:29:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5d9c01d3b0 con 0x7f5dac0d0660 2023-11-17T06:29:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f5d937fe700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 0x7f5d98068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d9c083cd0 con 0x7f5dac0d0660 2023-11-17T06:29:46.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.808+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2cc088060 con 0x7fe2d003ee90 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.812+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0001240 con 0x7f5ff00cff70 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.812+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00070d0 con 0x7f5ff00cff70 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.812+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5fe00072f0 con 0x7f5ff00cff70 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.812+0000 7f5fecff9700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 0x7f5fdc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.812+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fe0084050 con 0x7f5ff00cff70 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.816+0000 7f5fef7fe700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 0x7f5fdc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.816+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5fe00514b0 con 0x7f5ff00cff70 2023-11-17T06:29:46.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.816+0000 7f5fef7fe700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 0x7f5fdc0689d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00d2570 tx=0x7f5fe401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.816+0000 7f5daaffd700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 0x7f5d98068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:46.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.816+0000 7f5daaffd700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 0x7f5d98068aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06dbd0 tx=0x7f5da4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:46.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:46.824+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d9c089020 con 0x7f5dac0d0660 2023-11-17T06:29:47.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.128+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb5d40d02f0 con 0x7fb5d40d4dc0 2023-11-17T06:29:47.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.128+0000 7fb5ca7fc700 1 -- 172.21.15.100:0/1119454566 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5d40d02f0 con 0x7fb5d40d4dc0 2023-11-17T06:29:47.131 INFO:teuthology.orchestra.run.smithi100.stdout:55834574861 2023-11-17T06:29:47.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.128+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74b8005890 con 0x7f74d00546e0 2023-11-17T06:29:47.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bc804eea0 con 0x7f7bb0003c50 2023-11-17T06:29:47.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7f74c3fff700 1 -- 172.21.15.100:0/3346257156 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74c40011a0 con 0x7f74d00546e0 2023-11-17T06:29:47.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7f7baf7fe700 1 -- 172.21.15.100:0/1922056895 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bb8055e30 con 0x7f7bb0003c50 2023-11-17T06:29:47.135 INFO:teuthology.orchestra.run.smithi100.stdout:55834574861 2023-11-17T06:29:47.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 msgr2=0x7fb5b8068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 0x7fb5b8068aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5d415be70 tx=0x7fb5d0010000 comp rx=0 tx=0).stop 2023-11-17T06:29:47.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 msgr2=0x7fb5d40d05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c580 tx=0x7fb5c400c940 comp rx=0 tx=0).stop 2023-11-17T06:29:47.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdd240055c0 con 0x7fdd480cc880 2023-11-17T06:29:47.137 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 shutdown_connections 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb5b80665e0 0x7fb5b8068aa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5d41629f0 0x7fb5d4200ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5d40d4dc0 0x7fb5d40d05d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 --2- 172.21.15.100:0/1119454566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5d40b9960 0x7fb5d41f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 >> 172.21.15.100:0/1119454566 conn(0x7fb5d40737e0 msgr2=0x7fb5d4158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 shutdown_connections 2023-11-17T06:29:47.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.132+0000 7fb5dbb4b700 1 -- 172.21.15.100:0/1119454566 wait complete. 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3effd700 1 -- 172.21.15.100:0/2873899257 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd40054940 con 0x7fdd480cc880 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 msgr2=0x7f74bc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 0x7f74bc068a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0090b0 tx=0x7f74cc01c040 comp rx=0 tx=0).stop 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 msgr2=0x7f74d004da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c500 tx=0x7f74c400c810 comp rx=0 tx=0).stop 2023-11-17T06:29:47.139 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 msgr2=0x7f7bb4068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 0x7f7bb4068aa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80cd100 tx=0x7f7bbc009040 comp rx=0 tx=0).stop 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 msgr2=0x7f7bc8158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800e4b0 tx=0x7f7bb80047e0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 shutdown_connections 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f74bc066560 0x7f74bc068a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74d00e6750 0x7f74d00d8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74d00546e0 0x7f74d004da90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 --2- 172.21.15.100:0/3346257156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74d003ee90 0x7f74d00e2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 >> 172.21.15.100:0/3346257156 conn(0x7f74d0059200 msgr2=0x7f74d0057a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 shutdown_connections 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7bb40665e0 0x7f7bb4068aa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc806f5a0 0x7f7bc806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc81f7830 0x7f7bc815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 --2- 172.21.15.100:0/1922056895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bb0003c50 0x7f7bc8158cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 >> 172.21.15.100:0/1922056895 conn(0x7f7bc80cf2d0 msgr2=0x7f7bc80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 shutdown_connections 2023-11-17T06:29:47.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f7bcd738700 1 -- 172.21.15.100:0/1922056895 wait complete. 2023-11-17T06:29:47.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 shutdown_connections 2023-11-17T06:29:47.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7f74dce14700 1 -- 172.21.15.100:0/3346257156 wait complete. 2023-11-17T06:29:47.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 msgr2=0x7fdd2c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 0x7fdd2c068a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000c00 tx=0x7fdd38010000 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 msgr2=0x7fdd481f9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 0x7fdd481f9230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e8e0 tx=0x7fdd4000eca0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 shutdown_connections 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480cc880 0x7fdd481f9230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480ca680 0x7fdd48163110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd2c066560 0x7fdd2c068a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 --2- 172.21.15.100:0/2873899257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd480c4060 0x7fdd481f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 >> 172.21.15.100:0/2873899257 conn(0x7fdd480cb730 msgr2=0x7fdd48072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fafac04eea0 con 0x7fafac0b1150 2023-11-17T06:29:47.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.136+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 shutdown_connections 2023-11-17T06:29:47.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.140+0000 7fdd3cff9700 1 -- 172.21.15.100:0/2873899257 wait complete. 2023-11-17T06:29:47.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.140+0000 7fafa8ff9700 1 -- 172.21.15.100:0/1493385993 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf9c055f10 con 0x7fafac0b1150 2023-11-17T06:29:47.144 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:47.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.144+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 msgr2=0x7faf8c068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.144+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 0x7faf8c068aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafac15b270 tx=0x7faf9400d040 comp rx=0 tx=0).stop 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.144+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2d0005980 con 0x7fe2d003ee90 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.144+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 msgr2=0x7fafac1f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.144+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf9c004000 tx=0x7faf9c004770 comp rx=0 tx=0).stop 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 shutdown_connections 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafac0cdfc0 0x7fafac1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafac0cdbe0 0x7fafac0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf8c0665e0 0x7faf8c068aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 --2- 172.21.15.100:0/1493385993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafac0b1150 0x7fafac1f5180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 >> 172.21.15.100:0/1493385993 conn(0x7fafac06a270 msgr2=0x7fafac0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 shutdown_connections 2023-11-17T06:29:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fafb236e700 1 -- 172.21.15.100:0/1493385993 wait complete. 2023-11-17T06:29:47.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fd0005890 con 0x7f5ff00cff70 2023-11-17T06:29:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5d840055c0 con 0x7f5dac0d0660 2023-11-17T06:29:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7fe2d4ff9700 1 -- 172.21.15.100:0/4212158047 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2cc017020 con 0x7fe2d003ee90 2023-11-17T06:29:47.153 INFO:teuthology.orchestra.run.smithi100.stdout:55834574864 2023-11-17T06:29:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7f5fecff9700 1 -- 172.21.15.100:0/3353765670 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fe0054ad0 con 0x7f5ff00cff70 2023-11-17T06:29:47.154 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.148+0000 7f5d937fe700 1 -- 172.21.15.100:0/3041698649 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d9c019020 con 0x7f5dac0d0660 2023-11-17T06:29:47.154 INFO:teuthology.orchestra.run.smithi100.stdout:55834574861 2023-11-17T06:29:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 msgr2=0x7f5fdc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 msgr2=0x7fe2bc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 0x7fe2bc068a20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009fd0 tx=0x7fe2c4008030 comp rx=0 tx=0).stop 2023-11-17T06:29:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 msgr2=0x7fe2d004e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c4d0 tx=0x7fe2cc00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 shutdown_connections 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe2bc066560 0x7fe2bc068a20 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009fd0 tx=0x7fe2c4008030 comp rx=0 tx=0).stop 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2d00e6750 0x7fe2d0178c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d0054510 0x7fe2d0178750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 --2- 172.21.15.100:0/4212158047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2d003ee90 0x7fe2d004e330 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c4d0 tx=0x7fe2cc00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 >> 172.21.15.100:0/4212158047 conn(0x7fe2d0059200 msgr2=0x7fe2d0051e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 0x7f5fdc0689d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00d2570 tx=0x7f5fe401c040 comp rx=0 tx=0).stop 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 msgr2=0x7f5d98068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 0x7f5d98068aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06dbd0 tx=0x7f5da4008030 comp rx=0 tx=0).stop 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 msgr2=0x7f5dac0b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00bd50 tx=0x7f5d9c00bd80 comp rx=0 tx=0).stop 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 msgr2=0x7f5ff01567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c4b0 tx=0x7f5fe000c7c0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 shutdown_connections 2023-11-17T06:29:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff015d2d0 0x7f5ff00b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5fdc066510 0x7f5fdc0689d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff00d2170 0x7f5ff00cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 --2- 172.21.15.100:0/3353765670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff00cff70 0x7f5ff01567d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 >> 172.21.15.100:0/3353765670 conn(0x7f5ff006b390 msgr2=0x7f5ff00b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 shutdown_connections 2023-11-17T06:29:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 shutdown_connections 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dac160a40 0x7f5dac0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d980665e0 0x7f5d98068aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dac0d0660 0x7f5dac0b4b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 --2- 172.21.15.100:0/3041698649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dac0b41b0 0x7f5dac1f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.152+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 >> 172.21.15.100:0/3041698649 conn(0x7f5dac0d30b0 msgr2=0x7f5dac0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.156+0000 7fe2dd7f4700 1 -- 172.21.15.100:0/4212158047 wait complete. 2023-11-17T06:29:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.156+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 shutdown_connections 2023-11-17T06:29:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.156+0000 7f5fd67fc700 1 -- 172.21.15.100:0/3353765670 wait complete. 2023-11-17T06:29:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.156+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 shutdown_connections 2023-11-17T06:29:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:47.156+0000 7f5d917fa700 1 -- 172.21.15.100:0/3041698649 wait complete. 2023-11-17T06:29:47.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.5 2023-11-17T06:29:47.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574862 for osd.4 2023-11-17T06:29:47.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574864 got 55834574863 for osd.2 2023-11-17T06:29:47.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574862 for osd.7 2023-11-17T06:29:47.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2023-11-17T06:29:47.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574862 for osd.3 2023-11-17T06:29:47.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.6 2023-11-17T06:29:47.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574865 got 55834574864 for osd.1 2023-11-17T06:29:48.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-17T06:29:48.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-17T06:29:48.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-17T06:29:48.178 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-17T06:29:48.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-17T06:29:48.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-17T06:29:48.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-17T06:29:48.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.384+0000 7fd0b2014700 1 Processor -- start 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.384+0000 7fd0b2014700 1 -- start start 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b2014700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0a403b2f0 0x7fd0a4039090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b2014700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a4054a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b2014700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40565f0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b2014700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a4056cf0 con 0x7fd0a403b2f0 2023-11-17T06:29:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b2014700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a403c9e0 con 0x7fd0a40395d0 2023-11-17T06:29:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b1012700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd0a40e4a30 0x7fd0a4038980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54486/0 (socket says 172.21.15.100:54486) 2023-11-17T06:29:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b1012700 1 -- 172.21.15.100:0/2847799612 learned_addr learned my addr 172.21.15.100:0/2847799612 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7f28219e4700 1 Processor -- start 2023-11-17T06:29:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7f28219e4700 1 -- start start 2023-11-17T06:29:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 --2- 172.21.15.100:0/2847799612 >> v2:172.21.15.119:3300/0 conn(0x7fd0a403b2f0 0x7fd0a4039090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a4054a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7f295cdbc700 1 Processor -- start 2023-11-17T06:29:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 -- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 msgr2=0x7fd0a4054a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a4054a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 -- 172.21.15.100:0/2847799612 >> v1:172.21.15.100:6789/0 conn(0x7fd0a40e4a30 legacy=0x7fd0a4038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 -- 172.21.15.100:0/2847799612 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a403cc80 con 0x7fd0a403b2f0 2023-11-17T06:29:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7f295cdbc700 1 -- start start 2023-11-17T06:29:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7fd0b0811700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a403b2f0 0x7fd0a4039090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009850 tx=0x7fd09c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e7053222726a52 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.388+0000 7f28219e4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 0x7f281c0cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28219e4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f281c0cda90 0x7f281c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28219e4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c0d0530 con 0x7f281c0b4cb0 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28219e4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0d1480 con 0x7f281c0cda90 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28219e4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0d1760 con 0x7f281c0cfc10 2023-11-17T06:29:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f281c0cda90 0x7f281c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f281c0cda90 0x7f281c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47584/0 (socket says 172.21.15.100:47584) 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 -- 172.21.15.100:0/1747822630 learned_addr learned my addr 172.21.15.100:0/1747822630 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 -- 172.21.15.100:0/1747822630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 msgr2=0x7f281c0cfff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f281affd700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 0x7f281c0cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a4054a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 0x7f281c0cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0a3fff700 1 -- 172.21.15.100:0/2847799612 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c011830 con 0x7fd0a403b2f0 2023-11-17T06:29:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 -- 172.21.15.100:0/1747822630 >> v1:172.21.15.119:6789/0 conn(0x7f281c0b4cb0 legacy=0x7f281c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0a3fff700 1 -- 172.21.15.100:0/2847799612 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c011990 con 0x7fd0a403b2f0 2023-11-17T06:29:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0a3fff700 1 -- 172.21.15.100:0/2847799612 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c011d20 con 0x7fd0a403b2f0 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f28127fc700 1 -- 172.21.15.100:0/1747822630 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0d1a40 con 0x7f281c0cda90 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f295cdbc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29580cc880 0x7f29580ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f295cdbc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f29580ca680 0x7f29580c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f295cdbc700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29580cd570 con 0x7f29580c4060 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f295cdbc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295806cf30 con 0x7f29580ca680 2023-11-17T06:29:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f295cdbc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295806c3f0 con 0x7f29580cc880 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 -- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a403b2f0 msgr2=0x7fd0a4039090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a403b2f0 0x7fd0a4039090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009850 tx=0x7fd09c009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 -- 172.21.15.100:0/2847799612 shutdown_connections 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a4054a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2847799612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a403b2f0 0x7fd0a4039090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7fd0b2014700 1 -- 172.21.15.100:0/2847799612 >> 172.21.15.100:0/2847799612 conn(0x7fd0a4053980 msgr2=0x7fd0a4053d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f29580ca680 0x7f29580c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f29580ca680 0x7f29580c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47586/0 (socket says 172.21.15.100:47586) 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 -- 172.21.15.100:0/1549653864 learned_addr learned my addr 172.21.15.100:0/1549653864 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 -- 172.21.15.100:0/1549653864 >> v2:172.21.15.119:3300/0 conn(0x7f29580cc880 msgr2=0x7f29580ccc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f29577fe700 1 --2- 172.21.15.100:0/1549653864 >> v2:172.21.15.119:3300/0 conn(0x7f29580cc880 0x7f29580ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 --2- 172.21.15.100:0/1549653864 >> v2:172.21.15.119:3300/0 conn(0x7f29580cc880 0x7f29580ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 -- 172.21.15.100:0/1549653864 >> v1:172.21.15.119:6789/0 conn(0x7f29580c4060 legacy=0x7f29580c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f2957fff700 1 -- 172.21.15.100:0/1549653864 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580cd1a0 con 0x7f29580ca680 2023-11-17T06:29:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fd0b2014700 1 -- 172.21.15.100:0/2847799612 shutdown_connections 2023-11-17T06:29:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.392+0000 7f281affd700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 0x7f281c0cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28127fc700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0cda90 0x7f281c0cdeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2804009910 tx=0x7f2804009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3c7f5c9cabe72d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f2957fff700 1 --2- 172.21.15.100:0/1549653864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580ca680 0x7f29580c4bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2950009e50 tx=0x7f295000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d2996f3d667cec server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f281a7fc700 1 -- 172.21.15.100:0/1747822630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280400ba60 con 0x7f281c0cda90 2023-11-17T06:29:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fd0b2014700 1 -- 172.21.15.100:0/2847799612 wait complete. 2023-11-17T06:29:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f281a7fc700 1 -- 172.21.15.100:0/1747822630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280400bbc0 con 0x7f281c0cda90 2023-11-17T06:29:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f281a7fc700 1 -- 172.21.15.100:0/1747822630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804009e60 con 0x7f281c0cda90 2023-11-17T06:29:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f29567fc700 1 -- 172.21.15.100:0/1549653864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000e070 con 0x7f29580ca680 2023-11-17T06:29:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f29567fc700 1 -- 172.21.15.100:0/1549653864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295000b980 con 0x7f29580ca680 2023-11-17T06:29:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f29567fc700 1 -- 172.21.15.100:0/1549653864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000e070 con 0x7f29580ca680 2023-11-17T06:29:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 -- 172.21.15.100:0/1747822630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0cda90 msgr2=0x7f281c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0cda90 0x7f281c0cdeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2804009910 tx=0x7f2804009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:48.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fc39ff06700 1 Processor -- start 2023-11-17T06:29:48.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 -- 172.21.15.100:0/1549653864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580ca680 msgr2=0x7f29580c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 --2- 172.21.15.100:0/1549653864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580ca680 0x7f29580c4bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2950009e50 tx=0x7f295000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:48.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 -- 172.21.15.100:0/1747822630 shutdown_connections 2023-11-17T06:29:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fd0b2014700 1 Processor -- start 2023-11-17T06:29:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 -- 172.21.15.100:0/1549653864 shutdown_connections 2023-11-17T06:29:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 --2- 172.21.15.100:0/1549653864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580ca680 0x7f29580c4bd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 --2- 172.21.15.100:0/1549653864 >> v2:172.21.15.119:3300/0 conn(0x7f29580cc880 0x7f29580ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 -- 172.21.15.100:0/1549653864 >> 172.21.15.100:0/1549653864 conn(0x7f29580cb730 msgr2=0x7f29580cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fc39ff06700 1 -- start start 2023-11-17T06:29:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0cda90 0x7f281c0cdeb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 --2- 172.21.15.100:0/1747822630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cfc10 0x7f281c0cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 -- 172.21.15.100:0/1747822630 >> 172.21.15.100:0/1747822630 conn(0x7f281c06b500 msgr2=0x7f281c06b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7fd0b2014700 1 -- start start 2023-11-17T06:29:48.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 -- 172.21.15.100:0/1549653864 shutdown_connections 2023-11-17T06:29:48.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f295cdbc700 1 -- 172.21.15.100:0/1549653864 wait complete. 2023-11-17T06:29:48.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 -- 172.21.15.100:0/1747822630 shutdown_connections 2023-11-17T06:29:48.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.396+0000 7f28219e4700 1 -- 172.21.15.100:0/1747822630 wait complete. 2023-11-17T06:29:48.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a40d5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39ff06700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3980cfc10 0x7fc3980cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39ff06700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3980b6230 0x7fc3980b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39ff06700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3980d0530 con 0x7fc3980cda90 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39ff06700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980ce5c0 con 0x7fc3980cfc10 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39ff06700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980d1480 con 0x7fc3980b6230 2023-11-17T06:29:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 0x7fd0a403a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39dca2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3980cfc10 0x7fc3980cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39d4a1700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc3980cda90 0x7fc3980cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43860/0 (socket says 172.21.15.100:43860) 2023-11-17T06:29:48.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39d4a1700 1 -- 172.21.15.100:0/1469303577 learned_addr learned my addr 172.21.15.100:0/1469303577 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:48.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39e4a3700 1 --2- 172.21.15.100:0/1469303577 >> v2:172.21.15.119:3300/0 conn(0x7fc3980b6230 0x7fc3980b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 0x7fd0a403a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1012700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a40d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1012700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a40d5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46166/0 (socket says 172.21.15.100:46166) 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a404f560 con 0x7fd0a403b2f0 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a404e950 con 0x7fd0a40e4a30 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b2014700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a404ec30 con 0x7fd0a40395d0 2023-11-17T06:29:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906217324 0 0) 0x7fc3980d0530 con 0x7fc3980cda90 2023-11-17T06:29:48.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1012700 1 -- 172.21.15.100:0/2229240034 learned_addr learned my addr 172.21.15.100:0/2229240034 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7f28219e4700 1 Processor -- start 2023-11-17T06:29:48.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 0x7fd0a403a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3840035d0 con 0x7fc3980cda90 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39e4a3700 1 -- 172.21.15.100:0/1469303577 >> v2:172.21.15.100:3300/0 conn(0x7fc3980cfc10 msgr2=0x7fc3980cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39e4a3700 1 --2- 172.21.15.100:0/1469303577 >> v2:172.21.15.100:3300/0 conn(0x7fc3980cfc10 0x7fc3980cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39e4a3700 1 -- 172.21.15.100:0/1469303577 >> v1:172.21.15.119:6789/0 conn(0x7fc3980cda90 legacy=0x7fc3980cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b0811700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 0x7fd0a403a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1813700 1 -- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 msgr2=0x7fd0a40d5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a40d5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fd0b1813700 1 -- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 msgr2=0x7fd0a403a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058221646 0 0) 0x7fc3840035d0 con 0x7fc3980cda90 2023-11-17T06:29:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7fc39e4a3700 1 -- 172.21.15.100:0/1469303577 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980d1760 con 0x7fc3980b6230 2023-11-17T06:29:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.400+0000 7f28219e4700 1 -- start start 2023-11-17T06:29:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f295cdbc700 1 Processor -- start 2023-11-17T06:29:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 0x7fd0a403a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b1813700 1 -- 172.21.15.100:0/2229240034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0094b0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b0811700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 0x7fd0a403a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fc39e4a3700 1 --2- 172.21.15.100:0/1469303577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc3980b66e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc39808c570 tx=0x7fc388009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab470c62de3fd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f295cdbc700 1 -- start start 2023-11-17T06:29:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b1813700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 0x7fd0a403a720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac02d030 tx=0x7fd0ac067250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 Processor -- start 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cda90 0x7f281c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f281c0cfc10 0x7f281c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c151d80 con 0x7f281c0b4cb0 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15f200 con 0x7f281c0cfc10 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28219e4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0c92b0 con 0x7f281c0cda90 2023-11-17T06:29:48.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394001670 con 0x7fc3980b6230 2023-11-17T06:29:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac06b8c0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac06ba20 con 0x7fd0a40e4a30 2023-11-17T06:29:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac06bdd0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a404ef10 con 0x7fd0a40e4a30 2023-11-17T06:29:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388004030 con 0x7fc3980b6230 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fc39cca0700 1 -- 172.21.15.100:0/1469303577 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880043c0 con 0x7fc3980b6230 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47626/0 (socket says 172.21.15.100:47626) 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 -- 172.21.15.100:0/1812089660 learned_addr learned my addr 172.21.15.100:0/1812089660 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f28127fc700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cda90 0x7f281c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281b7fe700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f281c0cfc10 0x7f281c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40501d0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a404f6d0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 -- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cda90 msgr2=0x7f281c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cda90 0x7f281c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 -- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f281c0cfc10 msgr2=0x7f281c0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f281c0cfc10 0x7f281c0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f281affd700 1 -- 172.21.15.100:0/1812089660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2804009570 con 0x7f281c0b4cb0 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 -- start start 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 0x7f0d3c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d3c0cc580 0x7f0d3c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0ce4c0 con 0x7f0d3c06b380 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0c4780 con 0x7f0d3c0cc580 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f0d41405700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0cd8b0 con 0x7f0d3c0c3e60 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f295cdbc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.404+0000 7f295cdbc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 0x7f29580c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f295cdbc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29580cc880 0x7f29580c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f295cdbc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958146940 con 0x7f29580c4060 2023-11-17T06:29:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f295cdbc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c7e40 con 0x7f29580ca680 2023-11-17T06:29:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f295cdbc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c6840 con 0x7f29580cc880 2023-11-17T06:29:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 -- 172.21.15.100:0/1469303577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 msgr2=0x7fc3980b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 --2- 172.21.15.100:0/1469303577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc3980b66e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc39808c570 tx=0x7fc388009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f281affd700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c7f0 tx=0x7f280c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 -- 172.21.15.100:0/1469303577 shutdown_connections 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 --2- 172.21.15.100:0/1469303577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc3980b66e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 --2- 172.21.15.100:0/1469303577 >> v2:172.21.15.100:3300/0 conn(0x7fc3980cfc10 0x7fc3980cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 -- 172.21.15.100:0/1469303577 >> 172.21.15.100:0/1469303577 conn(0x7fc39806b500 msgr2=0x7fc39806b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d3bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 0x7f0d3c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47634/0 (socket says 172.21.15.100:47634) 2023-11-17T06:29:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 -- 172.21.15.100:0/806657178 learned_addr learned my addr 172.21.15.100:0/806657178 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2956ffd700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 0x7f29580c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d3bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 0x7f0d3c0c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34178/0 (socket says 172.21.15.100:34178) 2023-11-17T06:29:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c011800 con 0x7f281c0b4cb0 2023-11-17T06:29:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d3b7fe700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0d3c06b380 0x7f0d3c06e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:43862/0 (socket says 172.21.15.100:43862) 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d3b7fe700 1 -- 172.21.15.100:0/458009033 learned_addr learned my addr 172.21.15.100:0/458009033 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d40c04700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d3c0cc580 0x7f0d3c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2957fff700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29580cc880 0x7f29580c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 -- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29580cc880 msgr2=0x7f29580c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29580cc880 0x7f29580c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 -- 172.21.15.100:0/1469303577 shutdown_connections 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c011960 con 0x7f281c0b4cb0 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 -- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 msgr2=0x7f29580c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 0x7f29580c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 -- 172.21.15.100:0/806657178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950009b30 con 0x7f29580c4060 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2956ffd700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 0x7f29580c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fc39ff06700 1 -- 172.21.15.100:0/1469303577 wait complete. 2023-11-17T06:29:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d40c04700 1 -- 172.21.15.100:0/458009033 >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 msgr2=0x7f0d3c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d40c04700 1 --2- 172.21.15.100:0/458009033 >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 0x7f0d3c0c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d40c04700 1 -- 172.21.15.100:0/458009033 >> v1:172.21.15.119:6789/0 conn(0x7f0d3c06b380 legacy=0x7f0d3c06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f0d40c04700 1 -- 172.21.15.100:0/458009033 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0cdb90 con 0x7f0d3c0cc580 2023-11-17T06:29:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f29577fe700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c740 tx=0x7f294c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c011cd0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0ac093360 con 0x7fd0a40e4a30 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fd0a1ffb700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 0x7fd0900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0ac0fc8e0 con 0x7fd0a40e4a30 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fd0b1012700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 0x7fd0900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f28219e4700 1 -- 172.21.15.100:0/1812089660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c15e8d0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f28219e4700 1 -- 172.21.15.100:0/1812089660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c15ee90 con 0x7f281c0b4cb0 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f28219e4700 1 -- 172.21.15.100:0/1812089660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c04eea0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c004220 con 0x7f29580c4060 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.408+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29580c6b20 con 0x7f29580c4060 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c004380 con 0x7f29580c4060 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29580c7100 con 0x7f29580c4060 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0036c0 con 0x7f29580c4060 2023-11-17T06:29:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fc39ff06700 1 Processor -- start 2023-11-17T06:29:48.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f0d40c04700 1 --2- 172.21.15.100:0/458009033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c06b7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0b3a80 tx=0x7f0d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8127949896b6bee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fd0b1012700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 0x7fd0900689d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8005930 tx=0x7fd0a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fc39ff06700 1 -- start start 2023-11-17T06:29:48.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2938005310 con 0x7f29580c4060 2023-11-17T06:29:48.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f0d3affd700 1 -- 172.21.15.100:0/458009033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400e070 con 0x7f0d3c0cc580 2023-11-17T06:29:48.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f0d3affd700 1 -- 172.21.15.100:0/458009033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400bb20 con 0x7f0d3c0cc580 2023-11-17T06:29:48.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7f0d3affd700 1 -- 172.21.15.100:0/458009033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400be90 con 0x7f0d3c0cc580 2023-11-17T06:29:48.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fc39ff06700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc39815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fc39ff06700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 0x7fc3980c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.412+0000 7fc39ff06700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 0x7fc39814da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39d4a1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 0x7fc3980c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39e4a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 0x7fc39814da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39e4a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 0x7fc39814da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47648/0 (socket says 172.21.15.100:47648) 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39e4a3700 1 -- 172.21.15.100:0/2984446650 learned_addr learned my addr 172.21.15.100:0/2984446650 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc39815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398151080 con 0x7fc3980cfc10 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815ff60 con 0x7fc3980b6230 2023-11-17T06:29:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc398150b00 con 0x7fc3980cda90 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0ac0cd860 con 0x7fd0a40e4a30 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 -- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 msgr2=0x7fc3980c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 0x7fc3980c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 -- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 msgr2=0x7fc39814da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 0x7fc39814da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094b0 con 0x7fc3980b6230 2023-11-17T06:29:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f280c023480 con 0x7f281c0b4cb0 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f2818ff9700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 0x7f27fc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f280c083fc0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f28127fc700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 0x7f27fc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 -- 172.21.15.100:0/458009033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c0cc580 msgr2=0x7f0d3c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 --2- 172.21.15.100:0/458009033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c06b7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0b3a80 tx=0x7f0d3400b330 comp rx=0 tx=0).stop 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 -- 172.21.15.100:0/458009033 shutdown_connections 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 --2- 172.21.15.100:0/458009033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c06b7e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 --2- 172.21.15.100:0/458009033 >> v2:172.21.15.119:3300/0 conn(0x7f0d3c0c3e60 0x7f0d3c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 -- 172.21.15.100:0/458009033 >> 172.21.15.100:0/458009033 conn(0x7f0d3c09a180 msgr2=0x7f0d3c0d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 -- 172.21.15.100:0/458009033 shutdown_connections 2023-11-17T06:29:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f0d41405700 1 -- 172.21.15.100:0/458009033 wait complete. 2023-11-17T06:29:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f294c003820 con 0x7f29580c4060 2023-11-17T06:29:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7f293ffff700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 0x7f29440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39dca2700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc39815fa20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc39000efc0 tx=0x7fc39000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc39d4a1700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 0x7fc3980c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000cdc0 con 0x7fc3980b6230 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.416+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39000f040 con 0x7fc3980b6230 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39814e9b0 con 0x7fc3980b6230 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39814e3f0 con 0x7fc3980b6230 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7f2956ffd700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 0x7f29440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7f28127fc700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 0x7f27fc068a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2804000c00 tx=0x7f2804023040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390014680 con 0x7fc3980b6230 2023-11-17T06:29:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7f0d41405700 1 Processor -- start 2023-11-17T06:29:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc380005310 con 0x7fc3980b6230 2023-11-17T06:29:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7f0d41405700 1 -- start start 2023-11-17T06:29:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.420+0000 7f2956ffd700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 0x7f29440689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29581618a0 tx=0x7f2948009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 0x7f0d3c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f294c055f90 con 0x7f29580c4060 2023-11-17T06:29:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 0x7f0d3c152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3900147e0 con 0x7fc3980b6230 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c14ac00 con 0x7f0d3c06b380 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c152a90 con 0x7f0d3c0cc580 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d41405700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c151690 con 0x7f0d3c0c3e60 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d3b7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 0x7f0d3c152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 0x7f0d3c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d3b7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 0x7f0d3c152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46186/0 (socket says 172.21.15.100:46186) 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 0x7f0d3c1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47654/0 (socket says 172.21.15.100:47654) 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d3b7fe700 1 -- 172.21.15.100:0/793980745 learned_addr learned my addr 172.21.15.100:0/793980745 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f280c0515b0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7fc38e7fc700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 0x7fc37c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3900848d0 con 0x7fc3980b6230 2023-11-17T06:29:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7fc39d4a1700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 0x7fc37c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 -- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 msgr2=0x7f0d3c152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 0x7f0d3c152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 -- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 msgr2=0x7f0d3c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 0x7f0d3c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 -- 172.21.15.100:0/793980745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009a70 con 0x7f0d3c0cc580 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.424+0000 7f0d40c04700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c153390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d34016000 tx=0x7f0d34004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.428+0000 7fc39d4a1700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 0x7fc37c068a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3980b5d00 tx=0x7fc394009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.428+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f294c055660 con 0x7f29580c4060 2023-11-17T06:29:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.432+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34025400 con 0x7f0d3c0cc580 2023-11-17T06:29:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.432+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc390051ec0 con 0x7fc3980b6230 2023-11-17T06:29:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.432+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3401f070 con 0x7f0d3c0cc580 2023-11-17T06:29:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.432+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c1521f0 con 0x7f0d3c0cc580 2023-11-17T06:29:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.432+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c1527b0 con 0x7f0d3c0cc580 2023-11-17T06:29:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.436+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340257c0 con 0x7f0d3c0cc580 2023-11-17T06:29:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.436+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c005310 con 0x7f0d3c0cc580 2023-11-17T06:29:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.436+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d3402d3f0 con 0x7f0d3c0cc580 2023-11-17T06:29:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.440+0000 7f0d38ff9700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 0x7f0d28068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.440+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d340850f0 con 0x7f0d3c0cc580 2023-11-17T06:29:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.440+0000 7f0d3bfff700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 0x7f0d28068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.444+0000 7f0d3bfff700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 0x7f0d28068a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c073720 tx=0x7f0d2c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.448+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d34052660 con 0x7f0d3c0cc580 2023-11-17T06:29:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 Processor -- start 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 -- start start 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f651015f300 0x7f65100cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 0x7f65100b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100b1400 con 0x7f6510161f40 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65100cf4b0 con 0x7f651015f300 2023-11-17T06:29:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.452+0000 7f65167f7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510162c70 con 0x7f65100b0a80 2023-11-17T06:29:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f6514d94700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6510161f40 0x7f65101623b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54492/0 (socket says 172.21.15.100:54492) 2023-11-17T06:29:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f6514d94700 1 -- 172.21.15.100:0/1421837643 learned_addr learned my addr 172.21.15.100:0/1421837643 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 --2- 172.21.15.100:0/1421837643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 0x7f65100b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 -- 172.21.15.100:0/1421837643 >> v2:172.21.15.100:3300/0 conn(0x7f651015f300 msgr2=0x7f65100cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 --2- 172.21.15.100:0/1421837643 >> v2:172.21.15.100:3300/0 conn(0x7f651015f300 0x7f65100cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 -- 172.21.15.100:0/1421837643 >> v1:172.21.15.100:6789/0 conn(0x7f6510161f40 legacy=0x7f65101623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 -- 172.21.15.100:0/1421837643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100ceb10 con 0x7f65100b0a80 2023-11-17T06:29:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f1afa186700 1 Processor -- start 2023-11-17T06:29:48.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f65077fe700 1 --2- 172.21.15.100:0/1421837643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 0x7f65100b0ec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009850 tx=0x7f64f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3da8d5013a3967 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f1afa186700 1 -- start start 2023-11-17T06:29:48.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f650f7fe700 1 -- 172.21.15.100:0/1421837643 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8011830 con 0x7f65100b0a80 2023-11-17T06:29:48.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f650f7fe700 1 -- 172.21.15.100:0/1421837643 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f8011990 con 0x7f65100b0a80 2023-11-17T06:29:48.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f650f7fe700 1 -- 172.21.15.100:0/1421837643 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8011830 con 0x7f65100b0a80 2023-11-17T06:29:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f1afa186700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 0x7f1af415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.456+0000 7f1afa186700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1af40b1230 0x7f1af415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1afa186700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af415a100 con 0x7f1af40c9570 2023-11-17T06:29:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1afa186700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4159b20 con 0x7f1af40b1230 2023-11-17T06:29:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1afa186700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4159d90 con 0x7f1af406a980 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 -- 172.21.15.100:0/1421837643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 msgr2=0x7f65100b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 --2- 172.21.15.100:0/1421837643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 0x7f65100b0ec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009850 tx=0x7f64f8009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 -- 172.21.15.100:0/1421837643 shutdown_connections 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 --2- 172.21.15.100:0/1421837643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65100b0a80 0x7f65100b0ec0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 --2- 172.21.15.100:0/1421837643 >> v2:172.21.15.100:3300/0 conn(0x7f651015f300 0x7f65100cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 -- 172.21.15.100:0/1421837643 >> 172.21.15.100:0/1421837643 conn(0x7f65100737e0 msgr2=0x7f651006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 -- 172.21.15.100:0/1421837643 shutdown_connections 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af37fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 0x7f1af415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af37fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 0x7f1af415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34218/0 (socket says 172.21.15.100:34218) 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1af40b1230 0x7f1af415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1af40b1230 0x7f1af415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47674/0 (socket says 172.21.15.100:47674) 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 -- 172.21.15.100:0/3926549173 learned_addr learned my addr 172.21.15.100:0/3926549173 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f65167f7700 1 -- 172.21.15.100:0/1421837643 wait complete. 2023-11-17T06:29:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 -- 172.21.15.100:0/3926549173 >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 msgr2=0x7f1af415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 --2- 172.21.15.100:0/3926549173 >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 0x7f1af415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 -- 172.21.15.100:0/3926549173 >> v1:172.21.15.100:6789/0 conn(0x7f1af40c9570 legacy=0x7f1af40b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 -- 172.21.15.100:0/3926549173 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40ca180 con 0x7f1af40b1230 2023-11-17T06:29:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.460+0000 7f1af3fff700 1 --2- 172.21.15.100:0/3926549173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af40b1230 0x7f1af415d2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1af4072860 tx=0x7f1aec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22196cc4de35296 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1af2ffd700 1 -- 172.21.15.100:0/3926549173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00e070 con 0x7f1af40b1230 2023-11-17T06:29:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f65167f7700 1 Processor -- start 2023-11-17T06:29:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1af2ffd700 1 -- 172.21.15.100:0/3926549173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00b910 con 0x7f1af40b1230 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1af2ffd700 1 -- 172.21.15.100:0/3926549173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00bcc0 con 0x7f1af40b1230 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f65167f7700 1 -- start start 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 -- 172.21.15.100:0/3926549173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af40b1230 msgr2=0x7f1af415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 --2- 172.21.15.100:0/3926549173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af40b1230 0x7f1af415d2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1af4072860 tx=0x7f1aec00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 -- 172.21.15.100:0/3926549173 shutdown_connections 2023-11-17T06:29:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 --2- 172.21.15.100:0/3926549173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af40b1230 0x7f1af415d2c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 --2- 172.21.15.100:0/3926549173 >> v2:172.21.15.119:3300/0 conn(0x7f1af406a980 0x7f1af415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 -- 172.21.15.100:0/3926549173 >> 172.21.15.100:0/3926549173 conn(0x7f1af40737e0 msgr2=0x7f1af406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 -- 172.21.15.100:0/3926549173 shutdown_connections 2023-11-17T06:29:48.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f1afa186700 1 -- 172.21.15.100:0/3926549173 wait complete. 2023-11-17T06:29:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f65167f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7fcfd7335700 1 Processor -- start 2023-11-17T06:29:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f65167f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651015f300 0x7f651014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7fcfd7335700 1 -- start start 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f650ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f650ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34234/0 (socket says 172.21.15.100:34234) 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.464+0000 7f65167f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6510161f40 0x7f65100c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 -- 172.21.15.100:0/3896415156 learned_addr learned my addr 172.21.15.100:0/3896415156 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651014ec00 con 0x7f651015f300 2023-11-17T06:29:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100c70d0 con 0x7f65100b0a80 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65100c73b0 con 0x7f6510161f40 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65077fe700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651015f300 0x7f651014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 -- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6510161f40 msgr2=0x7f65100c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6510161f40 0x7f65100c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 -- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651015f300 msgr2=0x7f651014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651015f300 0x7f651014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80094b0 con 0x7f65100b0a80 2023-11-17T06:29:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f1afa186700 1 Processor -- start 2023-11-17T06:29:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcfd0160a80 0x7fcfd00d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfd00d16f0 0x7fcfd00d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd00ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00b2940 con 0x7fcfd00d16f0 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00d2090 con 0x7fcfd0160a80 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd7335700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00cedb0 con 0x7fcfd00cdc00 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfd00d16f0 0x7fcfd00d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650ffff700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f650000ba50 tx=0x7f650000be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfd00d16f0 0x7fcfd00d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47700/0 (socket says 172.21.15.100:47700) 2023-11-17T06:29:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 -- 172.21.15.100:0/1426737305 learned_addr learned my addr 172.21.15.100:0/1426737305 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd6333700 1 --2- 172.21.15.100:0/1426737305 >> v2:172.21.15.119:3300/0 conn(0x7fcfd0160a80 0x7fcfd00d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f1afa186700 1 -- start start 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd6b34700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd00ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 -- 172.21.15.100:0/1426737305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 msgr2=0x7fcfd00ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd00ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 -- 172.21.15.100:0/1426737305 >> v2:172.21.15.119:3300/0 conn(0x7fcfd0160a80 msgr2=0x7fcfd00d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 --2- 172.21.15.100:0/1426737305 >> v2:172.21.15.119:3300/0 conn(0x7fcfd0160a80 0x7fcfd00d3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7fcfd5b32700 1 -- 172.21.15.100:0/1426737305 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00cf090 con 0x7fcfd00d16f0 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000cab0 con 0x7f65100b0a80 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000cc30 con 0x7f65100b0a80 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500014440 con 0x7f65100b0a80 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65100c7690 con 0x7f65100b0a80 2023-11-17T06:29:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.468+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651014bcb0 con 0x7f65100b0a80 2023-11-17T06:29:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd5b32700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd00d1b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfd009cb50 tx=0x7fcfcc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1773f1691c4275a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af40b1230 0x7f1af40c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651014bea0 con 0x7f65100b0a80 2023-11-17T06:29:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af40c9570 0x7f1af4144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af41536d0 con 0x7f1af406a980 2023-11-17T06:29:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4153970 con 0x7f1af40c9570 2023-11-17T06:29:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4153c50 con 0x7f1af40b1230 2023-11-17T06:29:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd5331700 1 -- 172.21.15.100:0/1426737305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc011830 con 0x7fcfd00d16f0 2023-11-17T06:29:48.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47714/0 (socket says 172.21.15.100:47714) 2023-11-17T06:29:48.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 -- 172.21.15.100:0/3056412638 learned_addr learned my addr 172.21.15.100:0/3056412638 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af3fff700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af40c9570 0x7f1af4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd5331700 1 -- 172.21.15.100:0/1426737305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc011990 con 0x7fcfd00d16f0 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd5331700 1 -- 172.21.15.100:0/1426737305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc011d20 con 0x7fcfd00d16f0 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 -- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af40b1230 msgr2=0x7f1af40c5030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af40b1230 0x7f1af40c5030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 -- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af40c9570 msgr2=0x7f1af4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af40c9570 0x7f1af4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 -- 172.21.15.100:0/3056412638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec009b30 con 0x7f1af406a980 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af37fe700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400e9d0 tx=0x7f1ae400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400c850 con 0x7f1af406a980 2023-11-17T06:29:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400c9b0 con 0x7f1af406a980 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400cd20 con 0x7f1af406a980 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af40c4b10 con 0x7f1af406a980 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af40c47c0 con 0x7f1af406a980 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 -- 172.21.15.100:0/1426737305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 msgr2=0x7fcfd00d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd00d1b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfd009cb50 tx=0x7fcfcc009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 -- 172.21.15.100:0/1426737305 shutdown_connections 2023-11-17T06:29:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd00ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 --2- 172.21.15.100:0/1426737305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd00d1b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 --2- 172.21.15.100:0/1426737305 >> v2:172.21.15.119:3300/0 conn(0x7fcfd0160a80 0x7fcfd00d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.472+0000 7fcfd7335700 1 -- 172.21.15.100:0/1426737305 >> 172.21.15.100:0/1426737305 conn(0x7fcfd009c420 msgr2=0x7fcfd00d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7fcfd7335700 1 -- 172.21.15.100:0/1426737305 shutdown_connections 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7fcfd7335700 1 -- 172.21.15.100:0/1426737305 wait complete. 2023-11-17T06:29:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6500007370 con 0x7f65100b0a80 2023-11-17T06:29:48.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7f650d7fa700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 0x7f64f0068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6500083c70 con 0x7f65100b0a80 2023-11-17T06:29:48.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.476+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1ae4013470 con 0x7f1af406a980 2023-11-17T06:29:48.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 Processor -- start 2023-11-17T06:29:48.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40c4ca0 con 0x7f1af406a980 2023-11-17T06:29:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 -- start start 2023-11-17T06:29:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f65077fe700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 0x7f64f0068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f65077fe700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 0x7f64f0068aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64f80090b0 tx=0x7f64f801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f1af0ff9700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 0x7f1ad40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ae4083ff0 con 0x7f1af406a980 2023-11-17T06:29:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f1aeaffd700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 0x7f1ad40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00cadb0 con 0x7fcfd00d16f0 2023-11-17T06:29:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00ca1c0 con 0x7fcfd0160a80 2023-11-17T06:29:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd7335700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00ca410 con 0x7fcfd00cdc00 2023-11-17T06:29:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd6333700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7f1aeaffd700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 0x7f1ad40689d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1adc000f60 tx=0x7f1adc007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd6b34700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd6b34700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34252/0 (socket says 172.21.15.100:34252) 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.480+0000 7fcfd6b34700 1 -- 172.21.15.100:0/2693313402 learned_addr learned my addr 172.21.15.100:0/2693313402 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 -- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 msgr2=0x7fcfd006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd5b32700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 -- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 msgr2=0x7fcfd014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd014e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 -- 172.21.15.100:0/2693313402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc009570 con 0x7fcfd0160a80 2023-11-17T06:29:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd6b34700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8007d20 tx=0x7fcfc800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800ede0 con 0x7fcfd0160a80 2023-11-17T06:29:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc8007e70 con 0x7fcfd0160a80 2023-11-17T06:29:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8014640 con 0x7fcfd0160a80 2023-11-17T06:29:48.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd00ca6f0 con 0x7fcfd0160a80 2023-11-17T06:29:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.484+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd014eb90 con 0x7fcfd0160a80 2023-11-17T06:29:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.488+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6500051160 con 0x7f65100b0a80 2023-11-17T06:29:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.488+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd00caef0 con 0x7fcfd0160a80 2023-11-17T06:29:48.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.488+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1ae40513d0 con 0x7f1af406a980 2023-11-17T06:29:48.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.488+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcfc80147a0 con 0x7fcfd0160a80 2023-11-17T06:29:48.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.488+0000 7fcfc6ffd700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 0x7fcfb40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:48.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.492+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfc80844a0 con 0x7fcfd0160a80 2023-11-17T06:29:48.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.492+0000 7fcfd6333700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 0x7fcfb40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:48.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.492+0000 7fcfd6333700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 0x7fcfb40689d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009bf0 tx=0x7fcfc0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:48.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.492+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcfd00caef0 con 0x7fcfd0160a80 2023-11-17T06:29:48.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.732+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd0a4055f70 con 0x7fd0a40e4a30 2023-11-17T06:29:48.741 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:48.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.736+0000 7fd0a1ffb700 1 -- 172.21.15.100:0/2229240034 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0ac090020 con 0x7fd0a40e4a30 2023-11-17T06:29:48.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7f28219e4700 1 -- 172.21.15.100:0/1812089660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f281c1609a0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 msgr2=0x7fd0900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 0x7fd0900689d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8005930 tx=0x7fd0a8009040 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 msgr2=0x7fd0a403a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 0x7fd0a403a720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac02d030 tx=0x7fd0ac067250 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 shutdown_connections 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0a40e4a30 0x7fd0a403a720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd090066510 0x7fd0900689d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a403b2f0 0x7fd0a403a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 --2- 172.21.15.100:0/2229240034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0a40395d0 0x7fd0a40d5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 >> 172.21.15.100:0/2229240034 conn(0x7fd0a4053980 msgr2=0x7fd0a4008d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 shutdown_connections 2023-11-17T06:29:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7fd0b2014700 1 -- 172.21.15.100:0/2229240034 wait complete. 2023-11-17T06:29:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2938005890 con 0x7f29580c4060 2023-11-17T06:29:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7f2818ff9700 1 -- 172.21.15.100:0/1812089660 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f280c054bd0 con 0x7f281c0b4cb0 2023-11-17T06:29:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.744+0000 7f293ffff700 1 -- 172.21.15.100:0/806657178 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f294c0551f0 con 0x7f29580c4060 2023-11-17T06:29:48.750 INFO:teuthology.orchestra.run.smithi100.stdout:55834574864 2023-11-17T06:29:48.750 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 msgr2=0x7f29440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 0x7f29440689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29581618a0 tx=0x7f2948009040 comp rx=0 tx=0).stop 2023-11-17T06:29:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 msgr2=0x7f2958146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c740 tx=0x7f294c00ca50 comp rx=0 tx=0).stop 2023-11-17T06:29:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 msgr2=0x7f27fc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 0x7f27fc068a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2804000c00 tx=0x7f2804023040 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 msgr2=0x7f281c1f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c7f0 tx=0x7f280c00cb00 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 shutdown_connections 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29580cc880 0x7f29580c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29580ca680 0x7f29580c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2944066510 0x7f29440689d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 --2- 172.21.15.100:0/806657178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29580c4060 0x7f2958146400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 >> 172.21.15.100:0/806657178 conn(0x7f29580cb730 msgr2=0x7f2958072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 shutdown_connections 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f281c0cfc10 0x7f281c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f281c0cda90 0x7f281c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f27fc066560 0x7f27fc068a20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 --2- 172.21.15.100:0/1812089660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f281c0b4cb0 0x7f281c1f31f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 shutdown_connections 2023-11-17T06:29:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 >> 172.21.15.100:0/1812089660 conn(0x7f281c06b500 msgr2=0x7f281c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f295cdbc700 1 -- 172.21.15.100:0/806657178 wait complete. 2023-11-17T06:29:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 shutdown_connections 2023-11-17T06:29:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.748+0000 7f2811ffb700 1 -- 172.21.15.100:0/1812089660 wait complete. 2023-11-17T06:29:48.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.760+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc380005890 con 0x7fc3980b6230 2023-11-17T06:29:48.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.764+0000 7fc38e7fc700 1 -- 172.21.15.100:0/2984446650 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc390018020 con 0x7fc3980b6230 2023-11-17T06:29:48.771 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:48.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 msgr2=0x7fc37c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 0x7fc37c068a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3980b5d00 tx=0x7fc394009040 comp rx=0 tx=0).stop 2023-11-17T06:29:48.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 msgr2=0x7fc39815fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc39815fa20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc39000efc0 tx=0x7fc39000c3a0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.5 2023-11-17T06:29:48.776 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 shutdown_connections 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc37c066560 0x7fc37c068a20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3980cfc10 0x7fc39814da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3980cda90 0x7fc3980c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 --2- 172.21.15.100:0/2984446650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3980b6230 0x7fc39815fa20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 >> 172.21.15.100:0/2984446650 conn(0x7fc39806b500 msgr2=0x7fc3980b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 shutdown_connections 2023-11-17T06:29:48.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.772+0000 7fc39ff06700 1 -- 172.21.15.100:0/2984446650 wait complete. 2023-11-17T06:29:48.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.776+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0d1c005890 con 0x7f0d3c0cc580 2023-11-17T06:29:48.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.776+0000 7f0d38ff9700 1 -- 172.21.15.100:0/793980745 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d34021020 con 0x7f0d3c0cc580 2023-11-17T06:29:48.781 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:48.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2023-11-17T06:29:48.784 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 msgr2=0x7f0d28068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 0x7f0d28068a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c073720 tx=0x7f0d2c009240 comp rx=0 tx=0).stop 2023-11-17T06:29:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 msgr2=0x7f0d3c153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c153390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d34016000 tx=0x7f0d34004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 shutdown_connections 2023-11-17T06:29:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d3c0cc580 0x7f0d3c153390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d3c0c3e60 0x7f0d3c152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d28066560 0x7f0d28068a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 --2- 172.21.15.100:0/793980745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d3c06b380 0x7f0d3c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 >> 172.21.15.100:0/793980745 conn(0x7f0d3c09a180 msgr2=0x7f0d3c06f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 shutdown_connections 2023-11-17T06:29:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.780+0000 7f0d41405700 1 -- 172.21.15.100:0/793980745 wait complete. 2023-11-17T06:29:48.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574864 got 55834574864 for osd.2 2023-11-17T06:29:48.788 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.792+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f651004eea0 con 0x7f65100b0a80 2023-11-17T06:29:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.792+0000 7f650d7fa700 1 -- 172.21.15.100:0/3896415156 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6500019090 con 0x7f65100b0a80 2023-11-17T06:29:48.796 INFO:teuthology.orchestra.run.smithi100.stdout:55834574863 2023-11-17T06:29:48.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.4 2023-11-17T06:29:48.798 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 msgr2=0x7f64f0068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 0x7f64f0068aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64f80090b0 tx=0x7f64f801c040 comp rx=0 tx=0).stop 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 msgr2=0x7f651014e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f650000ba50 tx=0x7f650000be10 comp rx=0 tx=0).stop 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 shutdown_connections 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6510161f40 0x7f65100c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f64f00665e0 0x7f64f0068aa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651015f300 0x7f651014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 --2- 172.21.15.100:0/3896415156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65100b0a80 0x7f651014e180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 >> 172.21.15.100:0/3896415156 conn(0x7f65100737e0 msgr2=0x7f65100ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 shutdown_connections 2023-11-17T06:29:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.796+0000 7f65167f7700 1 -- 172.21.15.100:0/3896415156 wait complete. 2023-11-17T06:29:48.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.800+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1af4153dc0 con 0x7f1af406a980 2023-11-17T06:29:48.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.800+0000 7f1af0ff9700 1 -- 172.21.15.100:0/3056412638 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ae4017020 con 0x7f1af406a980 2023-11-17T06:29:48.805 INFO:teuthology.orchestra.run.smithi100.stdout:55834574862 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 msgr2=0x7f1ad40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 0x7f1ad40689d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1adc000f60 tx=0x7f1adc007a60 comp rx=0 tx=0).stop 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 msgr2=0x7f1af40ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400e9d0 tx=0x7f1ae400ece0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 shutdown_connections 2023-11-17T06:29:48.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af40c9570 0x7f1af4144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af40b1230 0x7f1af40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1ad4066510 0x7f1ad40689d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 --2- 172.21.15.100:0/3056412638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1af406a980 0x7f1af40ce7d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 >> 172.21.15.100:0/3056412638 conn(0x7f1af40737e0 msgr2=0x7f1af40ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 shutdown_connections 2023-11-17T06:29:48.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.804+0000 7f1afa186700 1 -- 172.21.15.100:0/3056412638 wait complete. 2023-11-17T06:29:48.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.7 2023-11-17T06:29:48.811 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.808+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcfd00caef0 con 0x7fcfd0160a80 2023-11-17T06:29:48.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.808+0000 7fcfc6ffd700 1 -- 172.21.15.100:0/2693313402 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfd00caef0 con 0x7fcfd0160a80 2023-11-17T06:29:48.813 INFO:teuthology.orchestra.run.smithi100.stdout:55834574865 2023-11-17T06:29:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 msgr2=0x7fcfb40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 0x7fcfb40689d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009bf0 tx=0x7fcfc0009240 comp rx=0 tx=0).stop 2023-11-17T06:29:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 msgr2=0x7fcfd014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8007d20 tx=0x7fcfc800e3c0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 shutdown_connections 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfd0160a80 0x7fcfd014e650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcfb4066510 0x7fcfb40689d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd00d16f0 0x7fcfd014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 --2- 172.21.15.100:0/2693313402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfd00cdc00 0x7fcfd006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 >> 172.21.15.100:0/2693313402 conn(0x7fcfd009c420 msgr2=0x7fcfd006b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 shutdown_connections 2023-11-17T06:29:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:48.812+0000 7fcfd7335700 1 -- 172.21.15.100:0/2693313402 wait complete. 2023-11-17T06:29:48.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.3 2023-11-17T06:29:48.819 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.6 2023-11-17T06:29:48.827 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574865 got 55834574865 for osd.1 2023-11-17T06:29:48.836 DEBUG:teuthology.parallel:result is None 2023-11-17T06:29:48.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-17T06:29:48.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:29:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 Processor -- start 2023-11-17T06:29:49.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 -- start start 2023-11-17T06:29:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb4400c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4400ac8c0 0x7fb4400c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400cde60 con 0x7fb4400c47e0 2023-11-17T06:29:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400cd600 con 0x7fb4400ac8c0 2023-11-17T06:29:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44703e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400ce450 con 0x7fb44015d450 2023-11-17T06:29:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44683d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb4400c47e0 0x7fb4400acdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54514/0 (socket says 172.21.15.100:54514) 2023-11-17T06:29:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.040+0000 7fb44683d700 1 -- 172.21.15.100:0/3687666459 learned_addr learned my addr 172.21.15.100:0/3687666459 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:49.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb4400c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44583b700 1 --2- 172.21.15.100:0/3687666459 >> v2:172.21.15.119:3300/0 conn(0x7fb4400ac8c0 0x7fb4400c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701792749 0 0) 0x7fb4400cde60 con 0x7fb4400c47e0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4300035d0 con 0x7fb4400c47e0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287425578 0 0) 0x7fb4300035d0 con 0x7fb4400c47e0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 msgr2=0x7fb4400c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb4400c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 >> v2:172.21.15.119:3300/0 conn(0x7fb4400ac8c0 msgr2=0x7fb4400c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 --2- 172.21.15.100:0/3687666459 >> v2:172.21.15.119:3300/0 conn(0x7fb4400ac8c0 0x7fb4400c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400cd810 con 0x7fb4400c47e0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7fb438001670 con 0x7fb4400c47e0 2023-11-17T06:29:49.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 >> v1:172.21.15.100:6789/0 conn(0x7fb4400c47e0 legacy=0x7fb4400acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb430003a20 0x7fb430003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430004870 0x7fb430004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb430005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400cd600 con 0x7fb430003a20 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400ce450 con 0x7fb430004870 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43000ba30 con 0x7fb44015d450 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb430003a20 0x7fb430003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44583b700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430004870 0x7fb430004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44683d700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb430005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 -- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 msgr2=0x7fb430005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb44015d450 0x7fb430005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 -- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430004870 msgr2=0x7fb430004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430004870 0x7fb430004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 -- 172.21.15.100:0/3687666459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300035d0 con 0x7fb430003a20 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44603c700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb430003a20 0x7fb430003e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb434009fc0 tx=0x7fb4300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccab156135683377 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ebd0 con 0x7fb430003a20 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400f040 con 0x7fb430003a20 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.044+0000 7fb44503a700 1 -- 172.21.15.100:0/3687666459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434014480 con 0x7fb430003a20 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 -- 172.21.15.100:0/3687666459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb430003a20 msgr2=0x7fb430003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 --2- 172.21.15.100:0/3687666459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb430003a20 0x7fb430003e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb434009fc0 tx=0x7fb4300058a0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44683d700 1 -- 172.21.15.100:0/3687666459 reap_dead start 2023-11-17T06:29:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 -- 172.21.15.100:0/3687666459 shutdown_connections 2023-11-17T06:29:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 -- 172.21.15.100:0/3687666459 >> 172.21.15.100:0/3687666459 conn(0x7fb4400cb730 msgr2=0x7fb4400cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 -- 172.21.15.100:0/3687666459 shutdown_connections 2023-11-17T06:29:49.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.048+0000 7fb44703e700 1 -- 172.21.15.100:0/3687666459 wait complete. 2023-11-17T06:29:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 Processor -- start 2023-11-17T06:29:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 -- start start 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430003a20 0x7fb440156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 0x7fb4400ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400cd470 con 0x7fb4400b1b90 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4401f3870 con 0x7fb430003a20 2023-11-17T06:29:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400b28c0 con 0x7fb4400ccab0 2023-11-17T06:29:49.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47752/0 (socket says 172.21.15.100:47752) 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 -- 172.21.15.100:0/3710588565 learned_addr learned my addr 172.21.15.100:0/3710588565 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44603c700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430003a20 0x7fb440156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44583b700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 0x7fb4400ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 -- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 msgr2=0x7fb4400ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 0x7fb4400ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 -- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430003a20 msgr2=0x7fb440156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430003a20 0x7fb440156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 -- 172.21.15.100:0/3710588565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400b2de0 con 0x7fb4400b1b90 2023-11-17T06:29:49.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44583b700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 0x7fb4400ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44683d700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb44006f350 tx=0x7fb438007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438011580 con 0x7fb4400b1b90 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380116e0 con 0x7fb4400b1b90 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.052+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4400b30c0 con 0x7fb4400b1b90 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.056+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438011a90 con 0x7fb4400b1b90 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.056+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4400b3680 con 0x7fb4400b1b90 2023-11-17T06:29:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.056+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb440065e90 con 0x7fb4400b1b90 2023-11-17T06:29:49.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.056+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb438011bf0 con 0x7fb4400b1b90 2023-11-17T06:29:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.060+0000 7fb43effd700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 0x7fb4240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.060+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb438083e80 con 0x7fb4400b1b90 2023-11-17T06:29:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.060+0000 7fb44603c700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 0x7fb4240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.060+0000 7fb44603c700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 0x7fb4240689d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb434000f80 tx=0x7fb434013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.068+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb438051270 con 0x7fb4400b1b90 2023-11-17T06:29:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.228+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4400cdaf0 con 0x7fb424066510 2023-11-17T06:29:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.240+0000 7fb43effd700 1 -- 172.21.15.100:0/3710588565 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286596 (secure 0 0 0) 0x7fb434003a40 con 0x7fb424066510 2023-11-17T06:29:49.248 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 msgr2=0x7fb4240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 0x7fb4240689d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb434000f80 tx=0x7fb434013000 comp rx=0 tx=0).stop 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 msgr2=0x7fb4400b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb44006f350 tx=0x7fb438007570 comp rx=0 tx=0).stop 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 shutdown_connections 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb424066510 0x7fb4240689d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4400b1b90 0x7fb4400b2010 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4400ccab0 0x7fb4400ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 --2- 172.21.15.100:0/3710588565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb430003a20 0x7fb440156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 >> 172.21.15.100:0/3710588565 conn(0x7fb4400cb730 msgr2=0x7fb4400af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 shutdown_connections 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.248+0000 7fb44703e700 1 -- 172.21.15.100:0/3710588565 wait complete. 2023-11-17T06:29:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:29:49.273 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-11-17T06:29:47.265682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219200,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755520,"statfs":{"total":773094113280,"available":772869652480,"internally_reserved":0,"allocated":3088384,"data_stored":1830564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002820"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152090+0000","last_change":"2023-11-17T06:29:40.063019+0000","last_active":"2023-11-17T06:29:41.152090+0000","last_peered":"2023-11-17T06:29:41.152090+0000","last_clean":"2023-11-17T06:29:41.152090+0000","last_became_active":"2023-11-17T06:29:40.062726+0000","last_became_peered":"2023-11-17T06:29:40.062726+0000","last_unstale":"2023-11-17T06:29:41.152090+0000","last_undegraded":"2023-11-17T06:29:41.152090+0000","last_fullsized":"2023-11-17T06:29:41.152090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107932+0000","last_change":"2023-11-17T06:29:40.059039+0000","last_active":"2023-11-17T06:29:41.107932+0000","last_peered":"2023-11-17T06:29:41.107932+0000","last_clean":"2023-11-17T06:29:41.107932+0000","last_became_active":"2023-11-17T06:29:40.058738+0000","last_became_peered":"2023-11-17T06:29:40.058738+0000","last_unstale":"2023-11-17T06:29:41.107932+0000","last_undegraded":"2023-11-17T06:29:41.107932+0000","last_fullsized":"2023-11-17T06:29:41.107932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189875+0000","last_change":"2023-11-17T06:29:40.036396+0000","last_active":"2023-11-17T06:29:41.189875+0000","last_peered":"2023-11-17T06:29:41.189875+0000","last_clean":"2023-11-17T06:29:41.189875+0000","last_became_active":"2023-11-17T06:29:40.034856+0000","last_became_peered":"2023-11-17T06:29:40.034856+0000","last_unstale":"2023-11-17T06:29:41.189875+0000","last_undegraded":"2023-11-17T06:29:41.189875+0000","last_fullsized":"2023-11-17T06:29:41.189875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036505+0000","last_change":"2023-11-17T06:29:40.054375+0000","last_active":"2023-11-17T06:29:41.036505+0000","last_peered":"2023-11-17T06:29:41.036505+0000","last_clean":"2023-11-17T06:29:41.036505+0000","last_became_active":"2023-11-17T06:29:40.054057+0000","last_became_peered":"2023-11-17T06:29:40.054057+0000","last_unstale":"2023-11-17T06:29:41.036505+0000","last_undegraded":"2023-11-17T06:29:41.036505+0000","last_fullsized":"2023-11-17T06:29:41.036505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151486+0000","last_change":"2023-11-17T06:29:40.043645+0000","last_active":"2023-11-17T06:29:41.151486+0000","last_peered":"2023-11-17T06:29:41.151486+0000","last_clean":"2023-11-17T06:29:41.151486+0000","last_became_active":"2023-11-17T06:29:40.043104+0000","last_became_peered":"2023-11-17T06:29:40.043104+0000","last_unstale":"2023-11-17T06:29:41.151486+0000","last_undegraded":"2023-11-17T06:29:41.151486+0000","last_fullsized":"2023-11-17T06:29:41.151486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036135+0000","last_change":"2023-11-17T06:29:40.058390+0000","last_active":"2023-11-17T06:29:41.036135+0000","last_peered":"2023-11-17T06:29:41.036135+0000","last_clean":"2023-11-17T06:29:41.036135+0000","last_became_active":"2023-11-17T06:29:40.058051+0000","last_became_peered":"2023-11-17T06:29:40.058051+0000","last_unstale":"2023-11-17T06:29:41.036135+0000","last_undegraded":"2023-11-17T06:29:41.036135+0000","last_fullsized":"2023-11-17T06:29:41.036135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151241+0000","last_change":"2023-11-17T06:29:40.033175+0000","last_active":"2023-11-17T06:29:41.151241+0000","last_peered":"2023-11-17T06:29:41.151241+0000","last_clean":"2023-11-17T06:29:41.151241+0000","last_became_active":"2023-11-17T06:29:40.032870+0000","last_became_peered":"2023-11-17T06:29:40.032870+0000","last_unstale":"2023-11-17T06:29:41.151241+0000","last_undegraded":"2023-11-17T06:29:41.151241+0000","last_fullsized":"2023-11-17T06:29:41.151241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187178+0000","last_change":"2023-11-17T06:29:40.067796+0000","last_active":"2023-11-17T06:29:41.187178+0000","last_peered":"2023-11-17T06:29:41.187178+0000","last_clean":"2023-11-17T06:29:41.187178+0000","last_became_active":"2023-11-17T06:29:40.067549+0000","last_became_peered":"2023-11-17T06:29:40.067549+0000","last_unstale":"2023-11-17T06:29:41.187178+0000","last_undegraded":"2023-11-17T06:29:41.187178+0000","last_fullsized":"2023-11-17T06:29:41.187178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152224+0000","last_change":"2023-11-17T06:29:40.053086+0000","last_active":"2023-11-17T06:29:41.152224+0000","last_peered":"2023-11-17T06:29:41.152224+0000","last_clean":"2023-11-17T06:29:41.152224+0000","last_became_active":"2023-11-17T06:29:40.052820+0000","last_became_peered":"2023-11-17T06:29:40.052820+0000","last_unstale":"2023-11-17T06:29:41.152224+0000","last_undegraded":"2023-11-17T06:29:41.152224+0000","last_fullsized":"2023-11-17T06:29:41.152224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:34:42.735002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187565+0000","last_change":"2023-11-17T06:29:40.067431+0000","last_active":"2023-11-17T06:29:41.187565+0000","last_peered":"2023-11-17T06:29:41.187565+0000","last_clean":"2023-11-17T06:29:41.187565+0000","last_became_active":"2023-11-17T06:29:40.067106+0000","last_became_peered":"2023-11-17T06:29:40.067106+0000","last_unstale":"2023-11-17T06:29:41.187565+0000","last_undegraded":"2023-11-17T06:29:41.187565+0000","last_fullsized":"2023-11-17T06:29:41.187565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187309+0000","last_change":"2023-11-17T06:29:40.069847+0000","last_active":"2023-11-17T06:29:41.187309+0000","last_peered":"2023-11-17T06:29:41.187309+0000","last_clean":"2023-11-17T06:29:41.187309+0000","last_became_active":"2023-11-17T06:29:40.069567+0000","last_became_peered":"2023-11-17T06:29:40.069567+0000","last_unstale":"2023-11-17T06:29:41.187309+0000","last_undegraded":"2023-11-17T06:29:41.187309+0000","last_fullsized":"2023-11-17T06:29:41.187309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039102+0000","last_change":"2023-11-17T06:29:40.055649+0000","last_active":"2023-11-17T06:29:41.039102+0000","last_peered":"2023-11-17T06:29:41.039102+0000","last_clean":"2023-11-17T06:29:41.039102+0000","last_became_active":"2023-11-17T06:29:40.054763+0000","last_became_peered":"2023-11-17T06:29:40.054763+0000","last_unstale":"2023-11-17T06:29:41.039102+0000","last_undegraded":"2023-11-17T06:29:41.039102+0000","last_fullsized":"2023-11-17T06:29:41.039102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187571+0000","last_change":"2023-11-17T06:29:40.056634+0000","last_active":"2023-11-17T06:29:41.187571+0000","last_peered":"2023-11-17T06:29:41.187571+0000","last_clean":"2023-11-17T06:29:41.187571+0000","last_became_active":"2023-11-17T06:29:40.055547+0000","last_became_peered":"2023-11-17T06:29:40.055547+0000","last_unstale":"2023-11-17T06:29:41.187571+0000","last_undegraded":"2023-11-17T06:29:41.187571+0000","last_fullsized":"2023-11-17T06:29:41.187571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189196+0000","last_change":"2023-11-17T06:29:40.038547+0000","last_active":"2023-11-17T06:29:41.189196+0000","last_peered":"2023-11-17T06:29:41.189196+0000","last_clean":"2023-11-17T06:29:41.189196+0000","last_became_active":"2023-11-17T06:29:40.038231+0000","last_became_peered":"2023-11-17T06:29:40.038231+0000","last_unstale":"2023-11-17T06:29:41.189196+0000","last_undegraded":"2023-11-17T06:29:41.189196+0000","last_fullsized":"2023-11-17T06:29:41.189196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107274+0000","last_change":"2023-11-17T06:29:40.051827+0000","last_active":"2023-11-17T06:29:41.107274+0000","last_peered":"2023-11-17T06:29:41.107274+0000","last_clean":"2023-11-17T06:29:41.107274+0000","last_became_active":"2023-11-17T06:29:40.051501+0000","last_became_peered":"2023-11-17T06:29:40.051501+0000","last_unstale":"2023-11-17T06:29:41.107274+0000","last_undegraded":"2023-11-17T06:29:41.107274+0000","last_fullsized":"2023-11-17T06:29:41.107274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036003+0000","last_change":"2023-11-17T06:29:40.059452+0000","last_active":"2023-11-17T06:29:41.036003+0000","last_peered":"2023-11-17T06:29:41.036003+0000","last_clean":"2023-11-17T06:29:41.036003+0000","last_became_active":"2023-11-17T06:29:40.059183+0000","last_became_peered":"2023-11-17T06:29:40.059183+0000","last_unstale":"2023-11-17T06:29:41.036003+0000","last_undegraded":"2023-11-17T06:29:41.036003+0000","last_fullsized":"2023-11-17T06:29:41.036003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036860+0000","last_change":"2023-11-17T06:29:40.042601+0000","last_active":"2023-11-17T06:29:41.036860+0000","last_peered":"2023-11-17T06:29:41.036860+0000","last_clean":"2023-11-17T06:29:41.036860+0000","last_became_active":"2023-11-17T06:29:40.042331+0000","last_became_peered":"2023-11-17T06:29:40.042331+0000","last_unstale":"2023-11-17T06:29:41.036860+0000","last_undegraded":"2023-11-17T06:29:41.036860+0000","last_fullsized":"2023-11-17T06:29:41.036860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034229+0000","last_change":"2023-11-17T06:29:40.060783+0000","last_active":"2023-11-17T06:29:41.034229+0000","last_peered":"2023-11-17T06:29:41.034229+0000","last_clean":"2023-11-17T06:29:41.034229+0000","last_became_active":"2023-11-17T06:29:40.060402+0000","last_became_peered":"2023-11-17T06:29:40.060402+0000","last_unstale":"2023-11-17T06:29:41.034229+0000","last_undegraded":"2023-11-17T06:29:41.034229+0000","last_fullsized":"2023-11-17T06:29:41.034229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152132+0000","last_change":"2023-11-17T06:29:40.036086+0000","last_active":"2023-11-17T06:29:41.152132+0000","last_peered":"2023-11-17T06:29:41.152132+0000","last_clean":"2023-11-17T06:29:41.152132+0000","last_became_active":"2023-11-17T06:29:40.035726+0000","last_became_peered":"2023-11-17T06:29:40.035726+0000","last_unstale":"2023-11-17T06:29:41.152132+0000","last_undegraded":"2023-11-17T06:29:41.152132+0000","last_fullsized":"2023-11-17T06:29:41.152132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:32:30.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:40.054009+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:40.053676+0000","last_became_peered":"2023-11-17T06:29:40.053676+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188829+0000","last_change":"2023-11-17T06:29:40.030845+0000","last_active":"2023-11-17T06:29:41.188829+0000","last_peered":"2023-11-17T06:29:41.188829+0000","last_clean":"2023-11-17T06:29:41.188829+0000","last_became_active":"2023-11-17T06:29:40.030543+0000","last_became_peered":"2023-11-17T06:29:40.030543+0000","last_unstale":"2023-11-17T06:29:41.188829+0000","last_undegraded":"2023-11-17T06:29:41.188829+0000","last_fullsized":"2023-11-17T06:29:41.188829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:58.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036380+0000","last_change":"2023-11-17T06:29:40.044683+0000","last_active":"2023-11-17T06:29:41.036380+0000","last_peered":"2023-11-17T06:29:41.036380+0000","last_clean":"2023-11-17T06:29:41.036380+0000","last_became_active":"2023-11-17T06:29:40.044388+0000","last_became_peered":"2023-11-17T06:29:40.044388+0000","last_unstale":"2023-11-17T06:29:41.036380+0000","last_undegraded":"2023-11-17T06:29:41.036380+0000","last_fullsized":"2023-11-17T06:29:41.036380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187189+0000","last_change":"2023-11-17T06:29:40.053205+0000","last_active":"2023-11-17T06:29:41.187189+0000","last_peered":"2023-11-17T06:29:41.187189+0000","last_clean":"2023-11-17T06:29:41.187189+0000","last_became_active":"2023-11-17T06:29:40.052089+0000","last_became_peered":"2023-11-17T06:29:40.052089+0000","last_unstale":"2023-11-17T06:29:41.187189+0000","last_undegraded":"2023-11-17T06:29:41.187189+0000","last_fullsized":"2023-11-17T06:29:41.187189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036256+0000","last_change":"2023-11-17T06:29:40.043201+0000","last_active":"2023-11-17T06:29:41.036256+0000","last_peered":"2023-11-17T06:29:41.036256+0000","last_clean":"2023-11-17T06:29:41.036256+0000","last_became_active":"2023-11-17T06:29:40.042925+0000","last_became_peered":"2023-11-17T06:29:40.042925+0000","last_unstale":"2023-11-17T06:29:41.036256+0000","last_undegraded":"2023-11-17T06:29:41.036256+0000","last_fullsized":"2023-11-17T06:29:41.036256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189502+0000","last_change":"2023-11-17T06:29:40.051636+0000","last_active":"2023-11-17T06:29:41.189502+0000","last_peered":"2023-11-17T06:29:41.189502+0000","last_clean":"2023-11-17T06:29:41.189502+0000","last_became_active":"2023-11-17T06:29:40.051367+0000","last_became_peered":"2023-11-17T06:29:40.051367+0000","last_unstale":"2023-11-17T06:29:41.189502+0000","last_undegraded":"2023-11-17T06:29:41.189502+0000","last_fullsized":"2023-11-17T06:29:41.189502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187655+0000","last_change":"2023-11-17T06:29:40.048676+0000","last_active":"2023-11-17T06:29:41.187655+0000","last_peered":"2023-11-17T06:29:41.187655+0000","last_clean":"2023-11-17T06:29:41.187655+0000","last_became_active":"2023-11-17T06:29:40.048373+0000","last_became_peered":"2023-11-17T06:29:40.048373+0000","last_unstale":"2023-11-17T06:29:41.187655+0000","last_undegraded":"2023-11-17T06:29:41.187655+0000","last_fullsized":"2023-11-17T06:29:41.187655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107920+0000","last_change":"2023-11-17T06:29:40.048999+0000","last_active":"2023-11-17T06:29:41.107920+0000","last_peered":"2023-11-17T06:29:41.107920+0000","last_clean":"2023-11-17T06:29:41.107920+0000","last_became_active":"2023-11-17T06:29:40.048673+0000","last_became_peered":"2023-11-17T06:29:40.048673+0000","last_unstale":"2023-11-17T06:29:41.107920+0000","last_undegraded":"2023-11-17T06:29:41.107920+0000","last_fullsized":"2023-11-17T06:29:41.107920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187923+0000","last_change":"2023-11-17T06:29:40.049137+0000","last_active":"2023-11-17T06:29:41.187923+0000","last_peered":"2023-11-17T06:29:41.187923+0000","last_clean":"2023-11-17T06:29:41.187923+0000","last_became_active":"2023-11-17T06:29:40.047540+0000","last_became_peered":"2023-11-17T06:29:40.047540+0000","last_unstale":"2023-11-17T06:29:41.187923+0000","last_undegraded":"2023-11-17T06:29:41.187923+0000","last_fullsized":"2023-11-17T06:29:41.187923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189050+0000","last_change":"2023-11-17T06:29:40.044520+0000","last_active":"2023-11-17T06:29:41.189050+0000","last_peered":"2023-11-17T06:29:41.189050+0000","last_clean":"2023-11-17T06:29:41.189050+0000","last_became_active":"2023-11-17T06:29:40.044262+0000","last_became_peered":"2023-11-17T06:29:40.044262+0000","last_unstale":"2023-11-17T06:29:41.189050+0000","last_undegraded":"2023-11-17T06:29:41.189050+0000","last_fullsized":"2023-11-17T06:29:41.189050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036714+0000","last_change":"2023-11-17T06:29:40.051605+0000","last_active":"2023-11-17T06:29:41.036714+0000","last_peered":"2023-11-17T06:29:41.036714+0000","last_clean":"2023-11-17T06:29:41.036714+0000","last_became_active":"2023-11-17T06:29:40.051341+0000","last_became_peered":"2023-11-17T06:29:40.051341+0000","last_unstale":"2023-11-17T06:29:41.036714+0000","last_undegraded":"2023-11-17T06:29:41.036714+0000","last_fullsized":"2023-11-17T06:29:41.036714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034092+0000","last_change":"2023-11-17T06:29:40.033266+0000","last_active":"2023-11-17T06:29:41.034092+0000","last_peered":"2023-11-17T06:29:41.034092+0000","last_clean":"2023-11-17T06:29:41.034092+0000","last_became_active":"2023-11-17T06:29:40.032947+0000","last_became_peered":"2023-11-17T06:29:40.032947+0000","last_unstale":"2023-11-17T06:29:41.034092+0000","last_undegraded":"2023-11-17T06:29:41.034092+0000","last_fullsized":"2023-11-17T06:29:41.034092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187145+0000","last_change":"2023-11-17T06:29:40.061167+0000","last_active":"2023-11-17T06:29:41.187145+0000","last_peered":"2023-11-17T06:29:41.187145+0000","last_clean":"2023-11-17T06:29:41.187145+0000","last_became_active":"2023-11-17T06:29:40.060764+0000","last_became_peered":"2023-11-17T06:29:40.060764+0000","last_unstale":"2023-11-17T06:29:41.187145+0000","last_undegraded":"2023-11-17T06:29:41.187145+0000","last_fullsized":"2023-11-17T06:29:41.187145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038784+0000","last_change":"2023-11-17T06:29:40.049645+0000","last_active":"2023-11-17T06:29:41.038784+0000","last_peered":"2023-11-17T06:29:41.038784+0000","last_clean":"2023-11-17T06:29:41.038784+0000","last_became_active":"2023-11-17T06:29:40.049273+0000","last_became_peered":"2023-11-17T06:29:40.049273+0000","last_unstale":"2023-11-17T06:29:41.038784+0000","last_undegraded":"2023-11-17T06:29:41.038784+0000","last_fullsized":"2023-11-17T06:29:41.038784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:55:28.543526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187800+0000","last_change":"2023-11-17T06:29:39.017855+0000","last_active":"2023-11-17T06:29:41.187800+0000","last_peered":"2023-11-17T06:29:41.187800+0000","last_clean":"2023-11-17T06:29:41.187800+0000","last_became_active":"2023-11-17T06:29:39.017537+0000","last_became_peered":"2023-11-17T06:29:39.017537+0000","last_unstale":"2023-11-17T06:29:41.187800+0000","last_undegraded":"2023-11-17T06:29:41.187800+0000","last_fullsized":"2023-11-17T06:29:41.187800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188971+0000","last_change":"2023-11-17T06:29:40.055514+0000","last_active":"2023-11-17T06:29:41.188971+0000","last_peered":"2023-11-17T06:29:41.188971+0000","last_clean":"2023-11-17T06:29:41.188971+0000","last_became_active":"2023-11-17T06:29:40.055200+0000","last_became_peered":"2023-11-17T06:29:40.055200+0000","last_unstale":"2023-11-17T06:29:41.188971+0000","last_undegraded":"2023-11-17T06:29:41.188971+0000","last_fullsized":"2023-11-17T06:29:41.188971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:40.599968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187590+0000","last_change":"2023-11-17T06:29:39.020908+0000","last_active":"2023-11-17T06:29:41.187590+0000","last_peered":"2023-11-17T06:29:41.187590+0000","last_clean":"2023-11-17T06:29:41.187590+0000","last_became_active":"2023-11-17T06:29:39.020586+0000","last_became_peered":"2023-11-17T06:29:39.020586+0000","last_unstale":"2023-11-17T06:29:41.187590+0000","last_undegraded":"2023-11-17T06:29:41.187590+0000","last_fullsized":"2023-11-17T06:29:41.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187260+0000","last_change":"2023-11-17T06:29:39.021831+0000","last_active":"2023-11-17T06:29:41.187260+0000","last_peered":"2023-11-17T06:29:41.187260+0000","last_clean":"2023-11-17T06:29:41.187260+0000","last_became_active":"2023-11-17T06:29:39.019316+0000","last_became_peered":"2023-11-17T06:29:39.019316+0000","last_unstale":"2023-11-17T06:29:41.187260+0000","last_undegraded":"2023-11-17T06:29:41.187260+0000","last_fullsized":"2023-11-17T06:29:41.187260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187226+0000","last_change":"2023-11-17T06:29:40.045533+0000","last_active":"2023-11-17T06:29:41.187226+0000","last_peered":"2023-11-17T06:29:41.187226+0000","last_clean":"2023-11-17T06:29:41.187226+0000","last_became_active":"2023-11-17T06:29:40.045114+0000","last_became_peered":"2023-11-17T06:29:40.045114+0000","last_unstale":"2023-11-17T06:29:41.187226+0000","last_undegraded":"2023-11-17T06:29:41.187226+0000","last_fullsized":"2023-11-17T06:29:41.187226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036436+0000","last_change":"2023-11-17T06:29:39.017157+0000","last_active":"2023-11-17T06:29:41.036436+0000","last_peered":"2023-11-17T06:29:41.036436+0000","last_clean":"2023-11-17T06:29:41.036436+0000","last_became_active":"2023-11-17T06:29:39.016730+0000","last_became_peered":"2023-11-17T06:29:39.016730+0000","last_unstale":"2023-11-17T06:29:41.036436+0000","last_undegraded":"2023-11-17T06:29:41.036436+0000","last_fullsized":"2023-11-17T06:29:41.036436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107184+0000","last_change":"2023-11-17T06:29:40.049925+0000","last_active":"2023-11-17T06:29:41.107184+0000","last_peered":"2023-11-17T06:29:41.107184+0000","last_clean":"2023-11-17T06:29:41.107184+0000","last_became_active":"2023-11-17T06:29:40.049606+0000","last_became_peered":"2023-11-17T06:29:40.049606+0000","last_unstale":"2023-11-17T06:29:41.107184+0000","last_undegraded":"2023-11-17T06:29:41.107184+0000","last_fullsized":"2023-11-17T06:29:41.107184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187631+0000","last_change":"2023-11-17T06:29:39.022881+0000","last_active":"2023-11-17T06:29:41.187631+0000","last_peered":"2023-11-17T06:29:41.187631+0000","last_clean":"2023-11-17T06:29:41.187631+0000","last_became_active":"2023-11-17T06:29:39.022626+0000","last_became_peered":"2023-11-17T06:29:39.022626+0000","last_unstale":"2023-11-17T06:29:41.187631+0000","last_undegraded":"2023-11-17T06:29:41.187631+0000","last_fullsized":"2023-11-17T06:29:41.187631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036999+0000","last_change":"2023-11-17T06:29:40.064114+0000","last_active":"2023-11-17T06:29:41.036999+0000","last_peered":"2023-11-17T06:29:41.036999+0000","last_clean":"2023-11-17T06:29:41.036999+0000","last_became_active":"2023-11-17T06:29:40.063813+0000","last_became_peered":"2023-11-17T06:29:40.063813+0000","last_unstale":"2023-11-17T06:29:41.036999+0000","last_undegraded":"2023-11-17T06:29:41.036999+0000","last_fullsized":"2023-11-17T06:29:41.036999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037198+0000","last_change":"2023-11-17T06:29:39.021771+0000","last_active":"2023-11-17T06:29:41.037198+0000","last_peered":"2023-11-17T06:29:41.037198+0000","last_clean":"2023-11-17T06:29:41.037198+0000","last_became_active":"2023-11-17T06:29:39.020672+0000","last_became_peered":"2023-11-17T06:29:39.020672+0000","last_unstale":"2023-11-17T06:29:41.037198+0000","last_undegraded":"2023-11-17T06:29:41.037198+0000","last_fullsized":"2023-11-17T06:29:41.037198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:51.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189905+0000","last_change":"2023-11-17T06:29:40.034173+0000","last_active":"2023-11-17T06:29:41.189905+0000","last_peered":"2023-11-17T06:29:41.189905+0000","last_clean":"2023-11-17T06:29:41.189905+0000","last_became_active":"2023-11-17T06:29:40.033194+0000","last_became_peered":"2023-11-17T06:29:40.033194+0000","last_unstale":"2023-11-17T06:29:41.189905+0000","last_undegraded":"2023-11-17T06:29:41.189905+0000","last_fullsized":"2023-11-17T06:29:41.189905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107726+0000","last_change":"2023-11-17T06:29:39.017388+0000","last_active":"2023-11-17T06:29:41.107726+0000","last_peered":"2023-11-17T06:29:41.107726+0000","last_clean":"2023-11-17T06:29:41.107726+0000","last_became_active":"2023-11-17T06:29:39.017072+0000","last_became_peered":"2023-11-17T06:29:39.017072+0000","last_unstale":"2023-11-17T06:29:41.107726+0000","last_undegraded":"2023-11-17T06:29:41.107726+0000","last_fullsized":"2023-11-17T06:29:41.107726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039292+0000","last_change":"2023-11-17T06:29:40.047302+0000","last_active":"2023-11-17T06:29:41.039292+0000","last_peered":"2023-11-17T06:29:41.039292+0000","last_clean":"2023-11-17T06:29:41.039292+0000","last_became_active":"2023-11-17T06:29:40.043674+0000","last_became_peered":"2023-11-17T06:29:40.043674+0000","last_unstale":"2023-11-17T06:29:41.039292+0000","last_undegraded":"2023-11-17T06:29:41.039292+0000","last_fullsized":"2023-11-17T06:29:41.039292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:39.017824+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:39.016946+0000","last_became_peered":"2023-11-17T06:29:39.016946+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.049717+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.048800+0000","last_became_peered":"2023-11-17T06:29:40.048800+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189065+0000","last_change":"2023-11-17T06:29:39.015752+0000","last_active":"2023-11-17T06:29:41.189065+0000","last_peered":"2023-11-17T06:29:41.189065+0000","last_clean":"2023-11-17T06:29:41.189065+0000","last_became_active":"2023-11-17T06:29:39.015186+0000","last_became_peered":"2023-11-17T06:29:39.015186+0000","last_unstale":"2023-11-17T06:29:41.189065+0000","last_undegraded":"2023-11-17T06:29:41.189065+0000","last_fullsized":"2023-11-17T06:29:41.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189437+0000","last_change":"2023-11-17T06:29:40.031730+0000","last_active":"2023-11-17T06:29:41.189437+0000","last_peered":"2023-11-17T06:29:41.189437+0000","last_clean":"2023-11-17T06:29:41.189437+0000","last_became_active":"2023-11-17T06:29:40.031393+0000","last_became_peered":"2023-11-17T06:29:40.031393+0000","last_unstale":"2023-11-17T06:29:41.189437+0000","last_undegraded":"2023-11-17T06:29:41.189437+0000","last_fullsized":"2023-11-17T06:29:41.189437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037146+0000","last_change":"2023-11-17T06:29:39.018521+0000","last_active":"2023-11-17T06:29:41.037146+0000","last_peered":"2023-11-17T06:29:41.037146+0000","last_clean":"2023-11-17T06:29:41.037146+0000","last_became_active":"2023-11-17T06:29:39.016769+0000","last_became_peered":"2023-11-17T06:29:39.016769+0000","last_unstale":"2023-11-17T06:29:41.037146+0000","last_undegraded":"2023-11-17T06:29:41.037146+0000","last_fullsized":"2023-11-17T06:29:41.037146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:24.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151548+0000","last_change":"2023-11-17T06:29:40.058720+0000","last_active":"2023-11-17T06:29:41.151548+0000","last_peered":"2023-11-17T06:29:41.151548+0000","last_clean":"2023-11-17T06:29:41.151548+0000","last_became_active":"2023-11-17T06:29:40.057027+0000","last_became_peered":"2023-11-17T06:29:40.057027+0000","last_unstale":"2023-11-17T06:29:41.151548+0000","last_undegraded":"2023-11-17T06:29:41.151548+0000","last_fullsized":"2023-11-17T06:29:41.151548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187287+0000","last_change":"2023-11-17T06:29:39.019273+0000","last_active":"2023-11-17T06:29:41.187287+0000","last_peered":"2023-11-17T06:29:41.187287+0000","last_clean":"2023-11-17T06:29:41.187287+0000","last_became_active":"2023-11-17T06:29:39.017424+0000","last_became_peered":"2023-11-17T06:29:39.017424+0000","last_unstale":"2023-11-17T06:29:41.187287+0000","last_undegraded":"2023-11-17T06:29:41.187287+0000","last_fullsized":"2023-11-17T06:29:41.187287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187172+0000","last_change":"2023-11-17T06:29:40.052673+0000","last_active":"2023-11-17T06:29:41.187172+0000","last_peered":"2023-11-17T06:29:41.187172+0000","last_clean":"2023-11-17T06:29:41.187172+0000","last_became_active":"2023-11-17T06:29:40.052360+0000","last_became_peered":"2023-11-17T06:29:40.052360+0000","last_unstale":"2023-11-17T06:29:41.187172+0000","last_undegraded":"2023-11-17T06:29:41.187172+0000","last_fullsized":"2023-11-17T06:29:41.187172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033791+0000","last_change":"2023-11-17T06:29:39.012145+0000","last_active":"2023-11-17T06:29:41.033791+0000","last_peered":"2023-11-17T06:29:41.033791+0000","last_clean":"2023-11-17T06:29:41.033791+0000","last_became_active":"2023-11-17T06:29:39.011840+0000","last_became_peered":"2023-11-17T06:29:39.011840+0000","last_unstale":"2023-11-17T06:29:41.033791+0000","last_undegraded":"2023-11-17T06:29:41.033791+0000","last_fullsized":"2023-11-17T06:29:41.033791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:14:03.642188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151184+0000","last_change":"2023-11-17T06:29:40.047955+0000","last_active":"2023-11-17T06:29:41.151184+0000","last_peered":"2023-11-17T06:29:41.151184+0000","last_clean":"2023-11-17T06:29:41.151184+0000","last_became_active":"2023-11-17T06:29:40.047530+0000","last_became_peered":"2023-11-17T06:29:40.047530+0000","last_unstale":"2023-11-17T06:29:41.151184+0000","last_undegraded":"2023-11-17T06:29:41.151184+0000","last_fullsized":"2023-11-17T06:29:41.151184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039359+0000","last_change":"2023-11-17T06:29:39.015633+0000","last_active":"2023-11-17T06:29:41.039359+0000","last_peered":"2023-11-17T06:29:41.039359+0000","last_clean":"2023-11-17T06:29:41.039359+0000","last_became_active":"2023-11-17T06:29:39.015301+0000","last_became_peered":"2023-11-17T06:29:39.015301+0000","last_unstale":"2023-11-17T06:29:41.039359+0000","last_undegraded":"2023-11-17T06:29:41.039359+0000","last_fullsized":"2023-11-17T06:29:41.039359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152124+0000","last_change":"2023-11-17T06:29:40.056743+0000","last_active":"2023-11-17T06:29:41.152124+0000","last_peered":"2023-11-17T06:29:41.152124+0000","last_clean":"2023-11-17T06:29:41.152124+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152124+0000","last_undegraded":"2023-11-17T06:29:41.152124+0000","last_fullsized":"2023-11-17T06:29:41.152124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:48:00.372978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034190+0000","last_change":"2023-11-17T06:29:39.018457+0000","last_active":"2023-11-17T06:29:41.034190+0000","last_peered":"2023-11-17T06:29:41.034190+0000","last_clean":"2023-11-17T06:29:41.034190+0000","last_became_active":"2023-11-17T06:29:39.014204+0000","last_became_peered":"2023-11-17T06:29:39.014204+0000","last_unstale":"2023-11-17T06:29:41.034190+0000","last_undegraded":"2023-11-17T06:29:41.034190+0000","last_fullsized":"2023-11-17T06:29:41.034190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152267+0000","last_change":"2023-11-17T06:29:40.056354+0000","last_active":"2023-11-17T06:29:41.152267+0000","last_peered":"2023-11-17T06:29:41.152267+0000","last_clean":"2023-11-17T06:29:41.152267+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152267+0000","last_undegraded":"2023-11-17T06:29:41.152267+0000","last_fullsized":"2023-11-17T06:29:41.152267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:13:49.943175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107824+0000","last_change":"2023-11-17T06:29:39.006221+0000","last_active":"2023-11-17T06:29:41.107824+0000","last_peered":"2023-11-17T06:29:41.107824+0000","last_clean":"2023-11-17T06:29:41.107824+0000","last_became_active":"2023-11-17T06:29:39.005712+0000","last_became_peered":"2023-11-17T06:29:39.005712+0000","last_unstale":"2023-11-17T06:29:41.107824+0000","last_undegraded":"2023-11-17T06:29:41.107824+0000","last_fullsized":"2023-11-17T06:29:41.107824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037120+0000","last_change":"2023-11-17T06:29:40.054044+0000","last_active":"2023-11-17T06:29:41.037120+0000","last_peered":"2023-11-17T06:29:41.037120+0000","last_clean":"2023-11-17T06:29:41.037120+0000","last_became_active":"2023-11-17T06:29:40.050897+0000","last_became_peered":"2023-11-17T06:29:40.050897+0000","last_unstale":"2023-11-17T06:29:41.037120+0000","last_undegraded":"2023-11-17T06:29:41.037120+0000","last_fullsized":"2023-11-17T06:29:41.037120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033921+0000","last_change":"2023-11-17T06:29:39.018173+0000","last_active":"2023-11-17T06:29:41.033921+0000","last_peered":"2023-11-17T06:29:41.033921+0000","last_clean":"2023-11-17T06:29:41.033921+0000","last_became_active":"2023-11-17T06:29:39.017909+0000","last_became_peered":"2023-11-17T06:29:39.017909+0000","last_unstale":"2023-11-17T06:29:41.033921+0000","last_undegraded":"2023-11-17T06:29:41.033921+0000","last_fullsized":"2023-11-17T06:29:41.033921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:57.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.067949+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.065233+0000","last_became_peered":"2023-11-17T06:29:40.065233+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-17T06:29:40.021755+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:29:40.021755+0000","last_peered":"2023-11-17T06:29:40.021755+0000","last_clean":"2023-11-17T06:29:40.021755+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:29:40.021755+0000","last_undegraded":"2023-11-17T06:29:40.021755+0000","last_fullsized":"2023-11-17T06:29:40.021755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.035967+0000","last_change":"2023-11-17T06:29:39.012948+0000","last_active":"2023-11-17T06:29:41.035967+0000","last_peered":"2023-11-17T06:29:41.035967+0000","last_clean":"2023-11-17T06:29:41.035967+0000","last_became_active":"2023-11-17T06:29:39.012399+0000","last_became_peered":"2023-11-17T06:29:39.012399+0000","last_unstale":"2023-11-17T06:29:41.035967+0000","last_undegraded":"2023-11-17T06:29:41.035967+0000","last_fullsized":"2023-11-17T06:29:41.035967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:04.513942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187413+0000","last_change":"2023-11-17T06:29:40.067314+0000","last_active":"2023-11-17T06:29:41.187413+0000","last_peered":"2023-11-17T06:29:41.187413+0000","last_clean":"2023-11-17T06:29:41.187413+0000","last_became_active":"2023-11-17T06:29:40.067024+0000","last_became_peered":"2023-11-17T06:29:40.067024+0000","last_unstale":"2023-11-17T06:29:41.187413+0000","last_undegraded":"2023-11-17T06:29:41.187413+0000","last_fullsized":"2023-11-17T06:29:41.187413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150983+0000","last_change":"2023-11-17T06:29:39.018265+0000","last_active":"2023-11-17T06:29:41.150983+0000","last_peered":"2023-11-17T06:29:41.150983+0000","last_clean":"2023-11-17T06:29:41.150983+0000","last_became_active":"2023-11-17T06:29:39.017921+0000","last_became_peered":"2023-11-17T06:29:39.017921+0000","last_unstale":"2023-11-17T06:29:41.150983+0000","last_undegraded":"2023-11-17T06:29:41.150983+0000","last_fullsized":"2023-11-17T06:29:41.150983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:21.174865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188592+0000","last_change":"2023-11-17T06:29:40.058305+0000","last_active":"2023-11-17T06:29:41.188592+0000","last_peered":"2023-11-17T06:29:41.188592+0000","last_clean":"2023-11-17T06:29:41.188592+0000","last_became_active":"2023-11-17T06:29:40.058045+0000","last_became_peered":"2023-11-17T06:29:40.058045+0000","last_unstale":"2023-11-17T06:29:41.188592+0000","last_undegraded":"2023-11-17T06:29:41.188592+0000","last_fullsized":"2023-11-17T06:29:41.188592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:48.722666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033924+0000","last_change":"2023-11-17T06:29:39.009964+0000","last_active":"2023-11-17T06:29:41.033924+0000","last_peered":"2023-11-17T06:29:41.033924+0000","last_clean":"2023-11-17T06:29:41.033924+0000","last_became_active":"2023-11-17T06:29:39.007573+0000","last_became_peered":"2023-11-17T06:29:39.007573+0000","last_unstale":"2023-11-17T06:29:41.033924+0000","last_undegraded":"2023-11-17T06:29:41.033924+0000","last_fullsized":"2023-11-17T06:29:41.033924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:00:22.924749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107525+0000","last_change":"2023-11-17T06:29:40.038796+0000","last_active":"2023-11-17T06:29:41.107525+0000","last_peered":"2023-11-17T06:29:41.107525+0000","last_clean":"2023-11-17T06:29:41.107525+0000","last_became_active":"2023-11-17T06:29:40.038469+0000","last_became_peered":"2023-11-17T06:29:40.038469+0000","last_unstale":"2023-11-17T06:29:41.107525+0000","last_undegraded":"2023-11-17T06:29:41.107525+0000","last_fullsized":"2023-11-17T06:29:41.107525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037187+0000","last_change":"2023-11-17T06:29:39.007112+0000","last_active":"2023-11-17T06:29:41.037187+0000","last_peered":"2023-11-17T06:29:41.037187+0000","last_clean":"2023-11-17T06:29:41.037187+0000","last_became_active":"2023-11-17T06:29:39.006736+0000","last_became_peered":"2023-11-17T06:29:39.006736+0000","last_unstale":"2023-11-17T06:29:41.037187+0000","last_undegraded":"2023-11-17T06:29:41.037187+0000","last_fullsized":"2023-11-17T06:29:41.037187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038938+0000","last_change":"2023-11-17T06:29:40.059681+0000","last_active":"2023-11-17T06:29:41.038938+0000","last_peered":"2023-11-17T06:29:41.038938+0000","last_clean":"2023-11-17T06:29:41.038938+0000","last_became_active":"2023-11-17T06:29:40.059165+0000","last_became_peered":"2023-11-17T06:29:40.059165+0000","last_unstale":"2023-11-17T06:29:41.038938+0000","last_undegraded":"2023-11-17T06:29:41.038938+0000","last_fullsized":"2023-11-17T06:29:41.038938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:58.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107450+0000","last_change":"2023-11-17T06:29:39.015572+0000","last_active":"2023-11-17T06:29:41.107450+0000","last_peered":"2023-11-17T06:29:41.107450+0000","last_clean":"2023-11-17T06:29:41.107450+0000","last_became_active":"2023-11-17T06:29:39.015272+0000","last_became_peered":"2023-11-17T06:29:39.015272+0000","last_unstale":"2023-11-17T06:29:41.107450+0000","last_undegraded":"2023-11-17T06:29:41.107450+0000","last_fullsized":"2023-11-17T06:29:41.107450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036928+0000","last_change":"2023-11-17T06:29:40.054094+0000","last_active":"2023-11-17T06:29:41.036928+0000","last_peered":"2023-11-17T06:29:41.036928+0000","last_clean":"2023-11-17T06:29:41.036928+0000","last_became_active":"2023-11-17T06:29:40.053816+0000","last_became_peered":"2023-11-17T06:29:40.053816+0000","last_unstale":"2023-11-17T06:29:41.036928+0000","last_undegraded":"2023-11-17T06:29:41.036928+0000","last_fullsized":"2023-11-17T06:29:41.036928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152236+0000","last_change":"2023-11-17T06:29:39.019355+0000","last_active":"2023-11-17T06:29:41.152236+0000","last_peered":"2023-11-17T06:29:41.152236+0000","last_clean":"2023-11-17T06:29:41.152236+0000","last_became_active":"2023-11-17T06:29:39.019090+0000","last_became_peered":"2023-11-17T06:29:39.019090+0000","last_unstale":"2023-11-17T06:29:41.152236+0000","last_undegraded":"2023-11-17T06:29:41.152236+0000","last_fullsized":"2023-11-17T06:29:41.152236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:35.188435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107457+0000","last_change":"2023-11-17T06:29:40.043278+0000","last_active":"2023-11-17T06:29:41.107457+0000","last_peered":"2023-11-17T06:29:41.107457+0000","last_clean":"2023-11-17T06:29:41.107457+0000","last_became_active":"2023-11-17T06:29:40.043106+0000","last_became_peered":"2023-11-17T06:29:40.043106+0000","last_unstale":"2023-11-17T06:29:41.107457+0000","last_undegraded":"2023-11-17T06:29:41.107457+0000","last_fullsized":"2023-11-17T06:29:41.107457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:42.340878+0000","last_change":"2023-11-17T06:29:39.020748+0000","last_active":"2023-11-17T06:29:42.340878+0000","last_peered":"2023-11-17T06:29:42.340878+0000","last_clean":"2023-11-17T06:29:42.340878+0000","last_became_active":"2023-11-17T06:29:39.020192+0000","last_became_peered":"2023-11-17T06:29:39.020192+0000","last_unstale":"2023-11-17T06:29:42.340878+0000","last_undegraded":"2023-11-17T06:29:42.340878+0000","last_fullsized":"2023-11-17T06:29:42.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189551+0000","last_change":"2023-11-17T06:29:40.044168+0000","last_active":"2023-11-17T06:29:41.189551+0000","last_peered":"2023-11-17T06:29:41.189551+0000","last_clean":"2023-11-17T06:29:41.189551+0000","last_became_active":"2023-11-17T06:29:40.043816+0000","last_became_peered":"2023-11-17T06:29:40.043816+0000","last_unstale":"2023-11-17T06:29:41.189551+0000","last_undegraded":"2023-11-17T06:29:41.189551+0000","last_fullsized":"2023-11-17T06:29:41.189551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187665+0000","last_change":"2023-11-17T06:29:39.014734+0000","last_active":"2023-11-17T06:29:41.187665+0000","last_peered":"2023-11-17T06:29:41.187665+0000","last_clean":"2023-11-17T06:29:41.187665+0000","last_became_active":"2023-11-17T06:29:39.014327+0000","last_became_peered":"2023-11-17T06:29:39.014327+0000","last_unstale":"2023-11-17T06:29:41.187665+0000","last_undegraded":"2023-11-17T06:29:41.187665+0000","last_fullsized":"2023-11-17T06:29:41.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.190089+0000","last_change":"2023-11-17T06:29:40.062903+0000","last_active":"2023-11-17T06:29:41.190089+0000","last_peered":"2023-11-17T06:29:41.190089+0000","last_clean":"2023-11-17T06:29:41.190089+0000","last_became_active":"2023-11-17T06:29:40.062579+0000","last_became_peered":"2023-11-17T06:29:40.062579+0000","last_unstale":"2023-11-17T06:29:41.190089+0000","last_undegraded":"2023-11-17T06:29:41.190089+0000","last_fullsized":"2023-11-17T06:29:41.190089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150984+0000","last_change":"2023-11-17T06:29:39.021850+0000","last_active":"2023-11-17T06:29:41.150984+0000","last_peered":"2023-11-17T06:29:41.150984+0000","last_clean":"2023-11-17T06:29:41.150984+0000","last_became_active":"2023-11-17T06:29:39.017210+0000","last_became_peered":"2023-11-17T06:29:39.017210+0000","last_unstale":"2023-11-17T06:29:41.150984+0000","last_undegraded":"2023-11-17T06:29:41.150984+0000","last_fullsized":"2023-11-17T06:29:41.150984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:26.995063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038808+0000","last_change":"2023-11-17T06:29:40.062837+0000","last_active":"2023-11-17T06:29:41.038808+0000","last_peered":"2023-11-17T06:29:41.038808+0000","last_clean":"2023-11-17T06:29:41.038808+0000","last_became_active":"2023-11-17T06:29:40.062553+0000","last_became_peered":"2023-11-17T06:29:40.062553+0000","last_unstale":"2023-11-17T06:29:41.038808+0000","last_undegraded":"2023-11-17T06:29:41.038808+0000","last_fullsized":"2023-11-17T06:29:41.038808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:20:05.317093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107283+0000","last_change":"2023-11-17T06:29:39.010652+0000","last_active":"2023-11-17T06:29:41.107283+0000","last_peered":"2023-11-17T06:29:41.107283+0000","last_clean":"2023-11-17T06:29:41.107283+0000","last_became_active":"2023-11-17T06:29:39.009663+0000","last_became_peered":"2023-11-17T06:29:39.009663+0000","last_unstale":"2023-11-17T06:29:41.107283+0000","last_undegraded":"2023-11-17T06:29:41.107283+0000","last_fullsized":"2023-11-17T06:29:41.107283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187492+0000","last_change":"2023-11-17T06:29:40.046969+0000","last_active":"2023-11-17T06:29:41.187492+0000","last_peered":"2023-11-17T06:29:41.187492+0000","last_clean":"2023-11-17T06:29:41.187492+0000","last_became_active":"2023-11-17T06:29:40.046400+0000","last_became_peered":"2023-11-17T06:29:40.046400+0000","last_unstale":"2023-11-17T06:29:41.187492+0000","last_undegraded":"2023-11-17T06:29:41.187492+0000","last_fullsized":"2023-11-17T06:29:41.187492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107727+0000","last_change":"2023-11-17T06:29:39.015476+0000","last_active":"2023-11-17T06:29:41.107727+0000","last_peered":"2023-11-17T06:29:41.107727+0000","last_clean":"2023-11-17T06:29:41.107727+0000","last_became_active":"2023-11-17T06:29:39.015166+0000","last_became_peered":"2023-11-17T06:29:39.015166+0000","last_unstale":"2023-11-17T06:29:41.107727+0000","last_undegraded":"2023-11-17T06:29:41.107727+0000","last_fullsized":"2023-11-17T06:29:41.107727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187769+0000","last_change":"2023-11-17T06:29:40.044575+0000","last_active":"2023-11-17T06:29:41.187769+0000","last_peered":"2023-11-17T06:29:41.187769+0000","last_clean":"2023-11-17T06:29:41.187769+0000","last_became_active":"2023-11-17T06:29:40.044313+0000","last_became_peered":"2023-11-17T06:29:40.044313+0000","last_unstale":"2023-11-17T06:29:41.187769+0000","last_undegraded":"2023-11-17T06:29:41.187769+0000","last_fullsized":"2023-11-17T06:29:41.187769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151785+0000","last_change":"2023-11-17T06:29:39.022524+0000","last_active":"2023-11-17T06:29:41.151785+0000","last_peered":"2023-11-17T06:29:41.151785+0000","last_clean":"2023-11-17T06:29:41.151785+0000","last_became_active":"2023-11-17T06:29:39.022245+0000","last_became_peered":"2023-11-17T06:29:39.022245+0000","last_unstale":"2023-11-17T06:29:41.151785+0000","last_undegraded":"2023-11-17T06:29:41.151785+0000","last_fullsized":"2023-11-17T06:29:41.151785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187140+0000","last_change":"2023-11-17T06:29:40.050948+0000","last_active":"2023-11-17T06:29:41.187140+0000","last_peered":"2023-11-17T06:29:41.187140+0000","last_clean":"2023-11-17T06:29:41.187140+0000","last_became_active":"2023-11-17T06:29:40.050407+0000","last_became_peered":"2023-11-17T06:29:40.050407+0000","last_unstale":"2023-11-17T06:29:41.187140+0000","last_undegraded":"2023-11-17T06:29:41.187140+0000","last_fullsized":"2023-11-17T06:29:41.187140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036601+0000","last_change":"2023-11-17T06:29:40.064292+0000","last_active":"2023-11-17T06:29:41.036601+0000","last_peered":"2023-11-17T06:29:41.036601+0000","last_clean":"2023-11-17T06:29:41.036601+0000","last_became_active":"2023-11-17T06:29:40.063950+0000","last_became_peered":"2023-11-17T06:29:40.063950+0000","last_unstale":"2023-11-17T06:29:41.036601+0000","last_undegraded":"2023-11-17T06:29:41.036601+0000","last_fullsized":"2023-11-17T06:29:41.036601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151542+0000","last_change":"2023-11-17T06:29:39.026270+0000","last_active":"2023-11-17T06:29:41.151542+0000","last_peered":"2023-11-17T06:29:41.151542+0000","last_clean":"2023-11-17T06:29:41.151542+0000","last_became_active":"2023-11-17T06:29:39.025930+0000","last_became_peered":"2023-11-17T06:29:39.025930+0000","last_unstale":"2023-11-17T06:29:41.151542+0000","last_undegraded":"2023-11-17T06:29:41.151542+0000","last_fullsized":"2023-11-17T06:29:41.151542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:02.074512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036867+0000","last_change":"2023-11-17T06:29:40.054287+0000","last_active":"2023-11-17T06:29:41.036867+0000","last_peered":"2023-11-17T06:29:41.036867+0000","last_clean":"2023-11-17T06:29:41.036867+0000","last_became_active":"2023-11-17T06:29:40.053760+0000","last_became_peered":"2023-11-17T06:29:40.053760+0000","last_unstale":"2023-11-17T06:29:41.036867+0000","last_undegraded":"2023-11-17T06:29:41.036867+0000","last_fullsized":"2023-11-17T06:29:41.036867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152006+0000","last_change":"2023-11-17T06:29:39.021077+0000","last_active":"2023-11-17T06:29:41.152006+0000","last_peered":"2023-11-17T06:29:41.152006+0000","last_clean":"2023-11-17T06:29:41.152006+0000","last_became_active":"2023-11-17T06:29:39.020821+0000","last_became_peered":"2023-11-17T06:29:39.020821+0000","last_unstale":"2023-11-17T06:29:41.152006+0000","last_undegraded":"2023-11-17T06:29:41.152006+0000","last_fullsized":"2023-11-17T06:29:41.152006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189999+0000","last_change":"2023-11-17T06:29:40.065696+0000","last_active":"2023-11-17T06:29:41.189999+0000","last_peered":"2023-11-17T06:29:41.189999+0000","last_clean":"2023-11-17T06:29:41.189999+0000","last_became_active":"2023-11-17T06:29:40.065459+0000","last_became_peered":"2023-11-17T06:29:40.065459+0000","last_unstale":"2023-11-17T06:29:41.189999+0000","last_undegraded":"2023-11-17T06:29:41.189999+0000","last_fullsized":"2023-11-17T06:29:41.189999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189626+0000","last_change":"2023-11-17T06:29:39.014916+0000","last_active":"2023-11-17T06:29:41.189626+0000","last_peered":"2023-11-17T06:29:41.189626+0000","last_clean":"2023-11-17T06:29:41.189626+0000","last_became_active":"2023-11-17T06:29:39.014625+0000","last_became_peered":"2023-11-17T06:29:39.014625+0000","last_unstale":"2023-11-17T06:29:41.189626+0000","last_undegraded":"2023-11-17T06:29:41.189626+0000","last_fullsized":"2023-11-17T06:29:41.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189444+0000","last_change":"2023-11-17T06:29:40.054935+0000","last_active":"2023-11-17T06:29:41.189444+0000","last_peered":"2023-11-17T06:29:41.189444+0000","last_clean":"2023-11-17T06:29:41.189444+0000","last_became_active":"2023-11-17T06:29:40.054651+0000","last_became_peered":"2023-11-17T06:29:40.054651+0000","last_unstale":"2023-11-17T06:29:41.189444+0000","last_undegraded":"2023-11-17T06:29:41.189444+0000","last_fullsized":"2023-11-17T06:29:41.189444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189996+0000","last_change":"2023-11-17T06:29:39.020080+0000","last_active":"2023-11-17T06:29:41.189996+0000","last_peered":"2023-11-17T06:29:41.189996+0000","last_clean":"2023-11-17T06:29:41.189996+0000","last_became_active":"2023-11-17T06:29:39.018857+0000","last_became_peered":"2023-11-17T06:29:39.018857+0000","last_unstale":"2023-11-17T06:29:41.189996+0000","last_undegraded":"2023-11-17T06:29:41.189996+0000","last_fullsized":"2023-11-17T06:29:41.189996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.7590000000000003,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":4.7590000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":4.9610000000000003,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":4.9610000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":5.0300000000000002,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":5.0300000000000002},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":5.0590000000000002}]},{"osd":2,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":4.8319999999999999},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":4.8070000000000004}]},{"osd":4,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.276},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.1040000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.331},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0920000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.94599999999999995}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.421}]},{"osd":3,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.208}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.141},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.383}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.5389999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.466},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.133},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.361}]},{"osd":1,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.226},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.206}]},{"osd":2,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.298}]},{"osd":3,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":1.111}]},{"osd":4,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.7250000000000001,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.423}]},{"osd":6,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":3.2370000000000001,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.474},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.5}]},{"osd":7,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":3.355,"5min":3.355,"15min":3.355},"last":1.5529999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":80752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.113}]},{"osd":1,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.056},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.2450000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.732,"15min":1.732},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":9.4499999999999993,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.302},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":9.2910000000000004,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.181}]},{"osd":3,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.5429999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.641}]},{"osd":7,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.671},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6919999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.016}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.423}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.444},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.286}]},{"osd":6,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.359},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.399},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.4770000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":80626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.258}]},{"osd":1,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.623},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.216},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.97699999999999998}]},{"osd":5,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.429},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.506}]},{"osd":7,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.319},{"interface":"front","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.615}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.624},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.393},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3,"5min":3,"15min":3},"last":1.089}]},{"osd":5,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":1.327},{"interface":"front","average":{"1min":1.609,"5min":1.609,"15min":1.609},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.117}]},{"osd":6,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.276},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":1.258}]},{"osd":7,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.359},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.4810000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.321},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.3660000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.091}]},{"osd":3,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.87},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1890000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.3359999999999999,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.399}]},{"osd":6,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.216,"5min":1.216,"15min":1.216},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.504},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.2929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:29:49.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:29:49.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.476+0000 7fbfc9dd7700 1 Processor -- start 2023-11-17T06:29:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.476+0000 7fbfc9dd7700 1 -- start start 2023-11-17T06:29:49.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc9dd7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbfc4144ac0 0x7fbfc406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc9dd7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc40cde70 0x7fbfc40c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc9dd7700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc406d160 con 0x7fbfc40c9840 2023-11-17T06:29:49.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc9dd7700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc406da00 con 0x7fbfc4144ac0 2023-11-17T06:29:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc9dd7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc406cf70 con 0x7fbfc40cde70 2023-11-17T06:29:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc8dd5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbfc4144ac0 0x7fbfc406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc40cde70 0x7fbfc40c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc8dd5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbfc4144ac0 0x7fbfc406ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47762/0 (socket says 172.21.15.100:47762) 2023-11-17T06:29:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.480+0000 7fbfc8dd5700 1 -- 172.21.15.100:0/2273684287 learned_addr learned my addr 172.21.15.100:0/2273684287 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc8dd5700 1 -- 172.21.15.100:0/2273684287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc40cde70 msgr2=0x7fbfc40c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc8dd5700 1 --2- 172.21.15.100:0/2273684287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc40cde70 0x7fbfc40c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc8dd5700 1 -- 172.21.15.100:0/2273684287 >> v1:172.21.15.119:6789/0 conn(0x7fbfc40c9840 legacy=0x7fbfc40ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc8dd5700 1 -- 172.21.15.100:0/2273684287 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc406d440 con 0x7fbfc4144ac0 2023-11-17T06:29:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc8dd5700 1 --2- 172.21.15.100:0/2273684287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4144ac0 0x7fbfc406ca30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009910 tx=0x7fbfb8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78231554ae106d0c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc37fe700 1 -- 172.21.15.100:0/2273684287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011830 con 0x7fbfc4144ac0 2023-11-17T06:29:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc37fe700 1 -- 172.21.15.100:0/2273684287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8011990 con 0x7fbfc4144ac0 2023-11-17T06:29:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc37fe700 1 -- 172.21.15.100:0/2273684287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011d40 con 0x7fbfc4144ac0 2023-11-17T06:29:49.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2273684287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4144ac0 msgr2=0x7fbfc406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2273684287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4144ac0 0x7fbfc406ca30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009910 tx=0x7fbfb8009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2273684287 shutdown_connections 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2273684287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc40cde70 0x7fbfc40c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2273684287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4144ac0 0x7fbfc406ca30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2273684287 >> 172.21.15.100:0/2273684287 conn(0x7fbfc40cb730 msgr2=0x7fbfc40cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2273684287 shutdown_connections 2023-11-17T06:29:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.484+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2273684287 wait complete. 2023-11-17T06:29:49.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 Processor -- start 2023-11-17T06:29:49.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 -- start start 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc40c9840 0x7fbfc40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 0x7fbfc4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc415cac0 con 0x7fbfc40cde70 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc415d640 con 0x7fbfc40c9840 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.488+0000 7fbfc9dd7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc415cd10 con 0x7fbfc4144ac0 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47766/0 (socket says 172.21.15.100:47766) 2023-11-17T06:29:49.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 -- 172.21.15.100:0/2011678629 learned_addr learned my addr 172.21.15.100:0/2011678629 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc8dd5700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc40c9840 0x7fbfc40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc95d6700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 0x7fbfc4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 -- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 msgr2=0x7fbfc4071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 0x7fbfc4071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 -- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc40c9840 msgr2=0x7fbfc40c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc40c9840 0x7fbfc40c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 -- 172.21.15.100:0/2011678629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8009570 con 0x7fbfc40cde70 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc95d6700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 0x7fbfc4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc3fff700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000e9d0 tx=0x7fbfb000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0009720 con 0x7fbfc40cde70 2023-11-17T06:29:49.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000c850 con 0x7fbfc40cde70 2023-11-17T06:29:49.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc415cff0 con 0x7fbfc40cde70 2023-11-17T06:29:49.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000cbc0 con 0x7fbfc40cde70 2023-11-17T06:29:49.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc40c89a0 con 0x7fbfc40cde70 2023-11-17T06:29:49.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.492+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc4065e90 con 0x7fbfc40cde70 2023-11-17T06:29:49.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.496+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbfb000cd20 con 0x7fbfc40cde70 2023-11-17T06:29:49.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.496+0000 7fbfc17fa700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 0x7fbfa8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.496+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfb0083fb0 con 0x7fbfc40cde70 2023-11-17T06:29:49.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.496+0000 7fbfc8dd5700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 0x7fbfa8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.496+0000 7fbfc8dd5700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 0x7fbfa8068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8014040 tx=0x7fbfb8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.500+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbfb0051420 con 0x7fbfc40cde70 2023-11-17T06:29:49.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.660+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfc4070290 con 0x7fbfa8066540 2023-11-17T06:29:49.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.672+0000 7fbfc17fa700 1 -- 172.21.15.100:0/2011678629 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286613 (secure 0 0 0) 0x7fbfb8011b00 con 0x7fbfa8066540 2023-11-17T06:29:49.681 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 msgr2=0x7fbfa8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 0x7fbfa8068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8014040 tx=0x7fbfb8008030 comp rx=0 tx=0).stop 2023-11-17T06:29:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 msgr2=0x7fbfc413d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000e9d0 tx=0x7fbfb000ed90 comp rx=0 tx=0).stop 2023-11-17T06:29:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 shutdown_connections 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfc4144ac0 0x7fbfc4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbfa8066540 0x7fbfa8068a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc40cde70 0x7fbfc413d650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 --2- 172.21.15.100:0/2011678629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfc40c9840 0x7fbfc40c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 >> 172.21.15.100:0/2011678629 conn(0x7fbfc40cb730 msgr2=0x7fbfc4142310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 shutdown_connections 2023-11-17T06:29:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.680+0000 7fbfc9dd7700 1 -- 172.21.15.100:0/2011678629 wait complete. 2023-11-17T06:29:49.685 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:29:49.703 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2023-11-17T06:29:49.266592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219200,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755520,"statfs":{"total":773094113280,"available":772869652480,"internally_reserved":0,"allocated":3088384,"data_stored":1830564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.252311"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152090+0000","last_change":"2023-11-17T06:29:40.063019+0000","last_active":"2023-11-17T06:29:41.152090+0000","last_peered":"2023-11-17T06:29:41.152090+0000","last_clean":"2023-11-17T06:29:41.152090+0000","last_became_active":"2023-11-17T06:29:40.062726+0000","last_became_peered":"2023-11-17T06:29:40.062726+0000","last_unstale":"2023-11-17T06:29:41.152090+0000","last_undegraded":"2023-11-17T06:29:41.152090+0000","last_fullsized":"2023-11-17T06:29:41.152090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107932+0000","last_change":"2023-11-17T06:29:40.059039+0000","last_active":"2023-11-17T06:29:41.107932+0000","last_peered":"2023-11-17T06:29:41.107932+0000","last_clean":"2023-11-17T06:29:41.107932+0000","last_became_active":"2023-11-17T06:29:40.058738+0000","last_became_peered":"2023-11-17T06:29:40.058738+0000","last_unstale":"2023-11-17T06:29:41.107932+0000","last_undegraded":"2023-11-17T06:29:41.107932+0000","last_fullsized":"2023-11-17T06:29:41.107932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189875+0000","last_change":"2023-11-17T06:29:40.036396+0000","last_active":"2023-11-17T06:29:41.189875+0000","last_peered":"2023-11-17T06:29:41.189875+0000","last_clean":"2023-11-17T06:29:41.189875+0000","last_became_active":"2023-11-17T06:29:40.034856+0000","last_became_peered":"2023-11-17T06:29:40.034856+0000","last_unstale":"2023-11-17T06:29:41.189875+0000","last_undegraded":"2023-11-17T06:29:41.189875+0000","last_fullsized":"2023-11-17T06:29:41.189875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036505+0000","last_change":"2023-11-17T06:29:40.054375+0000","last_active":"2023-11-17T06:29:41.036505+0000","last_peered":"2023-11-17T06:29:41.036505+0000","last_clean":"2023-11-17T06:29:41.036505+0000","last_became_active":"2023-11-17T06:29:40.054057+0000","last_became_peered":"2023-11-17T06:29:40.054057+0000","last_unstale":"2023-11-17T06:29:41.036505+0000","last_undegraded":"2023-11-17T06:29:41.036505+0000","last_fullsized":"2023-11-17T06:29:41.036505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151486+0000","last_change":"2023-11-17T06:29:40.043645+0000","last_active":"2023-11-17T06:29:41.151486+0000","last_peered":"2023-11-17T06:29:41.151486+0000","last_clean":"2023-11-17T06:29:41.151486+0000","last_became_active":"2023-11-17T06:29:40.043104+0000","last_became_peered":"2023-11-17T06:29:40.043104+0000","last_unstale":"2023-11-17T06:29:41.151486+0000","last_undegraded":"2023-11-17T06:29:41.151486+0000","last_fullsized":"2023-11-17T06:29:41.151486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036135+0000","last_change":"2023-11-17T06:29:40.058390+0000","last_active":"2023-11-17T06:29:41.036135+0000","last_peered":"2023-11-17T06:29:41.036135+0000","last_clean":"2023-11-17T06:29:41.036135+0000","last_became_active":"2023-11-17T06:29:40.058051+0000","last_became_peered":"2023-11-17T06:29:40.058051+0000","last_unstale":"2023-11-17T06:29:41.036135+0000","last_undegraded":"2023-11-17T06:29:41.036135+0000","last_fullsized":"2023-11-17T06:29:41.036135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151241+0000","last_change":"2023-11-17T06:29:40.033175+0000","last_active":"2023-11-17T06:29:41.151241+0000","last_peered":"2023-11-17T06:29:41.151241+0000","last_clean":"2023-11-17T06:29:41.151241+0000","last_became_active":"2023-11-17T06:29:40.032870+0000","last_became_peered":"2023-11-17T06:29:40.032870+0000","last_unstale":"2023-11-17T06:29:41.151241+0000","last_undegraded":"2023-11-17T06:29:41.151241+0000","last_fullsized":"2023-11-17T06:29:41.151241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187178+0000","last_change":"2023-11-17T06:29:40.067796+0000","last_active":"2023-11-17T06:29:41.187178+0000","last_peered":"2023-11-17T06:29:41.187178+0000","last_clean":"2023-11-17T06:29:41.187178+0000","last_became_active":"2023-11-17T06:29:40.067549+0000","last_became_peered":"2023-11-17T06:29:40.067549+0000","last_unstale":"2023-11-17T06:29:41.187178+0000","last_undegraded":"2023-11-17T06:29:41.187178+0000","last_fullsized":"2023-11-17T06:29:41.187178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152224+0000","last_change":"2023-11-17T06:29:40.053086+0000","last_active":"2023-11-17T06:29:41.152224+0000","last_peered":"2023-11-17T06:29:41.152224+0000","last_clean":"2023-11-17T06:29:41.152224+0000","last_became_active":"2023-11-17T06:29:40.052820+0000","last_became_peered":"2023-11-17T06:29:40.052820+0000","last_unstale":"2023-11-17T06:29:41.152224+0000","last_undegraded":"2023-11-17T06:29:41.152224+0000","last_fullsized":"2023-11-17T06:29:41.152224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:34:42.735002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187565+0000","last_change":"2023-11-17T06:29:40.067431+0000","last_active":"2023-11-17T06:29:41.187565+0000","last_peered":"2023-11-17T06:29:41.187565+0000","last_clean":"2023-11-17T06:29:41.187565+0000","last_became_active":"2023-11-17T06:29:40.067106+0000","last_became_peered":"2023-11-17T06:29:40.067106+0000","last_unstale":"2023-11-17T06:29:41.187565+0000","last_undegraded":"2023-11-17T06:29:41.187565+0000","last_fullsized":"2023-11-17T06:29:41.187565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187309+0000","last_change":"2023-11-17T06:29:40.069847+0000","last_active":"2023-11-17T06:29:41.187309+0000","last_peered":"2023-11-17T06:29:41.187309+0000","last_clean":"2023-11-17T06:29:41.187309+0000","last_became_active":"2023-11-17T06:29:40.069567+0000","last_became_peered":"2023-11-17T06:29:40.069567+0000","last_unstale":"2023-11-17T06:29:41.187309+0000","last_undegraded":"2023-11-17T06:29:41.187309+0000","last_fullsized":"2023-11-17T06:29:41.187309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039102+0000","last_change":"2023-11-17T06:29:40.055649+0000","last_active":"2023-11-17T06:29:41.039102+0000","last_peered":"2023-11-17T06:29:41.039102+0000","last_clean":"2023-11-17T06:29:41.039102+0000","last_became_active":"2023-11-17T06:29:40.054763+0000","last_became_peered":"2023-11-17T06:29:40.054763+0000","last_unstale":"2023-11-17T06:29:41.039102+0000","last_undegraded":"2023-11-17T06:29:41.039102+0000","last_fullsized":"2023-11-17T06:29:41.039102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187571+0000","last_change":"2023-11-17T06:29:40.056634+0000","last_active":"2023-11-17T06:29:41.187571+0000","last_peered":"2023-11-17T06:29:41.187571+0000","last_clean":"2023-11-17T06:29:41.187571+0000","last_became_active":"2023-11-17T06:29:40.055547+0000","last_became_peered":"2023-11-17T06:29:40.055547+0000","last_unstale":"2023-11-17T06:29:41.187571+0000","last_undegraded":"2023-11-17T06:29:41.187571+0000","last_fullsized":"2023-11-17T06:29:41.187571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189196+0000","last_change":"2023-11-17T06:29:40.038547+0000","last_active":"2023-11-17T06:29:41.189196+0000","last_peered":"2023-11-17T06:29:41.189196+0000","last_clean":"2023-11-17T06:29:41.189196+0000","last_became_active":"2023-11-17T06:29:40.038231+0000","last_became_peered":"2023-11-17T06:29:40.038231+0000","last_unstale":"2023-11-17T06:29:41.189196+0000","last_undegraded":"2023-11-17T06:29:41.189196+0000","last_fullsized":"2023-11-17T06:29:41.189196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107274+0000","last_change":"2023-11-17T06:29:40.051827+0000","last_active":"2023-11-17T06:29:41.107274+0000","last_peered":"2023-11-17T06:29:41.107274+0000","last_clean":"2023-11-17T06:29:41.107274+0000","last_became_active":"2023-11-17T06:29:40.051501+0000","last_became_peered":"2023-11-17T06:29:40.051501+0000","last_unstale":"2023-11-17T06:29:41.107274+0000","last_undegraded":"2023-11-17T06:29:41.107274+0000","last_fullsized":"2023-11-17T06:29:41.107274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036003+0000","last_change":"2023-11-17T06:29:40.059452+0000","last_active":"2023-11-17T06:29:41.036003+0000","last_peered":"2023-11-17T06:29:41.036003+0000","last_clean":"2023-11-17T06:29:41.036003+0000","last_became_active":"2023-11-17T06:29:40.059183+0000","last_became_peered":"2023-11-17T06:29:40.059183+0000","last_unstale":"2023-11-17T06:29:41.036003+0000","last_undegraded":"2023-11-17T06:29:41.036003+0000","last_fullsized":"2023-11-17T06:29:41.036003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036860+0000","last_change":"2023-11-17T06:29:40.042601+0000","last_active":"2023-11-17T06:29:41.036860+0000","last_peered":"2023-11-17T06:29:41.036860+0000","last_clean":"2023-11-17T06:29:41.036860+0000","last_became_active":"2023-11-17T06:29:40.042331+0000","last_became_peered":"2023-11-17T06:29:40.042331+0000","last_unstale":"2023-11-17T06:29:41.036860+0000","last_undegraded":"2023-11-17T06:29:41.036860+0000","last_fullsized":"2023-11-17T06:29:41.036860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:06:43.462704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034229+0000","last_change":"2023-11-17T06:29:40.060783+0000","last_active":"2023-11-17T06:29:41.034229+0000","last_peered":"2023-11-17T06:29:41.034229+0000","last_clean":"2023-11-17T06:29:41.034229+0000","last_became_active":"2023-11-17T06:29:40.060402+0000","last_became_peered":"2023-11-17T06:29:40.060402+0000","last_unstale":"2023-11-17T06:29:41.034229+0000","last_undegraded":"2023-11-17T06:29:41.034229+0000","last_fullsized":"2023-11-17T06:29:41.034229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152132+0000","last_change":"2023-11-17T06:29:40.036086+0000","last_active":"2023-11-17T06:29:41.152132+0000","last_peered":"2023-11-17T06:29:41.152132+0000","last_clean":"2023-11-17T06:29:41.152132+0000","last_became_active":"2023-11-17T06:29:40.035726+0000","last_became_peered":"2023-11-17T06:29:40.035726+0000","last_unstale":"2023-11-17T06:29:41.152132+0000","last_undegraded":"2023-11-17T06:29:41.152132+0000","last_fullsized":"2023-11-17T06:29:41.152132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:32:30.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:40.054009+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:40.053676+0000","last_became_peered":"2023-11-17T06:29:40.053676+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188829+0000","last_change":"2023-11-17T06:29:40.030845+0000","last_active":"2023-11-17T06:29:41.188829+0000","last_peered":"2023-11-17T06:29:41.188829+0000","last_clean":"2023-11-17T06:29:41.188829+0000","last_became_active":"2023-11-17T06:29:40.030543+0000","last_became_peered":"2023-11-17T06:29:40.030543+0000","last_unstale":"2023-11-17T06:29:41.188829+0000","last_undegraded":"2023-11-17T06:29:41.188829+0000","last_fullsized":"2023-11-17T06:29:41.188829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:58.080660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036380+0000","last_change":"2023-11-17T06:29:40.044683+0000","last_active":"2023-11-17T06:29:41.036380+0000","last_peered":"2023-11-17T06:29:41.036380+0000","last_clean":"2023-11-17T06:29:41.036380+0000","last_became_active":"2023-11-17T06:29:40.044388+0000","last_became_peered":"2023-11-17T06:29:40.044388+0000","last_unstale":"2023-11-17T06:29:41.036380+0000","last_undegraded":"2023-11-17T06:29:41.036380+0000","last_fullsized":"2023-11-17T06:29:41.036380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187189+0000","last_change":"2023-11-17T06:29:40.053205+0000","last_active":"2023-11-17T06:29:41.187189+0000","last_peered":"2023-11-17T06:29:41.187189+0000","last_clean":"2023-11-17T06:29:41.187189+0000","last_became_active":"2023-11-17T06:29:40.052089+0000","last_became_peered":"2023-11-17T06:29:40.052089+0000","last_unstale":"2023-11-17T06:29:41.187189+0000","last_undegraded":"2023-11-17T06:29:41.187189+0000","last_fullsized":"2023-11-17T06:29:41.187189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036256+0000","last_change":"2023-11-17T06:29:40.043201+0000","last_active":"2023-11-17T06:29:41.036256+0000","last_peered":"2023-11-17T06:29:41.036256+0000","last_clean":"2023-11-17T06:29:41.036256+0000","last_became_active":"2023-11-17T06:29:40.042925+0000","last_became_peered":"2023-11-17T06:29:40.042925+0000","last_unstale":"2023-11-17T06:29:41.036256+0000","last_undegraded":"2023-11-17T06:29:41.036256+0000","last_fullsized":"2023-11-17T06:29:41.036256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189502+0000","last_change":"2023-11-17T06:29:40.051636+0000","last_active":"2023-11-17T06:29:41.189502+0000","last_peered":"2023-11-17T06:29:41.189502+0000","last_clean":"2023-11-17T06:29:41.189502+0000","last_became_active":"2023-11-17T06:29:40.051367+0000","last_became_peered":"2023-11-17T06:29:40.051367+0000","last_unstale":"2023-11-17T06:29:41.189502+0000","last_undegraded":"2023-11-17T06:29:41.189502+0000","last_fullsized":"2023-11-17T06:29:41.189502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:33:18.538265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187655+0000","last_change":"2023-11-17T06:29:40.048676+0000","last_active":"2023-11-17T06:29:41.187655+0000","last_peered":"2023-11-17T06:29:41.187655+0000","last_clean":"2023-11-17T06:29:41.187655+0000","last_became_active":"2023-11-17T06:29:40.048373+0000","last_became_peered":"2023-11-17T06:29:40.048373+0000","last_unstale":"2023-11-17T06:29:41.187655+0000","last_undegraded":"2023-11-17T06:29:41.187655+0000","last_fullsized":"2023-11-17T06:29:41.187655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107920+0000","last_change":"2023-11-17T06:29:40.048999+0000","last_active":"2023-11-17T06:29:41.107920+0000","last_peered":"2023-11-17T06:29:41.107920+0000","last_clean":"2023-11-17T06:29:41.107920+0000","last_became_active":"2023-11-17T06:29:40.048673+0000","last_became_peered":"2023-11-17T06:29:40.048673+0000","last_unstale":"2023-11-17T06:29:41.107920+0000","last_undegraded":"2023-11-17T06:29:41.107920+0000","last_fullsized":"2023-11-17T06:29:41.107920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187923+0000","last_change":"2023-11-17T06:29:40.049137+0000","last_active":"2023-11-17T06:29:41.187923+0000","last_peered":"2023-11-17T06:29:41.187923+0000","last_clean":"2023-11-17T06:29:41.187923+0000","last_became_active":"2023-11-17T06:29:40.047540+0000","last_became_peered":"2023-11-17T06:29:40.047540+0000","last_unstale":"2023-11-17T06:29:41.187923+0000","last_undegraded":"2023-11-17T06:29:41.187923+0000","last_fullsized":"2023-11-17T06:29:41.187923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:49:41.808868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189050+0000","last_change":"2023-11-17T06:29:40.044520+0000","last_active":"2023-11-17T06:29:41.189050+0000","last_peered":"2023-11-17T06:29:41.189050+0000","last_clean":"2023-11-17T06:29:41.189050+0000","last_became_active":"2023-11-17T06:29:40.044262+0000","last_became_peered":"2023-11-17T06:29:40.044262+0000","last_unstale":"2023-11-17T06:29:41.189050+0000","last_undegraded":"2023-11-17T06:29:41.189050+0000","last_fullsized":"2023-11-17T06:29:41.189050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036714+0000","last_change":"2023-11-17T06:29:40.051605+0000","last_active":"2023-11-17T06:29:41.036714+0000","last_peered":"2023-11-17T06:29:41.036714+0000","last_clean":"2023-11-17T06:29:41.036714+0000","last_became_active":"2023-11-17T06:29:40.051341+0000","last_became_peered":"2023-11-17T06:29:40.051341+0000","last_unstale":"2023-11-17T06:29:41.036714+0000","last_undegraded":"2023-11-17T06:29:41.036714+0000","last_fullsized":"2023-11-17T06:29:41.036714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:52:49.537515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034092+0000","last_change":"2023-11-17T06:29:40.033266+0000","last_active":"2023-11-17T06:29:41.034092+0000","last_peered":"2023-11-17T06:29:41.034092+0000","last_clean":"2023-11-17T06:29:41.034092+0000","last_became_active":"2023-11-17T06:29:40.032947+0000","last_became_peered":"2023-11-17T06:29:40.032947+0000","last_unstale":"2023-11-17T06:29:41.034092+0000","last_undegraded":"2023-11-17T06:29:41.034092+0000","last_fullsized":"2023-11-17T06:29:41.034092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:28.000751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187145+0000","last_change":"2023-11-17T06:29:40.061167+0000","last_active":"2023-11-17T06:29:41.187145+0000","last_peered":"2023-11-17T06:29:41.187145+0000","last_clean":"2023-11-17T06:29:41.187145+0000","last_became_active":"2023-11-17T06:29:40.060764+0000","last_became_peered":"2023-11-17T06:29:40.060764+0000","last_unstale":"2023-11-17T06:29:41.187145+0000","last_undegraded":"2023-11-17T06:29:41.187145+0000","last_fullsized":"2023-11-17T06:29:41.187145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038784+0000","last_change":"2023-11-17T06:29:40.049645+0000","last_active":"2023-11-17T06:29:41.038784+0000","last_peered":"2023-11-17T06:29:41.038784+0000","last_clean":"2023-11-17T06:29:41.038784+0000","last_became_active":"2023-11-17T06:29:40.049273+0000","last_became_peered":"2023-11-17T06:29:40.049273+0000","last_unstale":"2023-11-17T06:29:41.038784+0000","last_undegraded":"2023-11-17T06:29:41.038784+0000","last_fullsized":"2023-11-17T06:29:41.038784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:55:28.543526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187800+0000","last_change":"2023-11-17T06:29:39.017855+0000","last_active":"2023-11-17T06:29:41.187800+0000","last_peered":"2023-11-17T06:29:41.187800+0000","last_clean":"2023-11-17T06:29:41.187800+0000","last_became_active":"2023-11-17T06:29:39.017537+0000","last_became_peered":"2023-11-17T06:29:39.017537+0000","last_unstale":"2023-11-17T06:29:41.187800+0000","last_undegraded":"2023-11-17T06:29:41.187800+0000","last_fullsized":"2023-11-17T06:29:41.187800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188971+0000","last_change":"2023-11-17T06:29:40.055514+0000","last_active":"2023-11-17T06:29:41.188971+0000","last_peered":"2023-11-17T06:29:41.188971+0000","last_clean":"2023-11-17T06:29:41.188971+0000","last_became_active":"2023-11-17T06:29:40.055200+0000","last_became_peered":"2023-11-17T06:29:40.055200+0000","last_unstale":"2023-11-17T06:29:41.188971+0000","last_undegraded":"2023-11-17T06:29:41.188971+0000","last_fullsized":"2023-11-17T06:29:41.188971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:40.599968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187590+0000","last_change":"2023-11-17T06:29:39.020908+0000","last_active":"2023-11-17T06:29:41.187590+0000","last_peered":"2023-11-17T06:29:41.187590+0000","last_clean":"2023-11-17T06:29:41.187590+0000","last_became_active":"2023-11-17T06:29:39.020586+0000","last_became_peered":"2023-11-17T06:29:39.020586+0000","last_unstale":"2023-11-17T06:29:41.187590+0000","last_undegraded":"2023-11-17T06:29:41.187590+0000","last_fullsized":"2023-11-17T06:29:41.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187260+0000","last_change":"2023-11-17T06:29:39.021831+0000","last_active":"2023-11-17T06:29:41.187260+0000","last_peered":"2023-11-17T06:29:41.187260+0000","last_clean":"2023-11-17T06:29:41.187260+0000","last_became_active":"2023-11-17T06:29:39.019316+0000","last_became_peered":"2023-11-17T06:29:39.019316+0000","last_unstale":"2023-11-17T06:29:41.187260+0000","last_undegraded":"2023-11-17T06:29:41.187260+0000","last_fullsized":"2023-11-17T06:29:41.187260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187226+0000","last_change":"2023-11-17T06:29:40.045533+0000","last_active":"2023-11-17T06:29:41.187226+0000","last_peered":"2023-11-17T06:29:41.187226+0000","last_clean":"2023-11-17T06:29:41.187226+0000","last_became_active":"2023-11-17T06:29:40.045114+0000","last_became_peered":"2023-11-17T06:29:40.045114+0000","last_unstale":"2023-11-17T06:29:41.187226+0000","last_undegraded":"2023-11-17T06:29:41.187226+0000","last_fullsized":"2023-11-17T06:29:41.187226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036436+0000","last_change":"2023-11-17T06:29:39.017157+0000","last_active":"2023-11-17T06:29:41.036436+0000","last_peered":"2023-11-17T06:29:41.036436+0000","last_clean":"2023-11-17T06:29:41.036436+0000","last_became_active":"2023-11-17T06:29:39.016730+0000","last_became_peered":"2023-11-17T06:29:39.016730+0000","last_unstale":"2023-11-17T06:29:41.036436+0000","last_undegraded":"2023-11-17T06:29:41.036436+0000","last_fullsized":"2023-11-17T06:29:41.036436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107184+0000","last_change":"2023-11-17T06:29:40.049925+0000","last_active":"2023-11-17T06:29:41.107184+0000","last_peered":"2023-11-17T06:29:41.107184+0000","last_clean":"2023-11-17T06:29:41.107184+0000","last_became_active":"2023-11-17T06:29:40.049606+0000","last_became_peered":"2023-11-17T06:29:40.049606+0000","last_unstale":"2023-11-17T06:29:41.107184+0000","last_undegraded":"2023-11-17T06:29:41.107184+0000","last_fullsized":"2023-11-17T06:29:41.107184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:05.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187631+0000","last_change":"2023-11-17T06:29:39.022881+0000","last_active":"2023-11-17T06:29:41.187631+0000","last_peered":"2023-11-17T06:29:41.187631+0000","last_clean":"2023-11-17T06:29:41.187631+0000","last_became_active":"2023-11-17T06:29:39.022626+0000","last_became_peered":"2023-11-17T06:29:39.022626+0000","last_unstale":"2023-11-17T06:29:41.187631+0000","last_undegraded":"2023-11-17T06:29:41.187631+0000","last_fullsized":"2023-11-17T06:29:41.187631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036999+0000","last_change":"2023-11-17T06:29:40.064114+0000","last_active":"2023-11-17T06:29:41.036999+0000","last_peered":"2023-11-17T06:29:41.036999+0000","last_clean":"2023-11-17T06:29:41.036999+0000","last_became_active":"2023-11-17T06:29:40.063813+0000","last_became_peered":"2023-11-17T06:29:40.063813+0000","last_unstale":"2023-11-17T06:29:41.036999+0000","last_undegraded":"2023-11-17T06:29:41.036999+0000","last_fullsized":"2023-11-17T06:29:41.036999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037198+0000","last_change":"2023-11-17T06:29:39.021771+0000","last_active":"2023-11-17T06:29:41.037198+0000","last_peered":"2023-11-17T06:29:41.037198+0000","last_clean":"2023-11-17T06:29:41.037198+0000","last_became_active":"2023-11-17T06:29:39.020672+0000","last_became_peered":"2023-11-17T06:29:39.020672+0000","last_unstale":"2023-11-17T06:29:41.037198+0000","last_undegraded":"2023-11-17T06:29:41.037198+0000","last_fullsized":"2023-11-17T06:29:41.037198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:51.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189905+0000","last_change":"2023-11-17T06:29:40.034173+0000","last_active":"2023-11-17T06:29:41.189905+0000","last_peered":"2023-11-17T06:29:41.189905+0000","last_clean":"2023-11-17T06:29:41.189905+0000","last_became_active":"2023-11-17T06:29:40.033194+0000","last_became_peered":"2023-11-17T06:29:40.033194+0000","last_unstale":"2023-11-17T06:29:41.189905+0000","last_undegraded":"2023-11-17T06:29:41.189905+0000","last_fullsized":"2023-11-17T06:29:41.189905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107726+0000","last_change":"2023-11-17T06:29:39.017388+0000","last_active":"2023-11-17T06:29:41.107726+0000","last_peered":"2023-11-17T06:29:41.107726+0000","last_clean":"2023-11-17T06:29:41.107726+0000","last_became_active":"2023-11-17T06:29:39.017072+0000","last_became_peered":"2023-11-17T06:29:39.017072+0000","last_unstale":"2023-11-17T06:29:41.107726+0000","last_undegraded":"2023-11-17T06:29:41.107726+0000","last_fullsized":"2023-11-17T06:29:41.107726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039292+0000","last_change":"2023-11-17T06:29:40.047302+0000","last_active":"2023-11-17T06:29:41.039292+0000","last_peered":"2023-11-17T06:29:41.039292+0000","last_clean":"2023-11-17T06:29:41.039292+0000","last_became_active":"2023-11-17T06:29:40.043674+0000","last_became_peered":"2023-11-17T06:29:40.043674+0000","last_unstale":"2023-11-17T06:29:41.039292+0000","last_undegraded":"2023-11-17T06:29:41.039292+0000","last_fullsized":"2023-11-17T06:29:41.039292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:22.180553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187418+0000","last_change":"2023-11-17T06:29:39.017824+0000","last_active":"2023-11-17T06:29:41.187418+0000","last_peered":"2023-11-17T06:29:41.187418+0000","last_clean":"2023-11-17T06:29:41.187418+0000","last_became_active":"2023-11-17T06:29:39.016946+0000","last_became_peered":"2023-11-17T06:29:39.016946+0000","last_unstale":"2023-11-17T06:29:41.187418+0000","last_undegraded":"2023-11-17T06:29:41.187418+0000","last_fullsized":"2023-11-17T06:29:41.187418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.049717+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.048800+0000","last_became_peered":"2023-11-17T06:29:40.048800+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189065+0000","last_change":"2023-11-17T06:29:39.015752+0000","last_active":"2023-11-17T06:29:41.189065+0000","last_peered":"2023-11-17T06:29:41.189065+0000","last_clean":"2023-11-17T06:29:41.189065+0000","last_became_active":"2023-11-17T06:29:39.015186+0000","last_became_peered":"2023-11-17T06:29:39.015186+0000","last_unstale":"2023-11-17T06:29:41.189065+0000","last_undegraded":"2023-11-17T06:29:41.189065+0000","last_fullsized":"2023-11-17T06:29:41.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189437+0000","last_change":"2023-11-17T06:29:40.031730+0000","last_active":"2023-11-17T06:29:41.189437+0000","last_peered":"2023-11-17T06:29:41.189437+0000","last_clean":"2023-11-17T06:29:41.189437+0000","last_became_active":"2023-11-17T06:29:40.031393+0000","last_became_peered":"2023-11-17T06:29:40.031393+0000","last_unstale":"2023-11-17T06:29:41.189437+0000","last_undegraded":"2023-11-17T06:29:41.189437+0000","last_fullsized":"2023-11-17T06:29:41.189437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037146+0000","last_change":"2023-11-17T06:29:39.018521+0000","last_active":"2023-11-17T06:29:41.037146+0000","last_peered":"2023-11-17T06:29:41.037146+0000","last_clean":"2023-11-17T06:29:41.037146+0000","last_became_active":"2023-11-17T06:29:39.016769+0000","last_became_peered":"2023-11-17T06:29:39.016769+0000","last_unstale":"2023-11-17T06:29:41.037146+0000","last_undegraded":"2023-11-17T06:29:41.037146+0000","last_fullsized":"2023-11-17T06:29:41.037146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:24.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151548+0000","last_change":"2023-11-17T06:29:40.058720+0000","last_active":"2023-11-17T06:29:41.151548+0000","last_peered":"2023-11-17T06:29:41.151548+0000","last_clean":"2023-11-17T06:29:41.151548+0000","last_became_active":"2023-11-17T06:29:40.057027+0000","last_became_peered":"2023-11-17T06:29:40.057027+0000","last_unstale":"2023-11-17T06:29:41.151548+0000","last_undegraded":"2023-11-17T06:29:41.151548+0000","last_fullsized":"2023-11-17T06:29:41.151548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187287+0000","last_change":"2023-11-17T06:29:39.019273+0000","last_active":"2023-11-17T06:29:41.187287+0000","last_peered":"2023-11-17T06:29:41.187287+0000","last_clean":"2023-11-17T06:29:41.187287+0000","last_became_active":"2023-11-17T06:29:39.017424+0000","last_became_peered":"2023-11-17T06:29:39.017424+0000","last_unstale":"2023-11-17T06:29:41.187287+0000","last_undegraded":"2023-11-17T06:29:41.187287+0000","last_fullsized":"2023-11-17T06:29:41.187287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187172+0000","last_change":"2023-11-17T06:29:40.052673+0000","last_active":"2023-11-17T06:29:41.187172+0000","last_peered":"2023-11-17T06:29:41.187172+0000","last_clean":"2023-11-17T06:29:41.187172+0000","last_became_active":"2023-11-17T06:29:40.052360+0000","last_became_peered":"2023-11-17T06:29:40.052360+0000","last_unstale":"2023-11-17T06:29:41.187172+0000","last_undegraded":"2023-11-17T06:29:41.187172+0000","last_fullsized":"2023-11-17T06:29:41.187172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:42:52.119503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033791+0000","last_change":"2023-11-17T06:29:39.012145+0000","last_active":"2023-11-17T06:29:41.033791+0000","last_peered":"2023-11-17T06:29:41.033791+0000","last_clean":"2023-11-17T06:29:41.033791+0000","last_became_active":"2023-11-17T06:29:39.011840+0000","last_became_peered":"2023-11-17T06:29:39.011840+0000","last_unstale":"2023-11-17T06:29:41.033791+0000","last_undegraded":"2023-11-17T06:29:41.033791+0000","last_fullsized":"2023-11-17T06:29:41.033791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:14:03.642188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151184+0000","last_change":"2023-11-17T06:29:40.047955+0000","last_active":"2023-11-17T06:29:41.151184+0000","last_peered":"2023-11-17T06:29:41.151184+0000","last_clean":"2023-11-17T06:29:41.151184+0000","last_became_active":"2023-11-17T06:29:40.047530+0000","last_became_peered":"2023-11-17T06:29:40.047530+0000","last_unstale":"2023-11-17T06:29:41.151184+0000","last_undegraded":"2023-11-17T06:29:41.151184+0000","last_fullsized":"2023-11-17T06:29:41.151184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.039359+0000","last_change":"2023-11-17T06:29:39.015633+0000","last_active":"2023-11-17T06:29:41.039359+0000","last_peered":"2023-11-17T06:29:41.039359+0000","last_clean":"2023-11-17T06:29:41.039359+0000","last_became_active":"2023-11-17T06:29:39.015301+0000","last_became_peered":"2023-11-17T06:29:39.015301+0000","last_unstale":"2023-11-17T06:29:41.039359+0000","last_undegraded":"2023-11-17T06:29:41.039359+0000","last_fullsized":"2023-11-17T06:29:41.039359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152124+0000","last_change":"2023-11-17T06:29:40.056743+0000","last_active":"2023-11-17T06:29:41.152124+0000","last_peered":"2023-11-17T06:29:41.152124+0000","last_clean":"2023-11-17T06:29:41.152124+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152124+0000","last_undegraded":"2023-11-17T06:29:41.152124+0000","last_fullsized":"2023-11-17T06:29:41.152124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:48:00.372978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.034190+0000","last_change":"2023-11-17T06:29:39.018457+0000","last_active":"2023-11-17T06:29:41.034190+0000","last_peered":"2023-11-17T06:29:41.034190+0000","last_clean":"2023-11-17T06:29:41.034190+0000","last_became_active":"2023-11-17T06:29:39.014204+0000","last_became_peered":"2023-11-17T06:29:39.014204+0000","last_unstale":"2023-11-17T06:29:41.034190+0000","last_undegraded":"2023-11-17T06:29:41.034190+0000","last_fullsized":"2023-11-17T06:29:41.034190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:16:50.646078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152267+0000","last_change":"2023-11-17T06:29:40.056354+0000","last_active":"2023-11-17T06:29:41.152267+0000","last_peered":"2023-11-17T06:29:41.152267+0000","last_clean":"2023-11-17T06:29:41.152267+0000","last_became_active":"2023-11-17T06:29:40.055275+0000","last_became_peered":"2023-11-17T06:29:40.055275+0000","last_unstale":"2023-11-17T06:29:41.152267+0000","last_undegraded":"2023-11-17T06:29:41.152267+0000","last_fullsized":"2023-11-17T06:29:41.152267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:13:49.943175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107824+0000","last_change":"2023-11-17T06:29:39.006221+0000","last_active":"2023-11-17T06:29:41.107824+0000","last_peered":"2023-11-17T06:29:41.107824+0000","last_clean":"2023-11-17T06:29:41.107824+0000","last_became_active":"2023-11-17T06:29:39.005712+0000","last_became_peered":"2023-11-17T06:29:39.005712+0000","last_unstale":"2023-11-17T06:29:41.107824+0000","last_undegraded":"2023-11-17T06:29:41.107824+0000","last_fullsized":"2023-11-17T06:29:41.107824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037120+0000","last_change":"2023-11-17T06:29:40.054044+0000","last_active":"2023-11-17T06:29:41.037120+0000","last_peered":"2023-11-17T06:29:41.037120+0000","last_clean":"2023-11-17T06:29:41.037120+0000","last_became_active":"2023-11-17T06:29:40.050897+0000","last_became_peered":"2023-11-17T06:29:40.050897+0000","last_unstale":"2023-11-17T06:29:41.037120+0000","last_undegraded":"2023-11-17T06:29:41.037120+0000","last_fullsized":"2023-11-17T06:29:41.037120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:47:30.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033921+0000","last_change":"2023-11-17T06:29:39.018173+0000","last_active":"2023-11-17T06:29:41.033921+0000","last_peered":"2023-11-17T06:29:41.033921+0000","last_clean":"2023-11-17T06:29:41.033921+0000","last_became_active":"2023-11-17T06:29:39.017909+0000","last_became_peered":"2023-11-17T06:29:39.017909+0000","last_unstale":"2023-11-17T06:29:41.033921+0000","last_undegraded":"2023-11-17T06:29:41.033921+0000","last_fullsized":"2023-11-17T06:29:41.033921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:57.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151757+0000","last_change":"2023-11-17T06:29:40.067949+0000","last_active":"2023-11-17T06:29:41.151757+0000","last_peered":"2023-11-17T06:29:41.151757+0000","last_clean":"2023-11-17T06:29:41.151757+0000","last_became_active":"2023-11-17T06:29:40.065233+0000","last_became_peered":"2023-11-17T06:29:40.065233+0000","last_unstale":"2023-11-17T06:29:41.151757+0000","last_undegraded":"2023-11-17T06:29:41.151757+0000","last_fullsized":"2023-11-17T06:29:41.151757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:48:05.316336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-17T06:29:40.021755+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:29:40.021755+0000","last_peered":"2023-11-17T06:29:40.021755+0000","last_clean":"2023-11-17T06:29:40.021755+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:29:40.021755+0000","last_undegraded":"2023-11-17T06:29:40.021755+0000","last_fullsized":"2023-11-17T06:29:40.021755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.035967+0000","last_change":"2023-11-17T06:29:39.012948+0000","last_active":"2023-11-17T06:29:41.035967+0000","last_peered":"2023-11-17T06:29:41.035967+0000","last_clean":"2023-11-17T06:29:41.035967+0000","last_became_active":"2023-11-17T06:29:39.012399+0000","last_became_peered":"2023-11-17T06:29:39.012399+0000","last_unstale":"2023-11-17T06:29:41.035967+0000","last_undegraded":"2023-11-17T06:29:41.035967+0000","last_fullsized":"2023-11-17T06:29:41.035967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:11:04.513942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187413+0000","last_change":"2023-11-17T06:29:40.067314+0000","last_active":"2023-11-17T06:29:41.187413+0000","last_peered":"2023-11-17T06:29:41.187413+0000","last_clean":"2023-11-17T06:29:41.187413+0000","last_became_active":"2023-11-17T06:29:40.067024+0000","last_became_peered":"2023-11-17T06:29:40.067024+0000","last_unstale":"2023-11-17T06:29:41.187413+0000","last_undegraded":"2023-11-17T06:29:41.187413+0000","last_fullsized":"2023-11-17T06:29:41.187413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150983+0000","last_change":"2023-11-17T06:29:39.018265+0000","last_active":"2023-11-17T06:29:41.150983+0000","last_peered":"2023-11-17T06:29:41.150983+0000","last_clean":"2023-11-17T06:29:41.150983+0000","last_became_active":"2023-11-17T06:29:39.017921+0000","last_became_peered":"2023-11-17T06:29:39.017921+0000","last_unstale":"2023-11-17T06:29:41.150983+0000","last_undegraded":"2023-11-17T06:29:41.150983+0000","last_fullsized":"2023-11-17T06:29:41.150983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:36:21.174865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.188592+0000","last_change":"2023-11-17T06:29:40.058305+0000","last_active":"2023-11-17T06:29:41.188592+0000","last_peered":"2023-11-17T06:29:41.188592+0000","last_clean":"2023-11-17T06:29:41.188592+0000","last_became_active":"2023-11-17T06:29:40.058045+0000","last_became_peered":"2023-11-17T06:29:40.058045+0000","last_unstale":"2023-11-17T06:29:41.188592+0000","last_undegraded":"2023-11-17T06:29:41.188592+0000","last_fullsized":"2023-11-17T06:29:41.188592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:48.722666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.033924+0000","last_change":"2023-11-17T06:29:39.009964+0000","last_active":"2023-11-17T06:29:41.033924+0000","last_peered":"2023-11-17T06:29:41.033924+0000","last_clean":"2023-11-17T06:29:41.033924+0000","last_became_active":"2023-11-17T06:29:39.007573+0000","last_became_peered":"2023-11-17T06:29:39.007573+0000","last_unstale":"2023-11-17T06:29:41.033924+0000","last_undegraded":"2023-11-17T06:29:41.033924+0000","last_fullsized":"2023-11-17T06:29:41.033924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:00:22.924749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107525+0000","last_change":"2023-11-17T06:29:40.038796+0000","last_active":"2023-11-17T06:29:41.107525+0000","last_peered":"2023-11-17T06:29:41.107525+0000","last_clean":"2023-11-17T06:29:41.107525+0000","last_became_active":"2023-11-17T06:29:40.038469+0000","last_became_peered":"2023-11-17T06:29:40.038469+0000","last_unstale":"2023-11-17T06:29:41.107525+0000","last_undegraded":"2023-11-17T06:29:41.107525+0000","last_fullsized":"2023-11-17T06:29:41.107525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.037187+0000","last_change":"2023-11-17T06:29:39.007112+0000","last_active":"2023-11-17T06:29:41.037187+0000","last_peered":"2023-11-17T06:29:41.037187+0000","last_clean":"2023-11-17T06:29:41.037187+0000","last_became_active":"2023-11-17T06:29:39.006736+0000","last_became_peered":"2023-11-17T06:29:39.006736+0000","last_unstale":"2023-11-17T06:29:41.037187+0000","last_undegraded":"2023-11-17T06:29:41.037187+0000","last_fullsized":"2023-11-17T06:29:41.037187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038938+0000","last_change":"2023-11-17T06:29:40.059681+0000","last_active":"2023-11-17T06:29:41.038938+0000","last_peered":"2023-11-17T06:29:41.038938+0000","last_clean":"2023-11-17T06:29:41.038938+0000","last_became_active":"2023-11-17T06:29:40.059165+0000","last_became_peered":"2023-11-17T06:29:40.059165+0000","last_unstale":"2023-11-17T06:29:41.038938+0000","last_undegraded":"2023-11-17T06:29:41.038938+0000","last_fullsized":"2023-11-17T06:29:41.038938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:58.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107450+0000","last_change":"2023-11-17T06:29:39.015572+0000","last_active":"2023-11-17T06:29:41.107450+0000","last_peered":"2023-11-17T06:29:41.107450+0000","last_clean":"2023-11-17T06:29:41.107450+0000","last_became_active":"2023-11-17T06:29:39.015272+0000","last_became_peered":"2023-11-17T06:29:39.015272+0000","last_unstale":"2023-11-17T06:29:41.107450+0000","last_undegraded":"2023-11-17T06:29:41.107450+0000","last_fullsized":"2023-11-17T06:29:41.107450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:47.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036928+0000","last_change":"2023-11-17T06:29:40.054094+0000","last_active":"2023-11-17T06:29:41.036928+0000","last_peered":"2023-11-17T06:29:41.036928+0000","last_clean":"2023-11-17T06:29:41.036928+0000","last_became_active":"2023-11-17T06:29:40.053816+0000","last_became_peered":"2023-11-17T06:29:40.053816+0000","last_unstale":"2023-11-17T06:29:41.036928+0000","last_undegraded":"2023-11-17T06:29:41.036928+0000","last_fullsized":"2023-11-17T06:29:41.036928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:17:15.415870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152236+0000","last_change":"2023-11-17T06:29:39.019355+0000","last_active":"2023-11-17T06:29:41.152236+0000","last_peered":"2023-11-17T06:29:41.152236+0000","last_clean":"2023-11-17T06:29:41.152236+0000","last_became_active":"2023-11-17T06:29:39.019090+0000","last_became_peered":"2023-11-17T06:29:39.019090+0000","last_unstale":"2023-11-17T06:29:41.152236+0000","last_undegraded":"2023-11-17T06:29:41.152236+0000","last_fullsized":"2023-11-17T06:29:41.152236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:35.188435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107457+0000","last_change":"2023-11-17T06:29:40.043278+0000","last_active":"2023-11-17T06:29:41.107457+0000","last_peered":"2023-11-17T06:29:41.107457+0000","last_clean":"2023-11-17T06:29:41.107457+0000","last_became_active":"2023-11-17T06:29:40.043106+0000","last_became_peered":"2023-11-17T06:29:40.043106+0000","last_unstale":"2023-11-17T06:29:41.107457+0000","last_undegraded":"2023-11-17T06:29:41.107457+0000","last_fullsized":"2023-11-17T06:29:41.107457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:38:25.847076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:42.340878+0000","last_change":"2023-11-17T06:29:39.020748+0000","last_active":"2023-11-17T06:29:42.340878+0000","last_peered":"2023-11-17T06:29:42.340878+0000","last_clean":"2023-11-17T06:29:42.340878+0000","last_became_active":"2023-11-17T06:29:39.020192+0000","last_became_peered":"2023-11-17T06:29:39.020192+0000","last_unstale":"2023-11-17T06:29:42.340878+0000","last_undegraded":"2023-11-17T06:29:42.340878+0000","last_fullsized":"2023-11-17T06:29:42.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189551+0000","last_change":"2023-11-17T06:29:40.044168+0000","last_active":"2023-11-17T06:29:41.189551+0000","last_peered":"2023-11-17T06:29:41.189551+0000","last_clean":"2023-11-17T06:29:41.189551+0000","last_became_active":"2023-11-17T06:29:40.043816+0000","last_became_peered":"2023-11-17T06:29:40.043816+0000","last_unstale":"2023-11-17T06:29:41.189551+0000","last_undegraded":"2023-11-17T06:29:41.189551+0000","last_fullsized":"2023-11-17T06:29:41.189551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187665+0000","last_change":"2023-11-17T06:29:39.014734+0000","last_active":"2023-11-17T06:29:41.187665+0000","last_peered":"2023-11-17T06:29:41.187665+0000","last_clean":"2023-11-17T06:29:41.187665+0000","last_became_active":"2023-11-17T06:29:39.014327+0000","last_became_peered":"2023-11-17T06:29:39.014327+0000","last_unstale":"2023-11-17T06:29:41.187665+0000","last_undegraded":"2023-11-17T06:29:41.187665+0000","last_fullsized":"2023-11-17T06:29:41.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:06:39.594279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.190089+0000","last_change":"2023-11-17T06:29:40.062903+0000","last_active":"2023-11-17T06:29:41.190089+0000","last_peered":"2023-11-17T06:29:41.190089+0000","last_clean":"2023-11-17T06:29:41.190089+0000","last_became_active":"2023-11-17T06:29:40.062579+0000","last_became_peered":"2023-11-17T06:29:40.062579+0000","last_unstale":"2023-11-17T06:29:41.190089+0000","last_undegraded":"2023-11-17T06:29:41.190089+0000","last_fullsized":"2023-11-17T06:29:41.190089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.150984+0000","last_change":"2023-11-17T06:29:39.021850+0000","last_active":"2023-11-17T06:29:41.150984+0000","last_peered":"2023-11-17T06:29:41.150984+0000","last_clean":"2023-11-17T06:29:41.150984+0000","last_became_active":"2023-11-17T06:29:39.017210+0000","last_became_peered":"2023-11-17T06:29:39.017210+0000","last_unstale":"2023-11-17T06:29:41.150984+0000","last_undegraded":"2023-11-17T06:29:41.150984+0000","last_fullsized":"2023-11-17T06:29:41.150984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:54:26.995063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.038808+0000","last_change":"2023-11-17T06:29:40.062837+0000","last_active":"2023-11-17T06:29:41.038808+0000","last_peered":"2023-11-17T06:29:41.038808+0000","last_clean":"2023-11-17T06:29:41.038808+0000","last_became_active":"2023-11-17T06:29:40.062553+0000","last_became_peered":"2023-11-17T06:29:40.062553+0000","last_unstale":"2023-11-17T06:29:41.038808+0000","last_undegraded":"2023-11-17T06:29:41.038808+0000","last_fullsized":"2023-11-17T06:29:41.038808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:20:05.317093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107283+0000","last_change":"2023-11-17T06:29:39.010652+0000","last_active":"2023-11-17T06:29:41.107283+0000","last_peered":"2023-11-17T06:29:41.107283+0000","last_clean":"2023-11-17T06:29:41.107283+0000","last_became_active":"2023-11-17T06:29:39.009663+0000","last_became_peered":"2023-11-17T06:29:39.009663+0000","last_unstale":"2023-11-17T06:29:41.107283+0000","last_undegraded":"2023-11-17T06:29:41.107283+0000","last_fullsized":"2023-11-17T06:29:41.107283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:45:50.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187492+0000","last_change":"2023-11-17T06:29:40.046969+0000","last_active":"2023-11-17T06:29:41.187492+0000","last_peered":"2023-11-17T06:29:41.187492+0000","last_clean":"2023-11-17T06:29:41.187492+0000","last_became_active":"2023-11-17T06:29:40.046400+0000","last_became_peered":"2023-11-17T06:29:40.046400+0000","last_unstale":"2023-11-17T06:29:41.187492+0000","last_undegraded":"2023-11-17T06:29:41.187492+0000","last_fullsized":"2023-11-17T06:29:41.187492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:27.476987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.107727+0000","last_change":"2023-11-17T06:29:39.015476+0000","last_active":"2023-11-17T06:29:41.107727+0000","last_peered":"2023-11-17T06:29:41.107727+0000","last_clean":"2023-11-17T06:29:41.107727+0000","last_became_active":"2023-11-17T06:29:39.015166+0000","last_became_peered":"2023-11-17T06:29:39.015166+0000","last_unstale":"2023-11-17T06:29:41.107727+0000","last_undegraded":"2023-11-17T06:29:41.107727+0000","last_fullsized":"2023-11-17T06:29:41.107727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:14:54.501399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187769+0000","last_change":"2023-11-17T06:29:40.044575+0000","last_active":"2023-11-17T06:29:41.187769+0000","last_peered":"2023-11-17T06:29:41.187769+0000","last_clean":"2023-11-17T06:29:41.187769+0000","last_became_active":"2023-11-17T06:29:40.044313+0000","last_became_peered":"2023-11-17T06:29:40.044313+0000","last_unstale":"2023-11-17T06:29:41.187769+0000","last_undegraded":"2023-11-17T06:29:41.187769+0000","last_fullsized":"2023-11-17T06:29:41.187769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:46:36.194123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151785+0000","last_change":"2023-11-17T06:29:39.022524+0000","last_active":"2023-11-17T06:29:41.151785+0000","last_peered":"2023-11-17T06:29:41.151785+0000","last_clean":"2023-11-17T06:29:41.151785+0000","last_became_active":"2023-11-17T06:29:39.022245+0000","last_became_peered":"2023-11-17T06:29:39.022245+0000","last_unstale":"2023-11-17T06:29:41.151785+0000","last_undegraded":"2023-11-17T06:29:41.151785+0000","last_fullsized":"2023-11-17T06:29:41.151785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:26.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.187140+0000","last_change":"2023-11-17T06:29:40.050948+0000","last_active":"2023-11-17T06:29:41.187140+0000","last_peered":"2023-11-17T06:29:41.187140+0000","last_clean":"2023-11-17T06:29:41.187140+0000","last_became_active":"2023-11-17T06:29:40.050407+0000","last_became_peered":"2023-11-17T06:29:40.050407+0000","last_unstale":"2023-11-17T06:29:41.187140+0000","last_undegraded":"2023-11-17T06:29:41.187140+0000","last_fullsized":"2023-11-17T06:29:41.187140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:10.576623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036601+0000","last_change":"2023-11-17T06:29:40.064292+0000","last_active":"2023-11-17T06:29:41.036601+0000","last_peered":"2023-11-17T06:29:41.036601+0000","last_clean":"2023-11-17T06:29:41.036601+0000","last_became_active":"2023-11-17T06:29:40.063950+0000","last_became_peered":"2023-11-17T06:29:40.063950+0000","last_unstale":"2023-11-17T06:29:41.036601+0000","last_undegraded":"2023-11-17T06:29:41.036601+0000","last_fullsized":"2023-11-17T06:29:41.036601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.517369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.151542+0000","last_change":"2023-11-17T06:29:39.026270+0000","last_active":"2023-11-17T06:29:41.151542+0000","last_peered":"2023-11-17T06:29:41.151542+0000","last_clean":"2023-11-17T06:29:41.151542+0000","last_became_active":"2023-11-17T06:29:39.025930+0000","last_became_peered":"2023-11-17T06:29:39.025930+0000","last_unstale":"2023-11-17T06:29:41.151542+0000","last_undegraded":"2023-11-17T06:29:41.151542+0000","last_fullsized":"2023-11-17T06:29:41.151542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:02.074512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.036867+0000","last_change":"2023-11-17T06:29:40.054287+0000","last_active":"2023-11-17T06:29:41.036867+0000","last_peered":"2023-11-17T06:29:41.036867+0000","last_clean":"2023-11-17T06:29:41.036867+0000","last_became_active":"2023-11-17T06:29:40.053760+0000","last_became_peered":"2023-11-17T06:29:40.053760+0000","last_unstale":"2023-11-17T06:29:41.036867+0000","last_undegraded":"2023-11-17T06:29:41.036867+0000","last_fullsized":"2023-11-17T06:29:41.036867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:03:46.506037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.152006+0000","last_change":"2023-11-17T06:29:39.021077+0000","last_active":"2023-11-17T06:29:41.152006+0000","last_peered":"2023-11-17T06:29:41.152006+0000","last_clean":"2023-11-17T06:29:41.152006+0000","last_became_active":"2023-11-17T06:29:39.020821+0000","last_became_peered":"2023-11-17T06:29:39.020821+0000","last_unstale":"2023-11-17T06:29:41.152006+0000","last_undegraded":"2023-11-17T06:29:41.152006+0000","last_fullsized":"2023-11-17T06:29:41.152006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:45:09.570935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189999+0000","last_change":"2023-11-17T06:29:40.065696+0000","last_active":"2023-11-17T06:29:41.189999+0000","last_peered":"2023-11-17T06:29:41.189999+0000","last_clean":"2023-11-17T06:29:41.189999+0000","last_became_active":"2023-11-17T06:29:40.065459+0000","last_became_peered":"2023-11-17T06:29:40.065459+0000","last_unstale":"2023-11-17T06:29:41.189999+0000","last_undegraded":"2023-11-17T06:29:41.189999+0000","last_fullsized":"2023-11-17T06:29:41.189999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:39:03.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189626+0000","last_change":"2023-11-17T06:29:39.014916+0000","last_active":"2023-11-17T06:29:41.189626+0000","last_peered":"2023-11-17T06:29:41.189626+0000","last_clean":"2023-11-17T06:29:41.189626+0000","last_became_active":"2023-11-17T06:29:39.014625+0000","last_became_peered":"2023-11-17T06:29:39.014625+0000","last_unstale":"2023-11-17T06:29:41.189626+0000","last_undegraded":"2023-11-17T06:29:41.189626+0000","last_fullsized":"2023-11-17T06:29:41.189626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:15:57.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189444+0000","last_change":"2023-11-17T06:29:40.054935+0000","last_active":"2023-11-17T06:29:41.189444+0000","last_peered":"2023-11-17T06:29:41.189444+0000","last_clean":"2023-11-17T06:29:41.189444+0000","last_became_active":"2023-11-17T06:29:40.054651+0000","last_became_peered":"2023-11-17T06:29:40.054651+0000","last_unstale":"2023-11-17T06:29:41.189444+0000","last_undegraded":"2023-11-17T06:29:41.189444+0000","last_fullsized":"2023-11-17T06:29:41.189444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:38.973329+0000","last_clean_scrub_stamp":"2023-11-17T06:29:38.973329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:10:51.063692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:41.189996+0000","last_change":"2023-11-17T06:29:39.020080+0000","last_active":"2023-11-17T06:29:41.189996+0000","last_peered":"2023-11-17T06:29:41.189996+0000","last_clean":"2023-11-17T06:29:41.189996+0000","last_became_active":"2023-11-17T06:29:39.018857+0000","last_became_peered":"2023-11-17T06:29:39.018857+0000","last_unstale":"2023-11-17T06:29:41.189996+0000","last_undegraded":"2023-11-17T06:29:41.189996+0000","last_fullsized":"2023-11-17T06:29:41.189996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:37.967641+0000","last_clean_scrub_stamp":"2023-11-17T06:29:37.967641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:29:58.754286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.7590000000000003,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":4.7590000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":4.9610000000000003,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":4.9610000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":5.0300000000000002,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":5.0300000000000002},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":5.0590000000000002}]},{"osd":2,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":4.8319999999999999},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":4.8070000000000004}]},{"osd":4,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.276},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.1040000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.331},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0920000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.94599999999999995}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.421}]},{"osd":3,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.208}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.141},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.383}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.5389999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.466},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.133},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.361}]},{"osd":1,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.226},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.206}]},{"osd":2,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.298}]},{"osd":3,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":1.111}]},{"osd":4,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.7250000000000001,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.423}]},{"osd":6,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":3.2370000000000001,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.474},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.5}]},{"osd":7,"last update":"Fri Nov 17 06:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":3.355,"5min":3.355,"15min":3.355},"last":1.5529999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":80752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.113}]},{"osd":1,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.056},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.2450000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":1.732,"15min":1.732},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":9.4499999999999993,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.302},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":9.2910000000000004,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.181}]},{"osd":3,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.5429999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.641}]},{"osd":7,"last update":"Fri Nov 17 06:29:46 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.671},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6919999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":82238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.016}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.423}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.444},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.286}]},{"osd":6,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.359},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.399},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.4770000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":80626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.258}]},{"osd":1,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.623},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.216},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.97699999999999998}]},{"osd":5,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.429},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.506}]},{"osd":7,"last update":"Fri Nov 17 06:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.319},{"interface":"front","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.615}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":4.2220000000000004},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.753}]},{"osd":3,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":4.0640000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.7370000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3,"5min":3,"15min":3},"last":3.891}]},{"osd":5,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":3.9430000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.609,"15min":1.609},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.877},{"interface":"front","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":3.9820000000000002}]},{"osd":7,"last update":"Fri Nov 17 06:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.123},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.321},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.3660000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.091}]},{"osd":3,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.87},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1890000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.3359999999999999,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.399}]},{"osd":6,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:29:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.216,"5min":1.216,"15min":1.216},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.504},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.2929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:29:49.711 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-17T06:29:49.711 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-17T06:29:49.711 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-17T06:29:49.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-17T06:29:49.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 Processor -- start 2023-11-17T06:29:49.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 -- start start 2023-11-17T06:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f78070b90 0x7f4f78070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4f780ce170 0x7f4f7815da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780714b0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f781549a0 con 0x7f4f78070b90 2023-11-17T06:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7d1ed700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7815a3e0 con 0x7f4f780ce170 2023-11-17T06:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7c9ec700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4f780ce5f0 0x7f4f7815df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54528/0 (socket says 172.21.15.100:54528) 2023-11-17T06:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f7c9ec700 1 -- 172.21.15.100:0/2287564800 learned_addr learned my addr 172.21.15.100:0/2287564800 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f77fff700 1 --2- 172.21.15.100:0/2287564800 >> v2:172.21.15.100:3300/0 conn(0x7f4f78070b90 0x7f4f78070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.920+0000 7f4f777fe700 1 --2- 172.21.15.100:0/2287564800 >> v2:172.21.15.119:3300/0 conn(0x7f4f780ce170 0x7f4f7815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f76ffd700 1 -- 172.21.15.100:0/2287564800 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468902856 0 0) 0x7f4f780714b0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f76ffd700 1 -- 172.21.15.100:0/2287564800 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f600035d0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f77fff700 1 -- 172.21.15.100:0/2287564800 >> v2:172.21.15.119:3300/0 conn(0x7f4f780ce170 msgr2=0x7f4f7815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f77fff700 1 --2- 172.21.15.100:0/2287564800 >> v2:172.21.15.119:3300/0 conn(0x7f4f780ce170 0x7f4f7815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f77fff700 1 -- 172.21.15.100:0/2287564800 >> v1:172.21.15.100:6789/0 conn(0x7f4f780ce5f0 legacy=0x7f4f7815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f77fff700 1 -- 172.21.15.100:0/2287564800 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7815a5d0 con 0x7f4f78070b90 2023-11-17T06:29:49.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f77fff700 1 --2- 172.21.15.100:0/2287564800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f78070b90 0x7f4f78070f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f78066a40 tx=0x7f4f68009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c812044110f0a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f76ffd700 1 -- 172.21.15.100:0/2287564800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011830 con 0x7f4f78070b90 2023-11-17T06:29:49.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f76ffd700 1 -- 172.21.15.100:0/2287564800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68011990 con 0x7f4f78070b90 2023-11-17T06:29:49.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f76ffd700 1 -- 172.21.15.100:0/2287564800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011d20 con 0x7f4f78070b90 2023-11-17T06:29:49.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/2287564800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f78070b90 msgr2=0x7f4f78070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/2287564800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f78070b90 0x7f4f78070f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f78066a40 tx=0x7f4f68009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/2287564800 shutdown_connections 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/2287564800 >> v2:172.21.15.119:3300/0 conn(0x7f4f780ce170 0x7f4f7815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/2287564800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f78070b90 0x7f4f78070f70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/2287564800 >> 172.21.15.100:0/2287564800 conn(0x7f4f780cec00 msgr2=0x7f4f780cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/2287564800 shutdown_connections 2023-11-17T06:29:49.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.924+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/2287564800 wait complete. 2023-11-17T06:29:49.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.928+0000 7f4f7d1ed700 1 Processor -- start 2023-11-17T06:29:49.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.928+0000 7f4f7d1ed700 1 -- start start 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.928+0000 7f4f7d1ed700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f78070b90 0x7f4f781479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f780ce170 0x7f4f780c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7814cf20 con 0x7f4f780ce5f0 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78147ef0 con 0x7f4f780ce170 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780c7df0 con 0x7f4f78070b90 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47784/0 (socket says 172.21.15.100:47784) 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 -- 172.21.15.100:0/1504780406 learned_addr learned my addr 172.21.15.100:0/1504780406 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f77fff700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f78070b90 0x7f4f781479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f777fe700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f780ce170 0x7f4f780c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 -- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f78070b90 msgr2=0x7f4f781479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f78070b90 0x7f4f781479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 -- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f780ce170 msgr2=0x7f4f780c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f780ce170 0x7f4f780c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 -- 172.21.15.100:0/1504780406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680094b0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7c9ec700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000cb40 tx=0x7f4f7000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70007500 con 0x7f4f780ce5f0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70007660 con 0x7f4f780ce5f0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700079f0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7814c610 con 0x7f4f780ce5f0 2023-11-17T06:29:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7814b6d0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.932+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7806e3d0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.936+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f7001b3b0 con 0x7f4f780ce5f0 2023-11-17T06:29:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.936+0000 7f4f74ff9700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 0x7f4f640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.936+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f70083910 con 0x7f4f780ce5f0 2023-11-17T06:29:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.936+0000 7f4f77fff700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 0x7f4f640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:49.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.936+0000 7f4f77fff700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 0x7f4f640689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000c00 tx=0x7f4f68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:49.944+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f70050d00 con 0x7f4f780ce5f0 2023-11-17T06:29:50.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.144+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f78072020 con 0x7f4f780ce5f0 2023-11-17T06:29:50.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.144+0000 7f4f74ff9700 1 -- 172.21.15.100:0/1504780406 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4f70054320 con 0x7f4f780ce5f0 2023-11-17T06:29:50.149 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:50.149 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 msgr2=0x7f4f640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 0x7f4f640689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000c00 tx=0x7f4f68008030 comp rx=0 tx=0).stop 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 msgr2=0x7f4f7814d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000cb40 tx=0x7f4f7000cb70 comp rx=0 tx=0).stop 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 shutdown_connections 2023-11-17T06:29:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f64066510 0x7f4f640689d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f780ce5f0 0x7f4f7814d340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f780ce170 0x7f4f780c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 --2- 172.21.15.100:0/1504780406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f78070b90 0x7f4f781479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 >> 172.21.15.100:0/1504780406 conn(0x7f4f780cec00 msgr2=0x7f4f780c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 shutdown_connections 2023-11-17T06:29:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.148+0000 7f4f7d1ed700 1 -- 172.21.15.100:0/1504780406 wait complete. 2023-11-17T06:29:50.172 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-17T06:29:50.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.336+0000 7f7fd640f700 1 Processor -- start 2023-11-17T06:29:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.336+0000 7f7fd640f700 1 -- start start 2023-11-17T06:29:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.336+0000 7f7fd640f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.336+0000 7f7fd640f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fd640f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd0070ad0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fd640f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd015fd40 con 0x7f7fd00cf8a0 2023-11-17T06:29:50.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fd640f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00b13f0 con 0x7f7fd015b0a0 2023-11-17T06:29:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fc77fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fc77fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34302/0 (socket says 172.21.15.100:34302) 2023-11-17T06:29:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fc77fe700 1 -- 172.21.15.100:0/661010629 learned_addr learned my addr 172.21.15.100:0/661010629 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46300/0 (socket says 172.21.15.100:46300) 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 -- 172.21.15.100:0/661010629 >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 msgr2=0x7f7fd00b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 --2- 172.21.15.100:0/661010629 >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 -- 172.21.15.100:0/661010629 >> v1:172.21.15.119:6789/0 conn(0x7f7fd00b0f80 legacy=0x7f7fd00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 -- 172.21.15.100:0/661010629 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0071f20 con 0x7f7fd015b0a0 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcf7fe700 1 -- 172.21.15.100:0/661010629 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889035418 0 0) 0x7f7fd0070ad0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fc77fe700 1 --2- 172.21.15.100:0/661010629 >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:50.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcffff700 1 --2- 172.21.15.100:0/661010629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000dc70 tx=0x7f7fc000df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181be0513bd8e671 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcf7fe700 1 -- 172.21.15.100:0/661010629 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0012070 con 0x7f7fd015b0a0 2023-11-17T06:29:50.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcf7fe700 1 -- 172.21.15.100:0/661010629 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc000d2e0 con 0x7f7fd015b0a0 2023-11-17T06:29:50.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fcf7fe700 1 -- 172.21.15.100:0/661010629 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000f8e0 con 0x7f7fd015b0a0 2023-11-17T06:29:50.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.340+0000 7f7fd640f700 1 -- 172.21.15.100:0/661010629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 msgr2=0x7f7fd00cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 --2- 172.21.15.100:0/661010629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000dc70 tx=0x7f7fc000df80 comp rx=0 tx=0).stop 2023-11-17T06:29:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 -- 172.21.15.100:0/661010629 shutdown_connections 2023-11-17T06:29:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 --2- 172.21.15.100:0/661010629 >> v2:172.21.15.119:3300/0 conn(0x7f7fd00cf8a0 0x7f7fd00b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 --2- 172.21.15.100:0/661010629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd015b0a0 0x7f7fd00cb3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 -- 172.21.15.100:0/661010629 >> 172.21.15.100:0/661010629 conn(0x7f7fd006a270 msgr2=0x7f7fd006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 -- 172.21.15.100:0/661010629 shutdown_connections 2023-11-17T06:29:50.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 -- 172.21.15.100:0/661010629 wait complete. 2023-11-17T06:29:50.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 Processor -- start 2023-11-17T06:29:50.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.344+0000 7f7fd640f700 1 -- start start 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd00cf8a0 0x7f7fd00c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 0x7f7fd0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0158b70 con 0x7f7fd00b0f80 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0158e50 con 0x7f7fd015b0a0 2023-11-17T06:29:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0159130 con 0x7f7fd00cf8a0 2023-11-17T06:29:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47794/0 (socket says 172.21.15.100:47794) 2023-11-17T06:29:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 -- 172.21.15.100:0/3841152316 learned_addr learned my addr 172.21.15.100:0/3841152316 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fc77fe700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd00cf8a0 0x7f7fd00c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd49ac700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 0x7f7fd0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 -- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd00cf8a0 msgr2=0x7f7fd00c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd00cf8a0 0x7f7fd00c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 -- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 msgr2=0x7f7fd0159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 0x7f7fd0159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 -- 172.21.15.100:0/3841152316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009570 con 0x7f7fd00b0f80 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd49ac700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 0x7f7fd0159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:50.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcffff700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b680 tx=0x7f7fc0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000bb90 con 0x7f7fd00b0f80 2023-11-17T06:29:50.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc000bd10 con 0x7f7fd00b0f80 2023-11-17T06:29:50.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc000d950 con 0x7f7fd00b0f80 2023-11-17T06:29:50.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0020680 con 0x7f7fd00b0f80 2023-11-17T06:29:50.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.348+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd01596f0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.352+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd004eea0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.352+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7fc00207e0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.352+0000 7f7fcd7fa700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 0x7f7fb00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.352+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fc00893c0 con 0x7f7fd00b0f80 2023-11-17T06:29:50.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.356+0000 7f7fc77fe700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 0x7f7fb00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.356+0000 7f7fc77fe700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 0x7f7fb00689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009d10 tx=0x7f7fb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.360+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fc0056830 con 0x7f7fd00b0f80 2023-11-17T06:29:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.536+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd00cc240 con 0x7f7fd00b0f80 2023-11-17T06:29:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.536+0000 7f7fcd7fa700 1 -- 172.21.15.100:0/3841152316 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f7fc0059e50 con 0x7f7fd00b0f80 2023-11-17T06:29:50.541 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:50.541 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 msgr2=0x7f7fb00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 0x7f7fb00689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009d10 tx=0x7f7fb8008040 comp rx=0 tx=0).stop 2023-11-17T06:29:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 msgr2=0x7f7fd0140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b680 tx=0x7f7fc0004770 comp rx=0 tx=0).stop 2023-11-17T06:29:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 shutdown_connections 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fd015b0a0 0x7f7fd0159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fd00cf8a0 0x7f7fd00c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7fb0066510 0x7f7fb00689d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 --2- 172.21.15.100:0/3841152316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd00b0f80 0x7f7fd0140300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 >> 172.21.15.100:0/3841152316 conn(0x7f7fd006a270 msgr2=0x7f7fd00b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 shutdown_connections 2023-11-17T06:29:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.540+0000 7f7fd640f700 1 -- 172.21.15.100:0/3841152316 wait complete. 2023-11-17T06:29:50.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:50.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:50.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.748+0000 7f510d460700 1 Processor -- start 2023-11-17T06:29:50.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.748+0000 7f510d460700 1 -- start start 2023-11-17T06:29:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f510815d310 0x7f51080ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51080d2c70 0x7f51080cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f510815d6f0 0x7f51080d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080ce8e0 con 0x7f51080d2c70 2023-11-17T06:29:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080d27e0 con 0x7f510815d310 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f510d460700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080ce630 con 0x7f510815d6f0 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f51067fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51080d2c70 0x7f51080cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f510815d310 0x7f51080ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f510815d310 0x7f51080ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34312/0 (socket says 172.21.15.100:34312) 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 -- 172.21.15.100:0/3469412415 learned_addr learned my addr 172.21.15.100:0/3469412415 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:50.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f51077fe700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f510815d6f0 0x7f51080d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 -- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f510815d6f0 msgr2=0x7f51080d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:50.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f510815d6f0 0x7f51080d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 -- 172.21.15.100:0/3469412415 >> v2:172.21.15.100:3300/0 conn(0x7f51080d2c70 msgr2=0x7f51080cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:50.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3469412415 >> v2:172.21.15.100:3300/0 conn(0x7f51080d2c70 0x7f51080cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 -- 172.21.15.100:0/3469412415 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080d1eb0 con 0x7f510815d310 2023-11-17T06:29:50.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d310 0x7f51080ce0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51080d0d60 tx=0x7f50f8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7a31fd02e7ab77 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5105ffb700 1 -- 172.21.15.100:0/3469412415 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8011830 con 0x7f510815d310 2023-11-17T06:29:50.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5105ffb700 1 -- 172.21.15.100:0/3469412415 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8011990 con 0x7f510815d310 2023-11-17T06:29:50.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.752+0000 7f5105ffb700 1 -- 172.21.15.100:0/3469412415 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8011d20 con 0x7f510815d310 2023-11-17T06:29:50.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d310 msgr2=0x7f51080ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d310 0x7f51080ce0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51080d0d60 tx=0x7f50f8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- 172.21.15.100:0/3469412415 shutdown_connections 2023-11-17T06:29:50.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f510815d6f0 0x7f51080d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 --2- 172.21.15.100:0/3469412415 >> v2:172.21.15.100:3300/0 conn(0x7f51080d2c70 0x7f51080cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 --2- 172.21.15.100:0/3469412415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d310 0x7f51080ce0f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- 172.21.15.100:0/3469412415 >> 172.21.15.100:0/3469412415 conn(0x7f510806b4e0 msgr2=0x7f510806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:50.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- 172.21.15.100:0/3469412415 shutdown_connections 2023-11-17T06:29:50.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- 172.21.15.100:0/3469412415 wait complete. 2023-11-17T06:29:50.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 Processor -- start 2023-11-17T06:29:50.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.756+0000 7f510d460700 1 -- start start 2023-11-17T06:29:50.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51080d2c70 0x7f51080b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d6f0 0x7f51080ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510814c450 con 0x7f510815d310 2023-11-17T06:29:50.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108150250 con 0x7f510815d6f0 2023-11-17T06:29:50.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080cb140 con 0x7f51080d2c70 2023-11-17T06:29:50.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47822/0 (socket says 172.21.15.100:47822) 2023-11-17T06:29:50.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 -- 172.21.15.100:0/3379791754 learned_addr learned my addr 172.21.15.100:0/3379791754 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51080d2c70 0x7f51080b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51077fe700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d6f0 0x7f51080ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 -- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51080d2c70 msgr2=0x7f51080b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51080d2c70 0x7f51080b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 -- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d6f0 msgr2=0x7f51080ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d6f0 0x7f51080ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 -- 172.21.15.100:0/3379791754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009570 con 0x7f510815d310 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f51067fc700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e9d0 tx=0x7f50fc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc009720 con 0x7f510815d310 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00ee70 con 0x7f510815d310 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51080cae60 con 0x7f510815d310 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.760+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00ca50 con 0x7f510815d310 2023-11-17T06:29:50.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.764+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510814c930 con 0x7f510815d310 2023-11-17T06:29:50.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.764+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510804eea0 con 0x7f510815d310 2023-11-17T06:29:50.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.764+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50fc00cbb0 con 0x7f510815d310 2023-11-17T06:29:50.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.768+0000 7f50ef7fe700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 0x7f50f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:50.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.768+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50fc083e00 con 0x7f510815d310 2023-11-17T06:29:50.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.768+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 0x7f50f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:50.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.768+0000 7f5106ffd700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 0x7f50f40689d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50f8000c00 tx=0x7f50f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:50.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.772+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50fc051310 con 0x7f510815d310 2023-11-17T06:29:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.952+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51080b1b30 con 0x7f510815d310 2023-11-17T06:29:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.952+0000 7f50ef7fe700 1 -- 172.21.15.100:0/3379791754 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50fc059e60 con 0x7f510815d310 2023-11-17T06:29:50.955 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:29:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 msgr2=0x7f50f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 0x7f50f40689d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50f8000c00 tx=0x7f50f8008030 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 msgr2=0x7f51080ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e9d0 tx=0x7f50fc00ece0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 shutdown_connections 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510815d6f0 0x7f51080ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f50f4066510 0x7f50f40689d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510815d310 0x7f51080ca2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 --2- 172.21.15.100:0/3379791754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51080d2c70 0x7f51080b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 >> 172.21.15.100:0/3379791754 conn(0x7f510806b4e0 msgr2=0x7f510815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 shutdown_connections 2023-11-17T06:29:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:50.956+0000 7f510d460700 1 -- 172.21.15.100:0/3379791754 wait complete. 2023-11-17T06:29:50.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:29:51.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.152+0000 7fd14bde4700 1 Processor -- start 2023-11-17T06:29:51.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14bde4700 1 -- start start 2023-11-17T06:29:51.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14bde4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 0x7fd1440ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14bde4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440d27e0 con 0x7fd1440d0340 2023-11-17T06:29:51.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14bde4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440ce630 con 0x7fd1440d2c70 2023-11-17T06:29:51.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14bde4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440ce8e0 con 0x7fd14415d310 2023-11-17T06:29:51.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14a381700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd1440d0340 0x7fd1440b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54540/0 (socket says 172.21.15.100:54540) 2023-11-17T06:29:51.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd14a381700 1 -- 172.21.15.100:0/2321106236 learned_addr learned my addr 172.21.15.100:0/2321106236 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:51.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.156+0000 7fd149b80700 1 --2- 172.21.15.100:0/2321106236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 0x7fd1440ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd149b80700 1 -- 172.21.15.100:0/2321106236 >> v1:172.21.15.119:6789/0 conn(0x7fd1440d2c70 legacy=0x7fd1440cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd149b80700 1 -- 172.21.15.100:0/2321106236 >> v1:172.21.15.100:6789/0 conn(0x7fd1440d0340 legacy=0x7fd1440b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd149b80700 1 -- 172.21.15.100:0/2321106236 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440d1eb0 con 0x7fd14415d310 2023-11-17T06:29:51.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd149b80700 1 --2- 172.21.15.100:0/2321106236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 0x7fd1440ce0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd140009880 tx=0x7fd140009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5583f6b43f650bfe server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd148b7e700 1 -- 172.21.15.100:0/2321106236 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140011830 con 0x7fd14415d310 2023-11-17T06:29:51.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd148b7e700 1 -- 172.21.15.100:0/2321106236 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140011990 con 0x7fd14415d310 2023-11-17T06:29:51.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd148b7e700 1 -- 172.21.15.100:0/2321106236 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140011d20 con 0x7fd14415d310 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 -- 172.21.15.100:0/2321106236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 msgr2=0x7fd1440ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 --2- 172.21.15.100:0/2321106236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 0x7fd1440ce0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd140009880 tx=0x7fd140009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 -- 172.21.15.100:0/2321106236 shutdown_connections 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 --2- 172.21.15.100:0/2321106236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd14415d310 0x7fd1440ce0f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 -- 172.21.15.100:0/2321106236 >> 172.21.15.100:0/2321106236 conn(0x7fd14406b4e0 msgr2=0x7fd14406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 -- 172.21.15.100:0/2321106236 shutdown_connections 2023-11-17T06:29:51.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.160+0000 7fd14bde4700 1 -- 172.21.15.100:0/2321106236 wait complete. 2023-11-17T06:29:51.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 Processor -- start 2023-11-17T06:29:51.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 -- start start 2023-11-17T06:29:51.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1440d0340 0x7fd1440cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14415d310 0x7fd1441f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440cd850 con 0x7fd1440d2c70 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440cdc70 con 0x7fd14415d310 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14bde4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440ccbd0 con 0x7fd1440d0340 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.164+0000 7fd14937f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47826/0 (socket says 172.21.15.100:47826) 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 -- 172.21.15.100:0/26722386 learned_addr learned my addr 172.21.15.100:0/26722386 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd149b80700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1440d0340 0x7fd1440cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14a381700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14415d310 0x7fd1441f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 -- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1440d0340 msgr2=0x7fd1440cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1440d0340 0x7fd1440cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 -- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14415d310 msgr2=0x7fd1441f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14415d310 0x7fd1441f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 -- 172.21.15.100:0/26722386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400094b0 con 0x7fd1440d2c70 2023-11-17T06:29:51.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14937f700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c4d0 tx=0x7fd13400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340052d0 con 0x7fd1440d2c70 2023-11-17T06:29:51.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134005430 con 0x7fd1440d2c70 2023-11-17T06:29:51.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340055a0 con 0x7fd1440d2c70 2023-11-17T06:29:51.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440cceb0 con 0x7fd1440d2c70 2023-11-17T06:29:51.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1440cd470 con 0x7fd1440d2c70 2023-11-17T06:29:51.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.168+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1440cd990 con 0x7fd1440d2c70 2023-11-17T06:29:51.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.172+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1340038c0 con 0x7fd1440d2c70 2023-11-17T06:29:51.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.172+0000 7fd13a7fc700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 0x7fd1280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.172+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd134083210 con 0x7fd1440d2c70 2023-11-17T06:29:51.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.172+0000 7fd149b80700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 0x7fd1280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.176+0000 7fd149b80700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 0x7fd1280689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd140000c00 tx=0x7fd14001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.180+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1440cd990 con 0x7fd1440d2c70 2023-11-17T06:29:51.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1440cd990 con 0x7fd1440d2c70 2023-11-17T06:29:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd13a7fc700 1 -- 172.21.15.100:0/26722386 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1440cd990 con 0x7fd1440d2c70 2023-11-17T06:29:51.367 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 msgr2=0x7fd1280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 0x7fd1280689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd140000c00 tx=0x7fd14001c040 comp rx=0 tx=0).stop 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 msgr2=0x7fd1441f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c4d0 tx=0x7fd13400c7e0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 shutdown_connections 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14415d310 0x7fd1441f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd128066510 0x7fd1280689d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1440d2c70 0x7fd1441f6840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 --2- 172.21.15.100:0/26722386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1440d0340 0x7fd1440cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.364+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 >> 172.21.15.100:0/26722386 conn(0x7fd14406b4e0 msgr2=0x7fd14415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.368+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 shutdown_connections 2023-11-17T06:29:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.368+0000 7fd14bde4700 1 -- 172.21.15.100:0/26722386 wait complete. 2023-11-17T06:29:51.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:29:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.568+0000 7fdca4982700 1 Processor -- start 2023-11-17T06:29:51.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.568+0000 7fdca4982700 1 -- start start 2023-11-17T06:29:51.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdca4982700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdca01595a0 0x7fdca00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdca4982700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca0159980 0x7fdca0070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdca4982700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00ccc40 con 0x7fdca006cb10 2023-11-17T06:29:51.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdca4982700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00c9840 con 0x7fdca0159980 2023-11-17T06:29:51.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdca4982700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00c9b10 con 0x7fdca01595a0 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca0159980 0x7fdca0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca0159980 0x7fdca0070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47828/0 (socket says 172.21.15.100:47828) 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 -- 172.21.15.100:0/1795732285 learned_addr learned my addr 172.21.15.100:0/1795732285 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9f7fe700 1 --2- 172.21.15.100:0/1795732285 >> v2:172.21.15.119:3300/0 conn(0x7fdca01595a0 0x7fdca00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 -- 172.21.15.100:0/1795732285 >> v2:172.21.15.119:3300/0 conn(0x7fdca01595a0 msgr2=0x7fdca00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 --2- 172.21.15.100:0/1795732285 >> v2:172.21.15.119:3300/0 conn(0x7fdca01595a0 0x7fdca00c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 -- 172.21.15.100:0/1795732285 >> v1:172.21.15.100:6789/0 conn(0x7fdca006cb10 legacy=0x7fdca00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 -- 172.21.15.100:0/1795732285 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00c9df0 con 0x7fdca0159980 2023-11-17T06:29:51.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9e7fc700 1 -- 172.21.15.100:0/1795732285 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070870856 0 0) 0x7fdca00ccc40 con 0x7fdca006cb10 2023-11-17T06:29:51.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9effd700 1 --2- 172.21.15.100:0/1795732285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca0070330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdca0073cb0 tx=0x7fdc9400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd7ebe0d41eb147 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9e7fc700 1 -- 172.21.15.100:0/1795732285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400cb70 con 0x7fdca0159980 2023-11-17T06:29:51.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9e7fc700 1 -- 172.21.15.100:0/1795732285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9400ccd0 con 0x7fdca0159980 2023-11-17T06:29:51.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.572+0000 7fdc9e7fc700 1 -- 172.21.15.100:0/1795732285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94018600 con 0x7fdca0159980 2023-11-17T06:29:51.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 -- 172.21.15.100:0/1795732285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 msgr2=0x7fdca0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 --2- 172.21.15.100:0/1795732285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca0070330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdca0073cb0 tx=0x7fdc9400ad90 comp rx=0 tx=0).stop 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 -- 172.21.15.100:0/1795732285 shutdown_connections 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 --2- 172.21.15.100:0/1795732285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca0070330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 --2- 172.21.15.100:0/1795732285 >> v2:172.21.15.119:3300/0 conn(0x7fdca01595a0 0x7fdca00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 -- 172.21.15.100:0/1795732285 >> 172.21.15.100:0/1795732285 conn(0x7fdca006a690 msgr2=0x7fdca006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 -- 172.21.15.100:0/1795732285 shutdown_connections 2023-11-17T06:29:51.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.576+0000 7fdca4982700 1 -- 172.21.15.100:0/1795732285 wait complete. 2023-11-17T06:29:51.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 Processor -- start 2023-11-17T06:29:51.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 -- start start 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 0x7fdca00b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdca01595a0 0x7fdca0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca015b2d0 con 0x7fdca0159980 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01552a0 con 0x7fdca006cb10 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdca4982700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca015aff0 con 0x7fdca01595a0 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47832/0 (socket says 172.21.15.100:47832) 2023-11-17T06:29:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 -- 172.21.15.100:0/584625782 learned_addr learned my addr 172.21.15.100:0/584625782 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9f7fe700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 0x7fdca00b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9effd700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdca01595a0 0x7fdca0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 -- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdca01595a0 msgr2=0x7fdca0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdca01595a0 0x7fdca0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.580+0000 7fdc9ffff700 1 -- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 msgr2=0x7fdca00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc9ffff700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 0x7fdca00b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc9ffff700 1 -- 172.21.15.100:0/584625782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9400a710 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc9f7fe700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 0x7fdca00b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc9ffff700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800cc20 tx=0x7fdc9800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98003e50 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9800a690 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00aca00 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800aa40 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca00acfc0 con 0x7fdca0159980 2023-11-17T06:29:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.584+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0067e10 con 0x7fdca0159980 2023-11-17T06:29:51.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.588+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc9800aba0 con 0x7fdca0159980 2023-11-17T06:29:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.588+0000 7fdc87fff700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 0x7fdc8c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.588+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc98083e40 con 0x7fdca0159980 2023-11-17T06:29:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.588+0000 7fdc9f7fe700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 0x7fdc8c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.588+0000 7fdc9f7fe700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 0x7fdc8c0689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdca0158750 tx=0x7fdc90009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.592+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc980512b0 con 0x7fdca0159980 2023-11-17T06:29:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.768+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdca00ad1e0 con 0x7fdca0159980 2023-11-17T06:29:51.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.768+0000 7fdc87fff700 1 -- 172.21.15.100:0/584625782 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc980548d0 con 0x7fdca0159980 2023-11-17T06:29:51.772 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:29:51.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 msgr2=0x7fdc8c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 0x7fdc8c0689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdca0158750 tx=0x7fdc90009240 comp rx=0 tx=0).stop 2023-11-17T06:29:51.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 msgr2=0x7fdca015a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800cc20 tx=0x7fdc9800cf30 comp rx=0 tx=0).stop 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 shutdown_connections 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdc8c066510 0x7fdc8c0689d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0159980 0x7fdca015a7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdca01595a0 0x7fdca0154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 --2- 172.21.15.100:0/584625782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca006cb10 0x7fdca00b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 >> 172.21.15.100:0/584625782 conn(0x7fdca006a690 msgr2=0x7fdca00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 shutdown_connections 2023-11-17T06:29:51.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.772+0000 7fdca4982700 1 -- 172.21.15.100:0/584625782 wait complete. 2023-11-17T06:29:51.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:51.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 Processor -- start 2023-11-17T06:29:51.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 -- start start 2023-11-17T06:29:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd73c15b0a0 0x7fd73c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c070ad0 con 0x7fd73c0b1150 2023-11-17T06:29:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c071f20 con 0x7fd73c0cf8a0 2023-11-17T06:29:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd7426db700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0cfd30 con 0x7fd73c15b0a0 2023-11-17T06:29:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd73bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd73c15b0a0 0x7fd73c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd740c78700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd73c0b1150 0x7fd73c15ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52906/0 (socket says 172.21.15.100:52906) 2023-11-17T06:29:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd740c78700 1 -- 172.21.15.100:0/2298496853 learned_addr learned my addr 172.21.15.100:0/2298496853 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.968+0000 7fd73bfff700 1 -- 172.21.15.100:0/2298496853 >> v1:172.21.15.119:6789/0 conn(0x7fd73c0cf8a0 legacy=0x7fd73c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73bfff700 1 -- 172.21.15.100:0/2298496853 >> v1:172.21.15.100:6789/0 conn(0x7fd73c0b1150 legacy=0x7fd73c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73bfff700 1 -- 172.21.15.100:0/2298496853 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0721a0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73bfff700 1 --2- 172.21.15.100:0/2298496853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0cb3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009850 tx=0x7fd72c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d369a8352da127aa server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73b7fe700 1 -- 172.21.15.100:0/2298496853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c004230 con 0x7fd73c15b0a0 2023-11-17T06:29:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73b7fe700 1 -- 172.21.15.100:0/2298496853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c004390 con 0x7fd73c15b0a0 2023-11-17T06:29:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd73b7fe700 1 -- 172.21.15.100:0/2298496853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0036c0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 -- 172.21.15.100:0/2298496853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 msgr2=0x7fd73c0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 --2- 172.21.15.100:0/2298496853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0cb3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009850 tx=0x7fd72c009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 -- 172.21.15.100:0/2298496853 shutdown_connections 2023-11-17T06:29:51.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 --2- 172.21.15.100:0/2298496853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0cb3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 -- 172.21.15.100:0/2298496853 >> 172.21.15.100:0/2298496853 conn(0x7fd73c06a270 msgr2=0x7fd73c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 -- 172.21.15.100:0/2298496853 shutdown_connections 2023-11-17T06:29:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.972+0000 7fd7426db700 1 -- 172.21.15.100:0/2298496853 wait complete. 2023-11-17T06:29:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 Processor -- start 2023-11-17T06:29:51.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- start start 2023-11-17T06:29:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c0b1150 0x7fd73c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd73c0cf8a0 0x7fd73c156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c158e60 con 0x7fd73c15b0a0 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1599a0 con 0x7fd73c0b1150 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c159100 con 0x7fd73c0cf8a0 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40698/0 (socket says 172.21.15.100:40698) 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 -- 172.21.15.100:0/1806581555 learned_addr learned my addr 172.21.15.100:0/1806581555 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd73bfff700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c0b1150 0x7fd73c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd733fff700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd73c0cf8a0 0x7fd73c156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 -- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd73c0cf8a0 msgr2=0x7fd73c156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd73c0cf8a0 0x7fd73c156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 -- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c0b1150 msgr2=0x7fd73c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c0b1150 0x7fd73c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 -- 172.21.15.100:0/1806581555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0094b0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd740c78700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd734002000 tx=0x7fd73400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400ad40 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7340070d0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c1593e0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400aea0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.976+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c1f29d0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.980+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c1f2bc0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.980+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd734007480 con 0x7fd73c15b0a0 2023-11-17T06:29:51.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.980+0000 7fd7397fa700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 0x7fd71c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.984+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd734083ae0 con 0x7fd73c15b0a0 2023-11-17T06:29:51.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.984+0000 7fd73bfff700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 0x7fd71c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.984+0000 7fd73bfff700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 0x7fd71c0689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009850 tx=0x7fd72c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:51.988+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd734050ee0 con 0x7fd73c15b0a0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.192+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd73c04eea0 con 0x7fd73c15b0a0 2023-11-17T06:29:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.196+0000 7fd7397fa700 1 -- 172.21.15.100:0/1806581555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fd734018090 con 0x7fd73c15b0a0 2023-11-17T06:29:52.199 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:29:52.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.196+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 msgr2=0x7fd71c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.196+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 0x7fd71c0689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009850 tx=0x7fd72c010000 comp rx=0 tx=0).stop 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.196+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 msgr2=0x7fd73c0c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.196+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd734002000 tx=0x7fd73400a340 comp rx=0 tx=0).stop 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 shutdown_connections 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd71c066510 0x7fd71c0689d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c15b0a0 0x7fd73c0c4380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd73c0cf8a0 0x7fd73c156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 --2- 172.21.15.100:0/1806581555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c0b1150 0x7fd73c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 >> 172.21.15.100:0/1806581555 conn(0x7fd73c06a270 msgr2=0x7fd73c0b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 shutdown_connections 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.200+0000 7fd7426db700 1 -- 172.21.15.100:0/1806581555 wait complete. 2023-11-17T06:29:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:29:52.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.392+0000 7f053197f700 1 Processor -- start 2023-11-17T06:29:52.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.392+0000 7f053197f700 1 -- start start 2023-11-17T06:29:52.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f053197f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f053197f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f052c0c9a10 0x7f052c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f053197f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c06d160 con 0x7f052c0cde70 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f053197f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c06da00 con 0x7f052c0c9a10 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f053197f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c06cf70 con 0x7f052c144ac0 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f05227fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f052c0cde70 0x7f052c0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52922/0 (socket says 172.21.15.100:52922) 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f05227fc700 1 -- 172.21.15.100:0/1893459339 learned_addr learned my addr 172.21.15.100:0/1893459339 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052b7fe700 1 --2- 172.21.15.100:0/1893459339 >> v2:172.21.15.119:3300/0 conn(0x7f052c0c9a10 0x7f052c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052affd700 1 --2- 172.21.15.100:0/1893459339 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052affd700 1 -- 172.21.15.100:0/1893459339 >> v2:172.21.15.119:3300/0 conn(0x7f052c0c9a10 msgr2=0x7f052c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052affd700 1 --2- 172.21.15.100:0/1893459339 >> v2:172.21.15.119:3300/0 conn(0x7f052c0c9a10 0x7f052c0707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052affd700 1 -- 172.21.15.100:0/1893459339 >> v1:172.21.15.100:6789/0 conn(0x7f052c0cde70 legacy=0x7f052c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.396+0000 7f052affd700 1 -- 172.21.15.100:0/1893459339 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c06d440 con 0x7f052c144ac0 2023-11-17T06:29:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f052affd700 1 --2- 172.21.15.100:0/1893459339 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c06ca30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f051c009d90 tx=0x7f051c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1b86eba9ffd2b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f052a7fc700 1 -- 172.21.15.100:0/1893459339 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c00e070 con 0x7f052c144ac0 2023-11-17T06:29:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f052a7fc700 1 -- 172.21.15.100:0/1893459339 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c00bb20 con 0x7f052c144ac0 2023-11-17T06:29:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f052a7fc700 1 -- 172.21.15.100:0/1893459339 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c012430 con 0x7f052c144ac0 2023-11-17T06:29:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 -- 172.21.15.100:0/1893459339 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 msgr2=0x7f052c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 --2- 172.21.15.100:0/1893459339 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c06ca30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f051c009d90 tx=0x7f051c00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 -- 172.21.15.100:0/1893459339 shutdown_connections 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 --2- 172.21.15.100:0/1893459339 >> v2:172.21.15.119:3300/0 conn(0x7f052c0c9a10 0x7f052c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 --2- 172.21.15.100:0/1893459339 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c06ca30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 -- 172.21.15.100:0/1893459339 >> 172.21.15.100:0/1893459339 conn(0x7f052c0cb730 msgr2=0x7f052c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 -- 172.21.15.100:0/1893459339 shutdown_connections 2023-11-17T06:29:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.400+0000 7f053197f700 1 -- 172.21.15.100:0/1893459339 wait complete. 2023-11-17T06:29:52.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 Processor -- start 2023-11-17T06:29:52.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 -- start start 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f052c0cde70 0x7f052c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0af860 con 0x7f052c0c9a10 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c140c40 con 0x7f052c0cde70 2023-11-17T06:29:52.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f053197f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c140170 con 0x7f052c144ac0 2023-11-17T06:29:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40702/0 (socket says 172.21.15.100:40702) 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 -- 172.21.15.100:0/1233106188 learned_addr learned my addr 172.21.15.100:0/1233106188 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052b7fe700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f05227fc700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f052c0cde70 0x7f052c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 -- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 msgr2=0x7f052c0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 -- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f052c0cde70 msgr2=0x7f052c13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f052c0cde70 0x7f052c13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 -- 172.21.15.100:0/1233106188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c009a70 con 0x7f052c0c9a10 2023-11-17T06:29:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.404+0000 7f052affd700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f051c014040 tx=0x7f051c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c004960 con 0x7f052c0c9a10 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c020070 con 0x7f052c0c9a10 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c0c6440 con 0x7f052c0c9a10 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0276c0 con 0x7f052c0c9a10 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c0af480 con 0x7f052c0c9a10 2023-11-17T06:29:52.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c065e90 con 0x7f052c0c9a10 2023-11-17T06:29:52.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.408+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f051c027820 con 0x7f052c0c9a10 2023-11-17T06:29:52.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.412+0000 7f0528ff9700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 0x7f050c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.412+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f051c022070 con 0x7f052c0c9a10 2023-11-17T06:29:52.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.412+0000 7f05227fc700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 0x7f050c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.412+0000 7f05227fc700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 0x7f050c0689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f052c0b1a40 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.416+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f051c053560 con 0x7f052c0c9a10 2023-11-17T06:29:52.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.588+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f052c0ccbb0 con 0x7f052c0c9a10 2023-11-17T06:29:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.592+0000 7f0528ff9700 1 -- 172.21.15.100:0/1233106188 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f051c056b80 con 0x7f052c0c9a10 2023-11-17T06:29:52.595 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 msgr2=0x7f050c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 0x7f050c0689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f052c0b1a40 tx=0x7f0514009040 comp rx=0 tx=0).stop 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 msgr2=0x7f052c0c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f051c014040 tx=0x7f051c004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 shutdown_connections 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f052c144ac0 0x7f052c0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f052c0cde70 0x7f052c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f050c066510 0x7f050c0689d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 --2- 172.21.15.100:0/1233106188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f052c0c9a10 0x7f052c0c5d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 >> 172.21.15.100:0/1233106188 conn(0x7f052c0cb730 msgr2=0x7f052c0c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 shutdown_connections 2023-11-17T06:29:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.596+0000 7f053197f700 1 -- 172.21.15.100:0/1233106188 wait complete. 2023-11-17T06:29:52.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:52.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:52.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 Processor -- start 2023-11-17T06:29:52.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 -- start start 2023-11-17T06:29:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 0x7f2f340d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f34160ce0 con 0x7f2f340cd8b0 2023-11-17T06:29:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cdd40 con 0x7f2f3415d2b0 2023-11-17T06:29:52.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f3a662700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340ce020 con 0x7f2f3415ced0 2023-11-17T06:29:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f38e5f700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2f340cd8b0 0x7f2f34161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52926/0 (socket says 172.21.15.100:52926) 2023-11-17T06:29:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f38e5f700 1 -- 172.21.15.100:0/3737349098 learned_addr learned my addr 172.21.15.100:0/3737349098 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:52.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.796+0000 7f2f39660700 1 --2- 172.21.15.100:0/3737349098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 0x7f2f340d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746538803 0 0) 0x7f2f34160ce0 con 0x7f2f340cd8b0 2023-11-17T06:29:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200035d0 con 0x7f2f340cd8b0 2023-11-17T06:29:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813289369 0 0) 0x7f2f340cdd40 con 0x7f2f3415d2b0 2023-11-17T06:29:52.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f34160ce0 con 0x7f2f3415d2b0 2023-11-17T06:29:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f39660700 1 -- 172.21.15.100:0/3737349098 >> v1:172.21.15.119:6789/0 conn(0x7f2f3415d2b0 legacy=0x7f2f340d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f39660700 1 -- 172.21.15.100:0/3737349098 >> v1:172.21.15.100:6789/0 conn(0x7f2f340cd8b0 legacy=0x7f2f34161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f39660700 1 -- 172.21.15.100:0/3737349098 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340ce300 con 0x7f2f3415ced0 2023-11-17T06:29:52.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f39660700 1 --2- 172.21.15.100:0/3737349098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 0x7f2f340d0fe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f300098b0 tx=0x7f2f30009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5b8a56f44133f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f3415ced0 2023-11-17T06:29:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f3415ced0 2023-11-17T06:29:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f2bfff700 1 -- 172.21.15.100:0/3737349098 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011d20 con 0x7f2f3415ced0 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 -- 172.21.15.100:0/3737349098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 msgr2=0x7f2f340d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 --2- 172.21.15.100:0/3737349098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 0x7f2f340d0fe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f300098b0 tx=0x7f2f30009bc0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 -- 172.21.15.100:0/3737349098 shutdown_connections 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 --2- 172.21.15.100:0/3737349098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415ced0 0x7f2f340d0fe0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 -- 172.21.15.100:0/3737349098 >> 172.21.15.100:0/3737349098 conn(0x7f2f3406b370 msgr2=0x7f2f3406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 -- 172.21.15.100:0/3737349098 shutdown_connections 2023-11-17T06:29:52.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.800+0000 7f2f3a662700 1 -- 172.21.15.100:0/3737349098 wait complete. 2023-11-17T06:29:52.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.804+0000 7f2f3a662700 1 Processor -- start 2023-11-17T06:29:52.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.804+0000 7f2f3a662700 1 -- start start 2023-11-17T06:29:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 0x7f2f341f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415d2b0 0x7f2f340c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c8570 con 0x7f2f340c80f0 2023-11-17T06:29:52.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c8850 con 0x7f2f3415ced0 2023-11-17T06:29:52.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c8b30 con 0x7f2f3415d2b0 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40710/0 (socket says 172.21.15.100:40710) 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 -- 172.21.15.100:0/177791995 learned_addr learned my addr 172.21.15.100:0/177791995 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39660700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 0x7f2f341f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f38e5f700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415d2b0 0x7f2f340c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 -- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415d2b0 msgr2=0x7f2f340c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415d2b0 0x7f2f340c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 -- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 msgr2=0x7f2f341f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 0x7f2f341f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 -- 172.21.15.100:0/177791995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300094b0 con 0x7f2f340c80f0 2023-11-17T06:29:52.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39660700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 0x7f2f341f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f39e61700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00cc50 tx=0x7f2f2c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c003c20 con 0x7f2f340c80f0 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c003d80 con 0x7f2f340c80f0 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00aab0 con 0x7f2f340c80f0 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f340c8e10 con 0x7f2f340c80f0 2023-11-17T06:29:52.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.808+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f341f27d0 con 0x7f2f340c80f0 2023-11-17T06:29:52.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.812+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340c9330 con 0x7f2f340c80f0 2023-11-17T06:29:52.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.812+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f2c00ac10 con 0x7f2f340c80f0 2023-11-17T06:29:52.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.812+0000 7f2f29ffb700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 0x7f2f180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.812+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f2c083f60 con 0x7f2f340c80f0 2023-11-17T06:29:52.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.812+0000 7f2f39660700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 0x7f2f180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.816+0000 7f2f39660700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 0x7f2f180689d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f300090b0 tx=0x7f2f30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.820+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f340c9330 con 0x7f2f340c80f0 2023-11-17T06:29:53.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:52.996+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f340c9330 con 0x7f2f340c80f0 2023-11-17T06:29:53.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f29ffb700 1 -- 172.21.15.100:0/177791995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f340c9330 con 0x7f2f340c80f0 2023-11-17T06:29:53.002 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 msgr2=0x7f2f180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 0x7f2f180689d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f300090b0 tx=0x7f2f30008030 comp rx=0 tx=0).stop 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 msgr2=0x7f2f3415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00cc50 tx=0x7f2f2c00cf60 comp rx=0 tx=0).stop 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 shutdown_connections 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f18066510 0x7f2f180689d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340c80f0 0x7f2f3415ec80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f3415d2b0 0x7f2f340c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 --2- 172.21.15.100:0/177791995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f3415ced0 0x7f2f341f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 >> 172.21.15.100:0/177791995 conn(0x7f2f3406b370 msgr2=0x7f2f3415c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 shutdown_connections 2023-11-17T06:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.000+0000 7f2f3a662700 1 -- 172.21.15.100:0/177791995 wait complete. 2023-11-17T06:29:53.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:29:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.204+0000 7fcd56c1e700 1 Processor -- start 2023-11-17T06:29:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.204+0000 7fcd56c1e700 1 -- start start 2023-11-17T06:29:53.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd56c1e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd500d2c70 0x7fcd500cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd56c1e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd5015d6f0 0x7fcd500d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd56c1e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500d27e0 con 0x7fcd5015d310 2023-11-17T06:29:53.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd56c1e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd500ce8e0 con 0x7fcd500d2c70 2023-11-17T06:29:53.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd56c1e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500d1eb0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd500d2c70 0x7fcd500cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd549ba700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcd5015d310 0x7fcd500ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52938/0 (socket says 172.21.15.100:52938) 2023-11-17T06:29:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd549ba700 1 -- 172.21.15.100:0/1834505081 learned_addr learned my addr 172.21.15.100:0/1834505081 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd551bb700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd5015d6f0 0x7fcd500d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 -- 172.21.15.100:0/1834505081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd5015d6f0 msgr2=0x7fcd500d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd5015d6f0 0x7fcd500d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 -- 172.21.15.100:0/1834505081 >> v1:172.21.15.100:6789/0 conn(0x7fcd5015d310 legacy=0x7fcd500ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 -- 172.21.15.100:0/1834505081 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500d2190 con 0x7fcd500d2c70 2023-11-17T06:29:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4f7fe700 1 -- 172.21.15.100:0/1834505081 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967430563 0 0) 0x7fcd500d27e0 con 0x7fcd5015d310 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4ffff700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd500d2c70 0x7fcd500cfc30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009880 tx=0x7fcd3c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73dda5ebea2d7ad server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.208+0000 7fcd4f7fe700 1 -- 172.21.15.100:0/1834505081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011830 con 0x7fcd500d2c70 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd4f7fe700 1 -- 172.21.15.100:0/1834505081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c011990 con 0x7fcd500d2c70 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd4f7fe700 1 -- 172.21.15.100:0/1834505081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011d20 con 0x7fcd500d2c70 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- 172.21.15.100:0/1834505081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd500d2c70 msgr2=0x7fcd500cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd500d2c70 0x7fcd500cfc30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009880 tx=0x7fcd3c009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- 172.21.15.100:0/1834505081 shutdown_connections 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd5015d6f0 0x7fcd500d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/1834505081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd500d2c70 0x7fcd500cfc30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- 172.21.15.100:0/1834505081 >> 172.21.15.100:0/1834505081 conn(0x7fcd5006b4e0 msgr2=0x7fcd5006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- 172.21.15.100:0/1834505081 shutdown_connections 2023-11-17T06:29:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- 172.21.15.100:0/1834505081 wait complete. 2023-11-17T06:29:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 Processor -- start 2023-11-17T06:29:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.212+0000 7fcd56c1e700 1 -- start start 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd500d2c70 0x7fcd501599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd5015d310 0x7fcd500c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50154000 con 0x7fcd5015d6f0 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd501f3c70 con 0x7fcd5015d310 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c71a0 con 0x7fcd500d2c70 2023-11-17T06:29:53.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40728/0 (socket says 172.21.15.100:40728) 2023-11-17T06:29:53.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 -- 172.21.15.100:0/2617688116 learned_addr learned my addr 172.21.15.100:0/2617688116 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:53.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd549ba700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd500d2c70 0x7fcd501599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd4ffff700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd5015d310 0x7fcd500c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 -- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd500d2c70 msgr2=0x7fcd501599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd500d2c70 0x7fcd501599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 -- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd5015d310 msgr2=0x7fcd500c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd5015d310 0x7fcd500c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 -- 172.21.15.100:0/2617688116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0094b0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd551bb700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800efc0 tx=0x7fcd4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800cc90 con 0x7fcd5015d6f0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4800f040 con 0x7fcd5015d6f0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500c7480 con 0x7fcd5015d6f0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480146c0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.216+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500c7a40 con 0x7fcd5015d6f0 2023-11-17T06:29:53.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.220+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5004eea0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.220+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd48014820 con 0x7fcd5015d6f0 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.224+0000 7fcd4d7fa700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 0x7fcd340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.224+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd48084ad0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.224+0000 7fcd549ba700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 0x7fcd340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.224+0000 7fcd549ba700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 0x7fcd340689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000f60 tx=0x7fcd44007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.228+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd48051eb0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.400+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd500c67f0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.404+0000 7fcd4d7fa700 1 -- 172.21.15.100:0/2617688116 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd480180a0 con 0x7fcd5015d6f0 2023-11-17T06:29:53.407 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:29:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 msgr2=0x7fcd340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 0x7fcd340689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000f60 tx=0x7fcd44007e90 comp rx=0 tx=0).stop 2023-11-17T06:29:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 msgr2=0x7fcd500b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800efc0 tx=0x7fcd4800c3a0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 shutdown_connections 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fcd34066510 0x7fcd340689d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd5015d6f0 0x7fcd500b4660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd5015d310 0x7fcd500c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 --2- 172.21.15.100:0/2617688116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd500d2c70 0x7fcd501599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 >> 172.21.15.100:0/2617688116 conn(0x7fcd5006b4e0 msgr2=0x7fcd500cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 shutdown_connections 2023-11-17T06:29:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.408+0000 7fcd56c1e700 1 -- 172.21.15.100:0/2617688116 wait complete. 2023-11-17T06:29:53.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:29:53.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 Processor -- start 2023-11-17T06:29:53.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 -- start start 2023-11-17T06:29:53.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c161590 0x7f518c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f518c0c2390 0x7f518c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0c9810 con 0x7f518c0cf610 2023-11-17T06:29:53.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c0cd980 con 0x7f518c0c2390 2023-11-17T06:29:53.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.612+0000 7f51928a4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0cfac0 con 0x7f518c161590 2023-11-17T06:29:53.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f518c0c2390 0x7f518c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51920a3700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f518c0cf610 0x7f518c165160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52940/0 (socket says 172.21.15.100:52940) 2023-11-17T06:29:53.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51920a3700 1 -- 172.21.15.100:0/2484760484 learned_addr learned my addr 172.21.15.100:0/2484760484 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:53.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51918a2700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c161590 0x7f518c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 -- 172.21.15.100:0/2484760484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c161590 msgr2=0x7f518c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:53.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c161590 0x7f518c0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 -- 172.21.15.100:0/2484760484 >> v1:172.21.15.100:6789/0 conn(0x7f518c0cf610 legacy=0x7f518c165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51908a0700 1 -- 172.21.15.100:0/2484760484 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968851408 0 0) 0x7f518c0c9810 con 0x7f518c0cf610 2023-11-17T06:29:53.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 -- 172.21.15.100:0/2484760484 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0cd3c0 con 0x7f518c0c2390 2023-11-17T06:29:53.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51910a1700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c0cf0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f517c009850 tx=0x7f517c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba63b7bbe7db1cb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51908a0700 1 -- 172.21.15.100:0/2484760484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011830 con 0x7f518c0c2390 2023-11-17T06:29:53.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51908a0700 1 -- 172.21.15.100:0/2484760484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c011990 con 0x7f518c0c2390 2023-11-17T06:29:53.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51908a0700 1 -- 172.21.15.100:0/2484760484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011d40 con 0x7f518c0c2390 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51928a4700 1 -- 172.21.15.100:0/2484760484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 msgr2=0x7f518c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.616+0000 7f51928a4700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c0cf0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f517c009850 tx=0x7f517c009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 -- 172.21.15.100:0/2484760484 shutdown_connections 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c0cf0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 --2- 172.21.15.100:0/2484760484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c161590 0x7f518c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 -- 172.21.15.100:0/2484760484 >> 172.21.15.100:0/2484760484 conn(0x7f518c06a690 msgr2=0x7f518c06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 -- 172.21.15.100:0/2484760484 shutdown_connections 2023-11-17T06:29:53.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 -- 172.21.15.100:0/2484760484 wait complete. 2023-11-17T06:29:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 Processor -- start 2023-11-17T06:29:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.620+0000 7f51928a4700 1 -- start start 2023-11-17T06:29:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c0cf610 0x7f518c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f518c161590 0x7f518c0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c15b520 con 0x7f518c0c2390 2023-11-17T06:29:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c36a0 con 0x7f518c161590 2023-11-17T06:29:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c3fc0 con 0x7f518c0cf610 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40746/0 (socket says 172.21.15.100:40746) 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 -- 172.21.15.100:0/145782832 learned_addr learned my addr 172.21.15.100:0/145782832 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51910a1700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c0cf610 0x7f518c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51920a3700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f518c161590 0x7f518c0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 -- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c0cf610 msgr2=0x7f518c0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c0cf610 0x7f518c0c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 -- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f518c161590 msgr2=0x7f518c0c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f518c161590 0x7f518c0c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 -- 172.21.15.100:0/145782832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0094b0 con 0x7f518c0c2390 2023-11-17T06:29:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51918a2700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f518800e840 tx=0x7f518800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880095a0 con 0x7f518c0c2390 2023-11-17T06:29:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188013680 con 0x7f518c0c2390 2023-11-17T06:29:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c0c42a0 con 0x7f518c0c2390 2023-11-17T06:29:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880139f0 con 0x7f518c0c2390 2023-11-17T06:29:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.624+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c0c2960 con 0x7f518c0c2390 2023-11-17T06:29:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.628+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c067e10 con 0x7f518c0c2390 2023-11-17T06:29:53.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.628+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5188013b50 con 0x7f518c0c2390 2023-11-17T06:29:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.628+0000 7f51827fc700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 0x7f51700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.628+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5188083d70 con 0x7f518c0c2390 2023-11-17T06:29:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.632+0000 7f51910a1700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 0x7f51700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.632+0000 7f51910a1700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 0x7f51700689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f518c0c27b0 tx=0x7f517c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.636+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5188051150 con 0x7f518c0c2390 2023-11-17T06:29:53.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.808+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f518c0c47c0 con 0x7f518c0c2390 2023-11-17T06:29:53.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.808+0000 7f51827fc700 1 -- 172.21.15.100:0/145782832 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5188017020 con 0x7f518c0c2390 2023-11-17T06:29:53.812 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:29:53.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 msgr2=0x7f51700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 0x7f51700689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f518c0c27b0 tx=0x7f517c008030 comp rx=0 tx=0).stop 2023-11-17T06:29:53.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 msgr2=0x7f518c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f518800e840 tx=0x7f518800eb50 comp rx=0 tx=0).stop 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 shutdown_connections 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f518c161590 0x7f518c0c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f518c0cf610 0x7f518c0c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5170066510 0x7f51700689d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 --2- 172.21.15.100:0/145782832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f518c0c2390 0x7f518c15ab00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 >> 172.21.15.100:0/145782832 conn(0x7f518c06a690 msgr2=0x7f518c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 shutdown_connections 2023-11-17T06:29:53.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:53.812+0000 7f51928a4700 1 -- 172.21.15.100:0/145782832 wait complete. 2023-11-17T06:29:53.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:54.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.008+0000 7f5f71aff700 1 Processor -- start 2023-11-17T06:29:54.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.008+0000 7f5f71aff700 1 -- start start 2023-11-17T06:29:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f71aff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f6c15d4a0 0x7f5f6c0b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f71aff700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0d15e0 con 0x7f5f6c0cfb60 2023-11-17T06:29:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f71aff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0d18c0 con 0x7f5f6c0b2730 2023-11-17T06:29:54.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f71aff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b6880 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f6c15d4a0 0x7f5f6c0b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5f6c0cfb60 0x7f5f6c0cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52956/0 (socket says 172.21.15.100:52956) 2023-11-17T06:29:54.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6bfff700 1 -- 172.21.15.100:0/421410794 learned_addr learned my addr 172.21.15.100:0/421410794 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:54.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6affd700 1 --1- 172.21.15.100:0/421410794 >> v1:172.21.15.119:6789/0 conn(0x7f5f6c0b2730 0x7f5f6c0b6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:55730/0 (socket says 172.21.15.100:55730) 2023-11-17T06:29:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6b7fe700 1 -- 172.21.15.100:0/421410794 >> v1:172.21.15.119:6789/0 conn(0x7f5f6c0b2730 legacy=0x7f5f6c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6b7fe700 1 -- 172.21.15.100:0/421410794 >> v1:172.21.15.100:6789/0 conn(0x7f5f6c0cfb60 legacy=0x7f5f6c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6b7fe700 1 -- 172.21.15.100:0/421410794 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0d1ba0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6b7fe700 1 --2- 172.21.15.100:0/421410794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c0b89d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009850 tx=0x7f5f5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2bb9385a6c236a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6a7fc700 1 -- 172.21.15.100:0/421410794 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011830 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6a7fc700 1 -- 172.21.15.100:0/421410794 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c011990 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.012+0000 7f5f6a7fc700 1 -- 172.21.15.100:0/421410794 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011d20 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- 172.21.15.100:0/421410794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 msgr2=0x7f5f6c0b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 --2- 172.21.15.100:0/421410794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c0b89d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009850 tx=0x7f5f5c009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- 172.21.15.100:0/421410794 shutdown_connections 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 --2- 172.21.15.100:0/421410794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c0b89d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- 172.21.15.100:0/421410794 >> 172.21.15.100:0/421410794 conn(0x7f5f6c06b430 msgr2=0x7f5f6c06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- 172.21.15.100:0/421410794 shutdown_connections 2023-11-17T06:29:54.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- 172.21.15.100:0/421410794 wait complete. 2023-11-17T06:29:54.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 Processor -- start 2023-11-17T06:29:54.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- start start 2023-11-17T06:29:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f6c0b2730 0x7f5f6c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 0x7f5f6c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c1584f0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c8b20 con 0x7f5f6c0b2730 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.016+0000 7f5f71aff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c8d70 con 0x7f5f6c0cfb60 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40768/0 (socket says 172.21.15.100:40768) 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 -- 172.21.15.100:0/3736929939 learned_addr learned my addr 172.21.15.100:0/3736929939 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6b7fe700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f6c0b2730 0x7f5f6c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6affd700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 0x7f5f6c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 -- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 msgr2=0x7f5f6c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 0x7f5f6c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 -- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f6c0b2730 msgr2=0x7f5f6c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f6c0b2730 0x7f5f6c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 -- 172.21.15.100:0/3736929939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0094b0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6affd700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 0x7f5f6c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:54.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f6bfff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400cbc0 tx=0x7f5f6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400a7b0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6400a910 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400ac80 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c0c9050 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.020+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c0c9610 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c1586e0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5f6401b3b0 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f53fff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 0x7f5f580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f64083780 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f6b7fe700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 0x7f5f580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.024+0000 7f5f6b7fe700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 0x7f5f580689d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c014040 tx=0x7f5f5c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.032+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f64050c10 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.244+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f6c0cf370 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f53fff700 1 -- 172.21.15.100:0/3736929939 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f5f64054230 con 0x7f5f6c15d4a0 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 msgr2=0x7f5f580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 0x7f5f580689d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c014040 tx=0x7f5f5c01c040 comp rx=0 tx=0).stop 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 msgr2=0x7f5f6c158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400cbc0 tx=0x7f5f6400cbf0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 shutdown_connections 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5f58066510 0x7f5f580689d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f6c15d4a0 0x7f5f6c158870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f6c0cfb60 0x7f5f6c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 --2- 172.21.15.100:0/3736929939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f6c0b2730 0x7f5f6c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.248+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 >> 172.21.15.100:0/3736929939 conn(0x7f5f6c06b430 msgr2=0x7f5f6c0cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.252+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 shutdown_connections 2023-11-17T06:29:54.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.252+0000 7f5f71aff700 1 -- 172.21.15.100:0/3736929939 wait complete. 2023-11-17T06:29:54.257 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:29:54.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.448+0000 7fd7e58cb700 1 Processor -- start 2023-11-17T06:29:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 -- start start 2023-11-17T06:29:54.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7e0144ac0 0x7fd7e006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e00cde70 0x7fd7e00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e006d160 con 0x7fd7e00c9840 2023-11-17T06:29:54.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e006da00 con 0x7fd7e0144ac0 2023-11-17T06:29:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7e58cb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e006cf70 con 0x7fd7e00cde70 2023-11-17T06:29:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7deffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7e0144ac0 0x7fd7e006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7deffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7e0144ac0 0x7fd7e006ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40770/0 (socket says 172.21.15.100:40770) 2023-11-17T06:29:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7deffd700 1 -- 172.21.15.100:0/2532947153 learned_addr learned my addr 172.21.15.100:0/2532947153 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.452+0000 7fd7de7fc700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e00cde70 0x7fd7e00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7deffd700 1 -- 172.21.15.100:0/2532947153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e00cde70 msgr2=0x7fd7e00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7deffd700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e00cde70 0x7fd7e00c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7deffd700 1 -- 172.21.15.100:0/2532947153 >> v1:172.21.15.119:6789/0 conn(0x7fd7e00c9840 legacy=0x7fd7e00ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7deffd700 1 -- 172.21.15.100:0/2532947153 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e006d440 con 0x7fd7e0144ac0 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7deffd700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e0144ac0 0x7fd7e006ca30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009910 tx=0x7fd7d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c81fa0001d510 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7ddffb700 1 -- 172.21.15.100:0/2532947153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000ba60 con 0x7fd7e0144ac0 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7ddffb700 1 -- 172.21.15.100:0/2532947153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000bbc0 con 0x7fd7e0144ac0 2023-11-17T06:29:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7ddffb700 1 -- 172.21.15.100:0/2532947153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0009e60 con 0x7fd7e0144ac0 2023-11-17T06:29:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2532947153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e0144ac0 msgr2=0x7fd7e006ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e0144ac0 0x7fd7e006ca30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009910 tx=0x7fd7d0009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2532947153 shutdown_connections 2023-11-17T06:29:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e00cde70 0x7fd7e00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2532947153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e0144ac0 0x7fd7e006ca30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2532947153 >> 172.21.15.100:0/2532947153 conn(0x7fd7e00cb730 msgr2=0x7fd7e00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2532947153 shutdown_connections 2023-11-17T06:29:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.456+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2532947153 wait complete. 2023-11-17T06:29:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 Processor -- start 2023-11-17T06:29:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 -- start start 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e00c9840 0x7fd7e01f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e0144ac0 0x7fd7e00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015d610 con 0x7fd7e00cde70 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00cd660 con 0x7fd7e00c9840 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7e58cb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01f7c50 con 0x7fd7e0144ac0 2023-11-17T06:29:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40778/0 (socket says 172.21.15.100:40778) 2023-11-17T06:29:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 -- 172.21.15.100:0/2912674744 learned_addr learned my addr 172.21.15.100:0/2912674744 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7deffd700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e00c9840 0x7fd7e01f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7df7fe700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e0144ac0 0x7fd7e00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 -- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e0144ac0 msgr2=0x7fd7e00cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e0144ac0 0x7fd7e00cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 -- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e00c9840 msgr2=0x7fd7e01f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e00c9840 0x7fd7e01f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 -- 172.21.15.100:0/2912674744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0009570 con 0x7fd7e00cde70 2023-11-17T06:29:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.460+0000 7fd7de7fc700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e760 tx=0x7fd7d400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400c070 con 0x7fd7e00cde70 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4013610 con 0x7fd7e00cde70 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e01f6cd0 con 0x7fd7e00cde70 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4013980 con 0x7fd7e00cde70 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e01f7290 con 0x7fd7e00cde70 2023-11-17T06:29:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e0065e90 con 0x7fd7e00cde70 2023-11-17T06:29:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.464+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7d4013ae0 con 0x7fd7e00cde70 2023-11-17T06:29:54.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.468+0000 7fd7c7fff700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 0x7fd7cc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.468+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7d4083ae0 con 0x7fd7e00cde70 2023-11-17T06:29:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.468+0000 7fd7deffd700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 0x7fd7cc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.468+0000 7fd7deffd700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 0x7fd7cc0689d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0000c00 tx=0x7fd7d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.472+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7d4050ff0 con 0x7fd7e00cde70 2023-11-17T06:29:54.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.652+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7e006d6f0 con 0x7fd7e00cde70 2023-11-17T06:29:54.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.652+0000 7fd7c7fff700 1 -- 172.21.15.100:0/2912674744 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fd7d4054610 con 0x7fd7e00cde70 2023-11-17T06:29:54.658 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:54.658 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 msgr2=0x7fd7cc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 0x7fd7cc0689d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0000c00 tx=0x7fd7d0008030 comp rx=0 tx=0).stop 2023-11-17T06:29:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 msgr2=0x7fd7e01f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e760 tx=0x7fd7d400ea70 comp rx=0 tx=0).stop 2023-11-17T06:29:54.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 shutdown_connections 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e0144ac0 0x7fd7e00cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd7cc066510 0x7fd7cc0689d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00cde70 0x7fd7e01f7570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 --2- 172.21.15.100:0/2912674744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e00c9840 0x7fd7e01f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 >> 172.21.15.100:0/2912674744 conn(0x7fd7e00cb730 msgr2=0x7fd7e00c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 shutdown_connections 2023-11-17T06:29:54.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.656+0000 7fd7e58cb700 1 -- 172.21.15.100:0/2912674744 wait complete. 2023-11-17T06:29:54.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.860+0000 7f696d1ce700 1 Processor -- start 2023-11-17T06:29:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.860+0000 7f696d1ce700 1 -- start start 2023-11-17T06:29:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696d1ce700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69680b1150 0x7f69680cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696d1ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f696815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696d1ce700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968070ad0 con 0x7f696815b0a0 2023-11-17T06:29:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696d1ce700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6968071f20 con 0x7f69680b1150 2023-11-17T06:29:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696d1ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69680721a0 con 0x7f69680cf8a0 2023-11-17T06:29:54.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69680b1150 0x7f69680cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69680b1150 0x7f69680cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40782/0 (socket says 172.21.15.100:40782) 2023-11-17T06:29:54.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 -- 172.21.15.100:0/1460869749 learned_addr learned my addr 172.21.15.100:0/1460869749 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696759e700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f696815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 -- 172.21.15.100:0/1460869749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 msgr2=0x7f696815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f696815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 -- 172.21.15.100:0/1460869749 >> v1:172.21.15.119:6789/0 conn(0x7f696815b0a0 legacy=0x7f69680b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 -- 172.21.15.100:0/1460869749 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968072480 con 0x7f69680b1150 2023-11-17T06:29:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696659c700 1 -- 172.21.15.100:0/1460869749 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815851014 0 0) 0x7f6968070ad0 con 0x7f696815b0a0 2023-11-17T06:29:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f695ffff700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69680cb3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6950009910 tx=0x7f6950009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7ff74b448b98c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696659c700 1 -- 172.21.15.100:0/1460869749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950011830 con 0x7f69680b1150 2023-11-17T06:29:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696659c700 1 -- 172.21.15.100:0/1460869749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6950011990 con 0x7f69680b1150 2023-11-17T06:29:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.864+0000 7f696659c700 1 -- 172.21.15.100:0/1460869749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950011d40 con 0x7f69680b1150 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 -- 172.21.15.100:0/1460869749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 msgr2=0x7f69680cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69680cb3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6950009910 tx=0x7f6950009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 -- 172.21.15.100:0/1460869749 shutdown_connections 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f696815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 --2- 172.21.15.100:0/1460869749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69680cb3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 -- 172.21.15.100:0/1460869749 >> 172.21.15.100:0/1460869749 conn(0x7f696806a270 msgr2=0x7f696806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 -- 172.21.15.100:0/1460869749 shutdown_connections 2023-11-17T06:29:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.868+0000 7f696d1ce700 1 -- 172.21.15.100:0/1460869749 wait complete. 2023-11-17T06:29:54.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 Processor -- start 2023-11-17T06:29:54.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 -- start start 2023-11-17T06:29:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f69680c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696815b0a0 0x7f69680c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6968157b80 con 0x7f69680b1150 2023-11-17T06:29:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69680c6bb0 con 0x7f696815b0a0 2023-11-17T06:29:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f696d1ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69681578a0 con 0x7f69680cf8a0 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.872+0000 7f6966d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40796/0 (socket says 172.21.15.100:40796) 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 -- 172.21.15.100:0/94580530 learned_addr learned my addr 172.21.15.100:0/94580530 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f695ffff700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f69680c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f696759e700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696815b0a0 0x7f69680c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 -- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 msgr2=0x7f69680c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f69680c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 -- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696815b0a0 msgr2=0x7f69680c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696815b0a0 0x7f69680c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 -- 172.21.15.100:0/94580530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009570 con 0x7f69680b1150 2023-11-17T06:29:54.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f6966d9d700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f695800c520 tx=0x7f695800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69580054e0 con 0x7f69680b1150 2023-11-17T06:29:54.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69580036a0 con 0x7f69680b1150 2023-11-17T06:29:54.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69680c6560 con 0x7f69680b1150 2023-11-17T06:29:54.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958003a50 con 0x7f69680b1150 2023-11-17T06:29:54.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.876+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69681f0890 con 0x7f69680b1150 2023-11-17T06:29:54.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69680c63c0 con 0x7f69680b1150 2023-11-17T06:29:54.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6958003bb0 con 0x7f69680b1150 2023-11-17T06:29:54.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f695f7fe700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 0x7f69480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69580832e0 con 0x7f69680b1150 2023-11-17T06:29:54.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f695ffff700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 0x7f69480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.880+0000 7f695ffff700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 0x7f69480689d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69680c8bf0 tx=0x7f6950008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:54.888+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69680c63c0 con 0x7f69680b1150 2023-11-17T06:29:55.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.096+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69680c63c0 con 0x7f69680b1150 2023-11-17T06:29:55.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f695f7fe700 1 -- 172.21.15.100:0/94580530 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f69680c63c0 con 0x7f69680b1150 2023-11-17T06:29:55.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:29:55.103 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:29:55.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 msgr2=0x7f69480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 0x7f69480689d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69680c8bf0 tx=0x7f6950008030 comp rx=0 tx=0).stop 2023-11-17T06:29:55.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 msgr2=0x7f69681f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f695800c520 tx=0x7f695800c830 comp rx=0 tx=0).stop 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 shutdown_connections 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696815b0a0 0x7f69680c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69680cf8a0 0x7f69680c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6948066510 0x7f69480689d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 --2- 172.21.15.100:0/94580530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69680b1150 0x7f69681f0350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.100+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 >> 172.21.15.100:0/94580530 conn(0x7f696806a270 msgr2=0x7f69680c56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.104+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 shutdown_connections 2023-11-17T06:29:55.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.104+0000 7f696d1ce700 1 -- 172.21.15.100:0/94580530 wait complete. 2023-11-17T06:29:55.109 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:29:55.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:29:39.441152+0000', 'modified': '2023-11-17T06:29:42.485705+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6834/3870554299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 3870554299}, {'type': 'v1', 'addr': '172.21.15.119:6834', 'nonce': 3870554299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:29:55.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:29:55.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-17T06:29:55.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.712+0000 7fc5515e6700 1 Processor -- start 2023-11-17T06:29:55.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.712+0000 7fc5515e6700 1 -- start start 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5515e6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5515e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5515e6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0d0380 con 0x7fc54c15d1c0 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5515e6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c1619b0 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5515e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0d1180 con 0x7fc54c0d1c60 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40800/0 (socket says 172.21.15.100:40800) 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 -- 172.21.15.100:0/2351170034 learned_addr learned my addr 172.21.15.100:0/2351170034 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc550de5700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 -- 172.21.15.100:0/2351170034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 msgr2=0x7fc54c0d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0d20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 -- 172.21.15.100:0/2351170034 >> v1:172.21.15.119:6789/0 conn(0x7fc54c15d1c0 legacy=0x7fc54c160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc5437fe700 1 -- 172.21.15.100:0/2351170034 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0d1460 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.716+0000 7fc550de5700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5437fe700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc534009910 tx=0x7fc534009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3bc15ad139e328 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc54b7fe700 1 -- 172.21.15.100:0/2351170034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400ba60 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc54b7fe700 1 -- 172.21.15.100:0/2351170034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53400bbc0 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc54b7fe700 1 -- 172.21.15.100:0/2351170034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534009e60 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- 172.21.15.100:0/2351170034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c0cf9e0 msgr2=0x7fc54c0cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc534009910 tx=0x7fc534009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- 172.21.15.100:0/2351170034 shutdown_connections 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 --2- 172.21.15.100:0/2351170034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c0cfe40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- 172.21.15.100:0/2351170034 >> 172.21.15.100:0/2351170034 conn(0x7fc54c0d2fd0 msgr2=0x7fc54c0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- 172.21.15.100:0/2351170034 shutdown_connections 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- 172.21.15.100:0/2351170034 wait complete. 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 Processor -- start 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.720+0000 7fc5515e6700 1 -- start start 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15feb0 con 0x7fc54c15d1c0 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15b5a0 con 0x7fc54c0cf9e0 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c15efc0 con 0x7fc54c0d1c60 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40814/0 (socket says 172.21.15.100:40814) 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 -- 172.21.15.100:0/3740481428 learned_addr learned my addr 172.21.15.100:0/3740481428 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5437fe700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 -- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 msgr2=0x7fc54c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 -- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c0cf9e0 msgr2=0x7fc54c15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 -- 172.21.15.100:0/3740481428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534009570 con 0x7fc54c15d1c0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc550de5700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc544009fd0 tx=0x7fc54400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5497fa700 1 -- 172.21.15.100:0/3740481428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544003a40 con 0x7fc54c15d1c0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5497fa700 1 -- 172.21.15.100:0/3740481428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400f040 con 0x7fc54c15d1c0 2023-11-17T06:29:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c15f2a0 con 0x7fc54c15d1c0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5497fa700 1 -- 172.21.15.100:0/3740481428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544003e00 con 0x7fc54c15d1c0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.724+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c15f860 con 0x7fc54c15d1c0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.728+0000 7fc5497fa700 1 -- 172.21.15.100:0/3740481428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc544004030 con 0x7fc54c15d1c0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.728+0000 7fc5497fa700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 0x7fc52c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.728+0000 7fc5497fa700 1 -- 172.21.15.100:0/3740481428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc544084130 con 0x7fc54c15d1c0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 0x7fc52c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 0x7fc52c0689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0c95e0 tx=0x7fc53c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 Processor -- start 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 -- start start 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e109a0 0x1e13010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e13550 0x1e13930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d42620 con 0x1e126f0 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d3fd10 con 0x1e13550 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.732+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d3b600 con 0x1e109a0 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40830/0 (socket says 172.21.15.100:40830) 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 -- 172.21.15.100:0/3500612852 learned_addr learned my addr 172.21.15.100:0/3500612852 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc550de5700 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e13550 0x1e13930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc5437fe700 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e109a0 0x1e13010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 -- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e109a0 msgr2=0x1e13010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e109a0 0x1e13010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 -- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e13550 msgr2=0x1e13930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e13550 0x1e13930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 -- 172.21.15.100:0/3500612852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d60850 con 0x1e126f0 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0053f0 tx=0x7fc53c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469ad84da573bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc541ffb700 1 -- 172.21.15.100:0/3500612852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c003df0 con 0x1e126f0 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc541ffb700 1 -- 172.21.15.100:0/3500612852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c021450 con 0x1e126f0 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc541ffb700 1 -- 172.21.15.100:0/3500612852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0217c0 con 0x1e126f0 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- 172.21.15.100:0/3500612852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 msgr2=0x1e12ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0053f0 tx=0x7fc53c011000 comp rx=0 tx=0).stop 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- 172.21.15.100:0/3500612852 shutdown_connections 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e13550 0x1e13930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e109a0 0x1e13010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 --2- 172.21.15.100:0/3500612852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e12ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- 172.21.15.100:0/3500612852 >> 172.21.15.100:0/3500612852 conn(0x1b604d0 msgr2=0x1dfb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- 172.21.15.100:0/3500612852 shutdown_connections 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- 172.21.15.100:0/3500612852 wait complete. 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 -- start start 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.736+0000 7fc555b16740 1 Processor -- start 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1dd36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1df8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cf96e0 con 0x1e13550 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cf9380 con 0x1e109a0 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1be4aa0 con 0x1e126f0 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 10 client.0 _ll_register_callbacks cb 0x1ce8a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:29:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40834/0 (socket says 172.21.15.100:40834) 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 -- 172.21.15.100:0/3396147332 learned_addr learned my addr 172.21.15.100:0/3396147332 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1dd36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 -- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 msgr2=0x1df8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc5437fe700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1df8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1df8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 -- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 msgr2=0x1dd36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1dd36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 -- 172.21.15.100:0/3396147332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c00f040 con 0x1e13550 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc5437fe700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1df8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc550de5700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc544054e50 tx=0x7fc544073160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca991dae6a76403f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:29:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544068ea0 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5440592a0 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d345e0 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc54405d450 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 10 client.4620 fetch_fsmap learned FSMap version 8 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1bab960 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d345e0 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc54405cfc0 con 0x1e13550 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 10 client.4620 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 20 client.4620 populate_metadata read hostname 'smithi100' 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e15060 0x1e15440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 4 client.4620 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.740+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 --> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1cf4470 con 0x1e15060 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e15060 0x1e15440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc52affd700 10 client.4620 ms_handle_connect on v2:172.21.15.119:6832/3870554299 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e15060 0x1e15440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15830b7fc6c42ab8 server_cookie=a5d93fe19c7f92fe in_seq=0 out_seq=0 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc52affd700 1 -- 172.21.15.100:0/3396147332 <== mds.0 v2:172.21.15.119:6832/3870554299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x1cf4470 con 0x1e15060 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc52affd700 10 client.4620 handle_command_reply: tid=0 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 client.4620 shutdown 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 msgr2=0x1df87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc544054e50 tx=0x7fc544073160 comp rx=0 tx=0).stop 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 shutdown_connections 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e15060 0x1e15440 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1df87b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1df8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 --2- 172.21.15.100:0/3396147332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1dd36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc52affd700 0 client.4620 ms_handle_reset on v2:172.21.15.119:6832/3870554299 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 >> 172.21.15.100:0/3396147332 conn(0x1b604d0 msgr2=0x1e116e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 shutdown_connections 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.744+0000 7fc555b16740 1 -- 172.21.15.100:0/3396147332 wait complete. 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.748+0000 7fc555b16740 20 client.4620 trim_cache size 0 max 16384 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 Processor -- start 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 -- start start 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1e11e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d36f70 con 0x1e13550 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d06d80 con 0x1e109a0 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dd2250 con 0x1e126f0 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40840/0 (socket says 172.21.15.100:40840) 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 -- 172.21.15.100:0/3125893875 learned_addr learned my addr 172.21.15.100:0/3125893875 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc54bfff700 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc5437fe700 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1e11e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 -- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 msgr2=0x1e11e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1e11e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 -- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 msgr2=0x1e118d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e118d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 -- 172.21.15.100:0/3125893875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cfe4f0 con 0x1e13550 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc550de5700 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc54405cf20 tx=0x7fc54405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7b672d377a9718 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc5427fc700 1 -- 172.21.15.100:0/3125893875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544068ea0 con 0x1e13550 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc5427fc700 1 -- 172.21.15.100:0/3125893875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc544054f20 con 0x1e13550 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.768+0000 7fc5427fc700 1 -- 172.21.15.100:0/3125893875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544054c90 con 0x1e13550 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- 172.21.15.100:0/3125893875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 msgr2=0x1dfadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc54405cf20 tx=0x7fc54405b000 comp rx=0 tx=0).stop 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- 172.21.15.100:0/3125893875 shutdown_connections 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e13550 0x1dfadc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e126f0 0x1e11e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- 172.21.15.100:0/3125893875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- 172.21.15.100:0/3125893875 >> 172.21.15.100:0/3125893875 conn(0x1b604d0 msgr2=0x1dfc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- 172.21.15.100:0/3125893875 shutdown_connections 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- 172.21.15.100:0/3125893875 wait complete. 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- start start 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 Processor -- start 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 0x1e37870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d38e10 con 0x1e126f0 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d0c970 con 0x1e109a0 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d38a00 con 0x1e13550 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc555b16740 10 client.0 _ll_register_callbacks cb 0x1d004b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40846/0 (socket says 172.21.15.100:40846) 2023-11-17T06:29:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 -- 172.21.15.100:0/1024716422 learned_addr learned my addr 172.21.15.100:0/1024716422 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc54bfff700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 -- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 msgr2=0x1e37870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc550de5700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 0x1e37870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 0x1e37870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 -- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 msgr2=0x1e7bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e7bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 -- 172.21.15.100:0/1024716422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bab960 con 0x1e126f0 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc550de5700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 0x1e37870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc54bfff700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e7bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc5437fe700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b3c0 tx=0x7fc5340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2361662d11723e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.772+0000 7fc52affd700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:29:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534004450 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc53c021450 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5340045b0 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5340036c0 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 10 client.4626 fetch_fsmap learned FSMap version 8 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1ce48d0 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c021450 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc534003820 con 0x1e126f0 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 10 client.4626 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 20 client.4626 populate_metadata read hostname 'smithi100' 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e38010 0x1e2e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 4 client.4626 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 --> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1bb7460 con 0x1e38010 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc54bfff700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e38010 0x1e2e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc54bfff700 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e38010 0x1e2e630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40ebbcf1e5d57b7f server_cookie=c674c7fea01c671f in_seq=0 out_seq=0 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 10 client.4626 ms_handle_connect on v2:172.21.15.119:6832/3870554299 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 1 -- 172.21.15.100:0/1024716422 <== mds.0 v2:172.21.15.119:6832/3870554299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1bb7460 con 0x1e38010 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc52affd700 10 client.4626 handle_command_reply: tid=0 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 client.4626 shutdown 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 msgr2=0x1e37330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.776+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b3c0 tx=0x7fc5340047e0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 shutdown_connections 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:6832/3870554299,v1:172.21.15.119:6834/3870554299] conn(0x1e38010 0x1e2e630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1e13550 0x1e37870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x1e126f0 0x1e37330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 --2- 172.21.15.100:0/1024716422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1e109a0 0x1e7bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 >> 172.21.15.100:0/1024716422 conn(0x1b604d0 msgr2=0x1df8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc52affd700 0 client.4626 ms_handle_reset on v2:172.21.15.119:6832/3870554299 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 shutdown_connections 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 1 -- 172.21.15.100:0/1024716422 wait complete. 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc555b16740 20 client.4626 trim_cache size 0 max 16384 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "85721606-40d2-46b5-8d45-5c90fa8b3283", 2023-11-17T06:29:55.829 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4288, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 15.749961626999999, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 8, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 22, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 22, 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 20.803470454999999 2023-11-17T06:29:55.830 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:29:55.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 msgr2=0x7fc52c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 0x7fc52c0689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0c95e0 tx=0x7fc53c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 msgr2=0x7fc54c0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc544009fd0 tx=0x7fc54400d460 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 shutdown_connections 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc52c066510 0x7fc52c0689d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54c15d1c0 0x7fc54c0ca970 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc54c0d1c60 0x7fc54c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 --2- 172.21.15.100:0/3740481428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc54c0cf9e0 0x7fc54c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 >> 172.21.15.100:0/3740481428 conn(0x7fc54c0d2fd0 msgr2=0x7fc54c0b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 shutdown_connections 2023-11-17T06:29:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:55.780+0000 7fc5515e6700 1 -- 172.21.15.100:0/3740481428 wait complete. 2023-11-17T06:29:55.833 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-17T06:29:55.859 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-17T06:29:55.859 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-17T06:29:55.859 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-17T06:29:55.859 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:29:55.859 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:29:55.859 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-17T06:29:55.859 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:29:55.859 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-17T06:29:55.860 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-17T06:29:55.860 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:29:55.860 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-17T06:29:55.860 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-17T06:29:55.860 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:29:55.860 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-17T06:29:55.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:55.860 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:29:55.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:55.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-11-17T06:29:55.969 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2023-11-17T06:29:55.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:29:55.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:55.974 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-11-17T06:29:55.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:55.998 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-11-17T06:29:56.083 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2023-11-17T06:29:56.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:29:56.087 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-17T06:29:56.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:29:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.264+0000 7f79eee76700 1 Processor -- start 2023-11-17T06:29:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 -- start start 2023-11-17T06:29:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f79e80cf8a0 0x7f79e815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e8070ad0 con 0x7f79e815b0a0 2023-11-17T06:29:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e8071f20 con 0x7f79e80cf8a0 2023-11-17T06:29:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79eee76700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80cfcf0 con 0x7f79e80b1150 2023-11-17T06:29:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ecc12700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f79e815b0a0 0x7f79e80b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52960/0 (socket says 172.21.15.100:52960) 2023-11-17T06:29:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ecc12700 1 -- 172.21.15.100:0/4239417643 learned_addr learned my addr 172.21.15.100:0/4239417643 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ed413700 1 --2- 172.21.15.100:0/4239417643 >> v2:172.21.15.119:3300/0 conn(0x7f79e80cf8a0 0x7f79e815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79dffff700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79df7fe700 1 -- 172.21.15.100:0/4239417643 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801478873 0 0) 0x7f79e8070ad0 con 0x7f79e815b0a0 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79df7fe700 1 -- 172.21.15.100:0/4239417643 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d00035d0 con 0x7f79e815b0a0 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ed413700 1 -- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 msgr2=0x7f79e80cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ed413700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ed413700 1 -- 172.21.15.100:0/4239417643 >> v1:172.21.15.100:6789/0 conn(0x7f79e815b0a0 legacy=0x7f79e80b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.268+0000 7f79ed413700 1 -- 172.21.15.100:0/4239417643 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80721a0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79ed413700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e80cf8a0 0x7f79e815ed30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009850 tx=0x7f79e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ebdfcce7b80741 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79df7fe700 1 -- 172.21.15.100:0/4239417643 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011830 con 0x7f79e80cf8a0 2023-11-17T06:29:56.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79df7fe700 1 -- 172.21.15.100:0/4239417643 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0011990 con 0x7f79e80cf8a0 2023-11-17T06:29:56.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79df7fe700 1 -- 172.21.15.100:0/4239417643 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011d40 con 0x7f79e80cf8a0 2023-11-17T06:29:56.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 -- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e80cf8a0 msgr2=0x7f79e815ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e80cf8a0 0x7f79e815ed30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009850 tx=0x7f79e0009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:56.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 -- 172.21.15.100:0/4239417643 shutdown_connections 2023-11-17T06:29:56.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e80cf8a0 0x7f79e815ed30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 --2- 172.21.15.100:0/4239417643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 -- 172.21.15.100:0/4239417643 >> 172.21.15.100:0/4239417643 conn(0x7f79e806a270 msgr2=0x7f79e806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:56.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 -- 172.21.15.100:0/4239417643 shutdown_connections 2023-11-17T06:29:56.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.272+0000 7f79eee76700 1 -- 172.21.15.100:0/4239417643 wait complete. 2023-11-17T06:29:56.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.276+0000 7f79eee76700 1 Processor -- start 2023-11-17T06:29:56.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.276+0000 7f79eee76700 1 -- start start 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.276+0000 7f79eee76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e815b0a0 0x7f79e80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e814e850 con 0x7f79e80cf8a0 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c8810 con 0x7f79e815b0a0 2023-11-17T06:29:56.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c8af0 con 0x7f79e80b1150 2023-11-17T06:29:56.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40850/0 (socket says 172.21.15.100:40850) 2023-11-17T06:29:56.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 -- 172.21.15.100:0/2949019173 learned_addr learned my addr 172.21.15.100:0/2949019173 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79ecc12700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79ed413700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e815b0a0 0x7f79e80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 -- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 msgr2=0x7f79e80ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 -- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e815b0a0 msgr2=0x7f79e80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e815b0a0 0x7f79e80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 -- 172.21.15.100:0/2949019173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00094b0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dffff700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79d800e840 tx=0x7f79d800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80095a0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e80c8dd0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80ac8d0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8005a40 con 0x7f79e80cf8a0 2023-11-17T06:29:56.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.280+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8005db0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.284+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c8005310 con 0x7f79e80cf8a0 2023-11-17T06:29:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.284+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79d800c690 con 0x7f79e80cf8a0 2023-11-17T06:29:56.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.288+0000 7f79dd7fa700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 0x7f79d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.288+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79d8083ec0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.288+0000 7f79ecc12700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 0x7f79d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.288+0000 7f79ecc12700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 0x7f79d40689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001560 tx=0x7f79e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.292+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79d80512b0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.500+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79c8005dd0 con 0x7f79e80cf8a0 2023-11-17T06:29:56.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.500+0000 7f79dd7fa700 1 -- 172.21.15.100:0/2949019173 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79d8017060 con 0x7f79e80cf8a0 2023-11-17T06:29:56.503 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 msgr2=0x7f79d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 0x7f79d40689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001560 tx=0x7f79e4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 msgr2=0x7f79e80c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79d800e840 tx=0x7f79d800ec00 comp rx=0 tx=0).stop 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 shutdown_connections 2023-11-17T06:29:56.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e815b0a0 0x7f79e80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f79d4066510 0x7f79d40689d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e80cf8a0 0x7f79e80c81a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 --2- 172.21.15.100:0/2949019173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e80b1150 0x7f79e80ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 >> 172.21.15.100:0/2949019173 conn(0x7f79e806a270 msgr2=0x7f79e80b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 shutdown_connections 2023-11-17T06:29:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:56.504+0000 7f79eee76700 1 -- 172.21.15.100:0/2949019173 wait complete. 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:29:56.531 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:29:56.532 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:29:56.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.532 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-11-17T06:29:56.551 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:29:56.551 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:29:56.551 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:29:56.551 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:56.552 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42124sec preferred_lft 42124sec 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:56:04:b0:e5 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:29:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:56.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-17T06:29:56.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.554 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-17T06:29:56.555 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:56.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.718 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:29:56.752 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:29:56.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.755 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-11-17T06:29:56.835 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:29:56.836 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:29:56.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.837 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:56.838 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:56.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:29:56.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:29:56.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:29:56.838 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:56.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.978 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:29:56.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:56.996 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2023-11-17T06:29:57.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:57.059 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:57.059 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:57.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:57.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-17T06:29:57.059 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:57.171 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-17T06:29:57.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-17T06:29:57.172 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:57.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:57.361 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:57.361 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:57.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-11-17T06:29:57.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2023-11-17T06:29:57.361 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:57.433 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:29:57.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:29:57.433 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:29:57.449 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:29:57.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:29:57.450 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:29:57.511 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:29:57.591 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:29:57.660 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:29:57.660 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:29:57.660 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:29:57.660 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:29:57.661 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:29:57.662 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:29:57.663 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:29:57.664 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:57.664 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:57.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:57.665 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:29:57.726 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:29:57.727 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:29:57.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:29:57.808 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:29:57.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:29:57.871 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:29:57.871 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:29:57.871 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:29:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:29:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:29:57.874 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:29:57.875 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:29:57.875 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:29:57.875 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:57.875 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:57.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:57.876 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:29:57.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2023-11-17T06:29:57.916+0000 7fa0c484f640 -1 init, newargv = 0x55610d3f1890 newargc=15 2023-11-17T06:29:57.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[43809]: starting ceph client 2023-11-17T06:29:57.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[43809]: starting fuse 2023-11-17T06:29:57.936 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:29:57.937 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:29:57.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:29:57.937 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-11-17T06:29:57.937 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-11-17T06:29:57.938 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2023-11-17T06:29:57.939 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:29:58.096 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.43809.asok 2023-11-17T06:29:58.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:29:58.116 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43809.asok 2023-11-17T06:29:58.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:58.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43809.asok status 2023-11-17T06:29:58.302 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:29:58.302 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "43809", 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4638, 2023-11-17T06:29:58.303 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4638 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4276003039 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:29:58.304 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4276003039 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4638 192.168.0.1:0/4276003039", 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/4276003039", 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 8, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 22, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-11-17T06:29:58.305 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:29:58.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:29:58.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.480+0000 7f1aa26c9700 1 Processor -- start 2023-11-17T06:29:58.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.480+0000 7f1aa26c9700 1 -- start start 2023-11-17T06:29:58.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa26c9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a9c15d1c0 0x7f1a9c160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa26c9700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c0d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa26c9700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c1619b0 con 0x7f1a9c161380 2023-11-17T06:29:58.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa26c9700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0d1180 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa26c9700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0d1460 con 0x7f1a9c0d00f0 2023-11-17T06:29:58.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa0ec6700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1a9c161380 0x7f1a9c0cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52974/0 (socket says 172.21.15.100:52974) 2023-11-17T06:29:58.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa0ec6700 1 -- 172.21.15.100:0/2195859110 learned_addr learned my addr 172.21.15.100:0/2195859110 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:29:58.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/2195859110 >> v2:172.21.15.100:3300/0 conn(0x7f1a9c15d1c0 0x7f1a9c160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1aa1ec8700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c0d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1a93fff700 1 -- 172.21.15.100:0/2195859110 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793330167 0 0) 0x7f1a9c1619b0 con 0x7f1a9c161380 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.484+0000 7f1a93fff700 1 -- 172.21.15.100:0/2195859110 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a880035d0 con 0x7f1a9c161380 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa16c7700 1 -- 172.21.15.100:0/2195859110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 msgr2=0x7f1a9c0d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c0d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa16c7700 1 -- 172.21.15.100:0/2195859110 >> v1:172.21.15.100:6789/0 conn(0x7f1a9c161380 legacy=0x7f1a9c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa16c7700 1 -- 172.21.15.100:0/2195859110 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0d1740 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c160e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009850 tx=0x7f1a98009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7feeb4c9a1856bdd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1a93fff700 1 -- 172.21.15.100:0/2195859110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011830 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1a93fff700 1 -- 172.21.15.100:0/2195859110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98011990 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1a93fff700 1 -- 172.21.15.100:0/2195859110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011d40 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 -- 172.21.15.100:0/2195859110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 msgr2=0x7f1a9c160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c160e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009850 tx=0x7f1a98009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:58.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 -- 172.21.15.100:0/2195859110 shutdown_connections 2023-11-17T06:29:58.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c0d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/2195859110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c160e40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 -- 172.21.15.100:0/2195859110 >> 172.21.15.100:0/2195859110 conn(0x7f1a9c0d2fd0 msgr2=0x7f1a9c0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:58.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 -- 172.21.15.100:0/2195859110 shutdown_connections 2023-11-17T06:29:58.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.488+0000 7f1aa26c9700 1 -- 172.21.15.100:0/2195859110 wait complete. 2023-11-17T06:29:58.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 Processor -- start 2023-11-17T06:29:58.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- start start 2023-11-17T06:29:58.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a9c161380 0x7f1a9c0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1601b0 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c151900 con 0x7f1a9c161380 2023-11-17T06:29:58.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c15f530 con 0x7f1a9c0d00f0 2023-11-17T06:29:58.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40880/0 (socket says 172.21.15.100:40880) 2023-11-17T06:29:58.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 -- 172.21.15.100:0/1536546320 learned_addr learned my addr 172.21.15.100:0/1536546320 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa1ec8700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a9c161380 0x7f1a9c0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 -- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 msgr2=0x7f1a9c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 -- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a9c161380 msgr2=0x7f1a9c0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a9c161380 0x7f1a9c0c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 -- 172.21.15.100:0/1536546320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980094b0 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa0ec6700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c4d0 tx=0x7f1a8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c005d90 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0070d0 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c15f810 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c007480 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.492+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c15fdd0 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.496+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c0b2730 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.496+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a8c0075e0 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.500+0000 7f1a91ffb700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 0x7f1a800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.500+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a8c083340 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.500+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 0x7f1a800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.500+0000 7f1aa16c7700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 0x7f1a800689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a980090b0 tx=0x7f1a98008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.504+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a9c0b2730 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.708+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a9c0b2730 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.708+0000 7f1a91ffb700 1 -- 172.21.15.100:0/1536546320 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a9c0b2730 con 0x7f1a9c15d1c0 2023-11-17T06:29:58.713 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:29:58.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 msgr2=0x7f1a800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 0x7f1a800689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a980090b0 tx=0x7f1a98008030 comp rx=0 tx=0).stop 2023-11-17T06:29:58.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 msgr2=0x7f1a9c0c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c4d0 tx=0x7f1a8c00c890 comp rx=0 tx=0).stop 2023-11-17T06:29:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 shutdown_connections 2023-11-17T06:29:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a9c161380 0x7f1a9c0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1a80066510 0x7f1a800689d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a9c15d1c0 0x7f1a9c0c8240 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 --2- 172.21.15.100:0/1536546320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a9c0d00f0 0x7f1a9c1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.712+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 >> 172.21.15.100:0/1536546320 conn(0x7f1a9c0d2fd0 msgr2=0x7f1a9c0b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.716+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 shutdown_connections 2023-11-17T06:29:58.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:29:58.716+0000 7f1aa26c9700 1 -- 172.21.15.100:0/1536546320 wait complete. 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:29:58.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-17T06:29:58.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:58.741 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:58.757 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42122sec preferred_lft 42122sec 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-11-17T06:29:58.758 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:56:04:b0:e5 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::500a:a9ff:fe52:b4e2/64 scope link 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:29:58.759 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:58.760 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c84b:a0ff:fe54:7d52/64 scope link tentative 2023-11-17T06:29:58.760 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:58.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:58.761 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:29:58.835 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:29:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:58.838 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:29:58.905 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:29:58.906 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:29:58.906 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:29:58.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:29:58.906 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:59.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.041 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:29:59.058 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:29:59.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.059 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2023-11-17T06:29:59.122 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-17T06:29:59.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.123 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:59.123 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:59.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:29:59.124 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-17T06:29:59.124 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:59.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:29:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 06:c1:0e:59:0c:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:29:59.279 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:29:59.279 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.279 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4c1:eff:fe59:c07/64 scope link 2023-11-17T06:29:59.279 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.281 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-17T06:29:59.363 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:29:59.363 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:29:59.363 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:29:59.363 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.363 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 06:c1:0e:59:0c:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4c1:eff:fe59:c07/64 scope link 2023-11-17T06:29:59.364 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:29:59.367 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-17T06:29:59.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.367 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-17T06:29:59.368 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:59.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.566 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:29:59.566 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:29:59.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2023-11-17T06:29:59.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2023-11-17T06:29:59.567 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:29:59.644 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-17T06:29:59.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:29:59.645 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-17T06:29:59.661 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-17T06:29:59.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:29:59.662 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-17T06:29:59.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:29:59.801 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:29:59.869 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:29:59.869 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:29:59.869 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:29:59.870 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:29:59.871 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:29:59.872 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-17T06:29:59.873 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:29:59.874 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:29:59.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:29:59.875 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:29:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:29:59.938 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-11-17T06:29:59.939 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-17T06:29:59.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:30:00.022 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:30:00.089 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:30:00.091 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:00.092 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:00.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:00.093 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:30:00.134 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:2023-11-17T06:30:00.132+0000 7f240689b640 -1 init, newargv = 0x55a61e0839c0 newargc=15 2023-11-17T06:30:00.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[43946]: starting ceph client 2023-11-17T06:30:00.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[43946]: starting fuse 2023-11-17T06:30:00.148 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:30:00.148 INFO:teuthology.orchestra.run.smithi100.stdout:50 2023-11-17T06:30:00.149 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-11-17T06:30:00.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:00.149 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-11-17T06:30:00.149 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-11-17T06:30:00.150 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.2")) 2023-11-17T06:30:00.151 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:30:00.317 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.2.43946.asok 2023-11-17T06:30:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:00.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.43946.asok 2023-11-17T06:30:00.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:00.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.43946.asok status 2023-11-17T06:30:00.540 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:30:00.540 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-11-17T06:30:00.540 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:00.540 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "2", 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "43946", 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4656, 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-11-17T06:30:00.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4656 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1592404254 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:00.542 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1592404254 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4656 192.168.0.2:0/1592404254", 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.2:0/1592404254", 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 8, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 22, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-11-17T06:30:00.543 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:30:00.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.732+0000 7fc763990700 1 Processor -- start 2023-11-17T06:30:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.732+0000 7fc763990700 1 -- start start 2023-11-17T06:30:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc763990700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc763990700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 0x7fc75c0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc763990700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0d15e0 con 0x7fc75c15d4a0 2023-11-17T06:30:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc763990700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0d0510 con 0x7fc75c0cfb60 2023-11-17T06:30:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc763990700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0d18c0 con 0x7fc75c0b2730 2023-11-17T06:30:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc761f2d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 0x7fc75c0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc761f2d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 0x7fc75c0cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40896/0 (socket says 172.21.15.100:40896) 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc761f2d700 1 -- 172.21.15.100:0/4206867739 learned_addr learned my addr 172.21.15.100:0/4206867739 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc753fff700 1 -- 172.21.15.100:0/4206867739 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960514056 0 0) 0x7fc75c0d15e0 con 0x7fc75c15d4a0 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 -- 172.21.15.100:0/4206867739 >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 msgr2=0x7fc75c0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 --2- 172.21.15.100:0/4206867739 >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 0x7fc75c0cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 -- 172.21.15.100:0/4206867739 >> v1:172.21.15.119:6789/0 conn(0x7fc75c15d4a0 legacy=0x7fc75c0b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 -- 172.21.15.100:0/4206867739 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0d1ba0 con 0x7fc75c0b2730 2023-11-17T06:30:00.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc760f2b700 1 --2- 172.21.15.100:0/4206867739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0b6170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009850 tx=0x7fc74c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48fbb0bde464def server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.736+0000 7fc753fff700 1 -- 172.21.15.100:0/4206867739 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011830 con 0x7fc75c0b2730 2023-11-17T06:30:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc753fff700 1 -- 172.21.15.100:0/4206867739 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c011990 con 0x7fc75c0b2730 2023-11-17T06:30:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc753fff700 1 -- 172.21.15.100:0/4206867739 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011d40 con 0x7fc75c0b2730 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 -- 172.21.15.100:0/4206867739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 msgr2=0x7fc75c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 --2- 172.21.15.100:0/4206867739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0b6170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009850 tx=0x7fc74c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 -- 172.21.15.100:0/4206867739 shutdown_connections 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 --2- 172.21.15.100:0/4206867739 >> v2:172.21.15.100:3300/0 conn(0x7fc75c0cfb60 0x7fc75c0cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 --2- 172.21.15.100:0/4206867739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0b6170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 -- 172.21.15.100:0/4206867739 >> 172.21.15.100:0/4206867739 conn(0x7fc75c06b430 msgr2=0x7fc75c06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 -- 172.21.15.100:0/4206867739 shutdown_connections 2023-11-17T06:30:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.740+0000 7fc763990700 1 -- 172.21.15.100:0/4206867739 wait complete. 2023-11-17T06:30:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 Processor -- start 2023-11-17T06:30:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 -- start start 2023-11-17T06:30:00.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c0cfb60 0x7fc75c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0cb650 con 0x7fc75c15d4a0 2023-11-17T06:30:00.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0ca7a0 con 0x7fc75c0cfb60 2023-11-17T06:30:00.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0caa40 con 0x7fc75c0b2730 2023-11-17T06:30:00.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40902/0 (socket says 172.21.15.100:40902) 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 -- 172.21.15.100:0/2584004030 learned_addr learned my addr 172.21.15.100:0/2584004030 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc760f2b700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c0cfb60 0x7fc75c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc76172c700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 -- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 msgr2=0x7fc75c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 -- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c0cfb60 msgr2=0x7fc75c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c0cfb60 0x7fc75c0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 -- 172.21.15.100:0/2584004030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0094b0 con 0x7fc75c15d4a0 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc761f2d700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc75400efc0 tx=0x7fc75400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754003c40 con 0x7fc75c15d4a0 2023-11-17T06:30:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400f040 con 0x7fc75c15d4a0 2023-11-17T06:30:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0cad20 con 0x7fc75c15d4a0 2023-11-17T06:30:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.744+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754009e60 con 0x7fc75c15d4a0 2023-11-17T06:30:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.748+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c0cb2e0 con 0x7fc75c15d4a0 2023-11-17T06:30:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.748+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0cf370 con 0x7fc75c15d4a0 2023-11-17T06:30:00.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.748+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc75400c880 con 0x7fc75c15d4a0 2023-11-17T06:30:00.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.752+0000 7fc751ffb700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 0x7fc7400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.752+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc754084140 con 0x7fc75c15d4a0 2023-11-17T06:30:00.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.752+0000 7fc76172c700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 0x7fc7400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.752+0000 7fc76172c700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 0x7fc7400689d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc758000f60 tx=0x7fc758009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.760+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc754051520 con 0x7fc75c15d4a0 2023-11-17T06:30:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.964+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc75c04eea0 con 0x7fc75c15d4a0 2023-11-17T06:30:00.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc751ffb700 1 -- 172.21.15.100:0/2584004030 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc754054b40 con 0x7fc75c15d4a0 2023-11-17T06:30:00.970 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:00.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 msgr2=0x7fc7400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 0x7fc7400689d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc758000f60 tx=0x7fc758009040 comp rx=0 tx=0).stop 2023-11-17T06:30:00.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 msgr2=0x7fc75c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc75400efc0 tx=0x7fc75400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 shutdown_connections 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc740066510 0x7fc7400689d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc75c15d4a0 0x7fc75c0c88c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc75c0cfb60 0x7fc75c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 --2- 172.21.15.100:0/2584004030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc75c0b2730 0x7fc75c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 >> 172.21.15.100:0/2584004030 conn(0x7fc75c06b430 msgr2=0x7fc75c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 shutdown_connections 2023-11-17T06:30:00.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:00.968+0000 7fc763990700 1 -- 172.21.15.100:0/2584004030 wait complete. 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:00.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:00.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:00.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:00.994 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-17T06:30:00.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:00.994 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:01.014 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:01.015 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42115sec preferred_lft 42115sec 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:f7:27:db:d1 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:01.016 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:01.017 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-17T06:30:01.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.017 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:01.017 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:01.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-11-17T06:30:01.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-11-17T06:30:01.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-11-17T06:30:01.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-17T06:30:01.018 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:01.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.169 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:01.201 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-11-17T06:30:01.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.205 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-11-17T06:30:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-11-17T06:30:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:01.283 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:01.283 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:01.283 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:01.283 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:01.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:01.284 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:01.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.423 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-11-17T06:30:01.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.443 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-11-17T06:30:01.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.502 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:01.502 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:01.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:01.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-17T06:30:01.503 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:01.622 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-17T06:30:01.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-17T06:30:01.623 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:01.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:01.807 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:01.807 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:01.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-11-17T06:30:01.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-11-17T06:30:01.807 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:01.879 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-17T06:30:01.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:01.879 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:01.894 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-17T06:30:01.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:01.895 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:01.953 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-11-17T06:30:02.041 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:02.113 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2023-11-17T06:30:02.114 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:02.115 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-11-17T06:30:02.116 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-11-17T06:30:02.117 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:02.118 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:02.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:02.119 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-11-17T06:30:02.177 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:30:02.178 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-17T06:30:02.225 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-11-17T06:30:02.259 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:02.323 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-11-17T06:30:02.323 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-11-17T06:30:02.324 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-11-17T06:30:02.325 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:02.326 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:02.327 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-11-17T06:30:02.327 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:02.327 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:02.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:02.328 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-11-17T06:30:02.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:2023-11-17T06:30:02.367+0000 7f81c8bb0640 -1 init, newargv = 0x55c72327f0c0 newargc=15 2023-11-17T06:30:02.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[41784]: starting ceph client 2023-11-17T06:30:02.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[41784]: starting fuse 2023-11-17T06:30:02.383 INFO:teuthology.orchestra.run.smithi119.stdout:49 2023-11-17T06:30:02.384 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:30:02.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:02.384 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-11-17T06:30:02.384 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-11-17T06:30:02.384 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:02.385 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.1")) 2023-11-17T06:30:02.386 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-11-17T06:30:02.555 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.1.41784.asok 2023-11-17T06:30:02.559 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:02.578 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41784.asok 2023-11-17T06:30:02.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:02.579 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41784.asok status 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "1", 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-11-17T06:30:02.773 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "41784", 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4535, 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4535 2023-11-17T06:30:02.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 14052660 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 14052660 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4535 192.168.0.1:0/14052660", 2023-11-17T06:30:02.775 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/14052660", 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 22, 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-11-17T06:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-11-17T06:30:02.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 Processor -- start 2023-11-17T06:30:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 -- start start 2023-11-17T06:30:02.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fad680e3580 0x7fad680544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 0x7fad6803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad68058eb0 con 0x7fad680583a0 2023-11-17T06:30:02.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad68057c70 con 0x7fad680e3580 2023-11-17T06:30:02.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad77034700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68057f50 con 0x7fad680574e0 2023-11-17T06:30:02.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad75831700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fad680583a0 0x7fad68056dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37194/0 (socket says 172.21.15.100:37194) 2023-11-17T06:30:02.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad75831700 1 -- 172.21.15.100:0/2023660942 learned_addr learned my addr 172.21.15.100:0/2023660942 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:02.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad76833700 1 --2- 172.21.15.100:0/2023660942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 0x7fad6803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad76032700 1 --2- 172.21.15.100:0/2023660942 >> v2:172.21.15.119:3300/0 conn(0x7fad680e3580 0x7fad680544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.976+0000 7fad75030700 1 -- 172.21.15.100:0/2023660942 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187110494 0 0) 0x7fad68058eb0 con 0x7fad680583a0 2023-11-17T06:30:02.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad75030700 1 -- 172.21.15.100:0/2023660942 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c0035d0 con 0x7fad680583a0 2023-11-17T06:30:02.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad76833700 1 -- 172.21.15.100:0/2023660942 >> v2:172.21.15.119:3300/0 conn(0x7fad680e3580 msgr2=0x7fad680544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad76833700 1 --2- 172.21.15.100:0/2023660942 >> v2:172.21.15.119:3300/0 conn(0x7fad680e3580 0x7fad680544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad76833700 1 -- 172.21.15.100:0/2023660942 >> v1:172.21.15.100:6789/0 conn(0x7fad680583a0 legacy=0x7fad68056dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad76833700 1 -- 172.21.15.100:0/2023660942 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680538f0 con 0x7fad680574e0 2023-11-17T06:30:02.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad76833700 1 --2- 172.21.15.100:0/2023660942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 0x7fad6803c3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad7002d030 tx=0x7fad7004f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee4ba2ef9643fed server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad75030700 1 -- 172.21.15.100:0/2023660942 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70067250 con 0x7fad680574e0 2023-11-17T06:30:02.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad75030700 1 -- 172.21.15.100:0/2023660942 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad700673b0 con 0x7fad680574e0 2023-11-17T06:30:02.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad75030700 1 -- 172.21.15.100:0/2023660942 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70067740 con 0x7fad680574e0 2023-11-17T06:30:02.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 -- 172.21.15.100:0/2023660942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 msgr2=0x7fad6803c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 --2- 172.21.15.100:0/2023660942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 0x7fad6803c3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad7002d030 tx=0x7fad7004f690 comp rx=0 tx=0).stop 2023-11-17T06:30:02.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 -- 172.21.15.100:0/2023660942 shutdown_connections 2023-11-17T06:30:02.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 --2- 172.21.15.100:0/2023660942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680574e0 0x7fad6803c3a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 --2- 172.21.15.100:0/2023660942 >> v2:172.21.15.119:3300/0 conn(0x7fad680e3580 0x7fad680544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 -- 172.21.15.100:0/2023660942 >> 172.21.15.100:0/2023660942 conn(0x7fad68059200 msgr2=0x7fad68059610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:02.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 -- 172.21.15.100:0/2023660942 shutdown_connections 2023-11-17T06:30:02.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.980+0000 7fad77034700 1 -- 172.21.15.100:0/2023660942 wait complete. 2023-11-17T06:30:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.984+0000 7fad77034700 1 Processor -- start 2023-11-17T06:30:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.984+0000 7fad77034700 1 -- start start 2023-11-17T06:30:02.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 0x7fad680d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680583a0 0x7fad6802fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680e0040 con 0x7fad680e3580 2023-11-17T06:30:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680e4c10 con 0x7fad680574e0 2023-11-17T06:30:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680e4eb0 con 0x7fad680583a0 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41920/0 (socket says 172.21.15.100:41920) 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 -- 172.21.15.100:0/1630658672 learned_addr learned my addr 172.21.15.100:0/1630658672 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76032700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 0x7fad680d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad75831700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680583a0 0x7fad6802fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 -- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680583a0 msgr2=0x7fad6802fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680583a0 0x7fad6802fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 -- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 msgr2=0x7fad680d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 0x7fad680d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 -- 172.21.15.100:0/1630658672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680e5190 con 0x7fad680e3580 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76032700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 0x7fad680d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad76833700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad7006a1d0 tx=0x7fad70068dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70092610 con 0x7fad680e3580 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680e5470 con 0x7fad680e3580 2023-11-17T06:30:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70092770 con 0x7fad680e3580 2023-11-17T06:30:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70092ae0 con 0x7fad680e3580 2023-11-17T06:30:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.988+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680e5a30 con 0x7fad680e3580 2023-11-17T06:30:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.992+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad680059c0 con 0x7fad680e3580 2023-11-17T06:30:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.992+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad70099020 con 0x7fad680e3580 2023-11-17T06:30:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.992+0000 7fad62ffd700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 0x7fad54068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.996+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad700fdd00 con 0x7fad680e3580 2023-11-17T06:30:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.996+0000 7fad76032700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 0x7fad54068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:02.996+0000 7fad76032700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 0x7fad54068a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009c40 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.000+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad700cb1b0 con 0x7fad680e3580 2023-11-17T06:30:03.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.208+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad6803f180 con 0x7fad680e3580 2023-11-17T06:30:03.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.212+0000 7fad62ffd700 1 -- 172.21.15.100:0/1630658672 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fad700ce7d0 con 0x7fad680e3580 2023-11-17T06:30:03.214 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 msgr2=0x7fad54068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 0x7fad54068a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009c40 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 msgr2=0x7fad680d4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad7006a1d0 tx=0x7fad70068dc0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 shutdown_connections 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fad54066540 0x7fad54068a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680e3580 0x7fad680d4090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad680583a0 0x7fad6802fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 --2- 172.21.15.100:0/1630658672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680574e0 0x7fad680d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 >> 172.21.15.100:0/1630658672 conn(0x7fad68059200 msgr2=0x7fad6803aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 shutdown_connections 2023-11-17T06:30:03.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:03.216+0000 7fad77034700 1 -- 172.21.15.100:0/1630658672 wait complete. 2023-11-17T06:30:03.240 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:03.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:03.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:03.241 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-17T06:30:03.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.241 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-11-17T06:30:03.259 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:03.259 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:03.259 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:03.259 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.259 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.260 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42113sec preferred_lft 42113sec 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:f7:27:db:d1 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether ae:58:5b:92:ae:97 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::60e9:d0ff:feae:d333/64 scope link 2023-11-17T06:30:03.261 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.262 INFO:teuthology.orchestra.run.smithi119.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:30:03.262 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether ae:58:5b:92:ae:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:03.262 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ac58:5bff:fe92:ae97/64 scope link 2023-11-17T06:30:03.262 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.263 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:03.342 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-11-17T06:30:03.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.347 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-11-17T06:30:03.412 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-11-17T06:30:03.412 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:03.412 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:03.412 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:03.412 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:03.413 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:03.413 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:03.413 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:03.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:03.413 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.553 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.572 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-11-17T06:30:03.631 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-17T06:30:03.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.632 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:03.632 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:03.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:03.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-17T06:30:03.632 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:03.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.748 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-17T06:30:03.750 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:03.757 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:03.783 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5a:67:2b:ab:29:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5867:2bff:feab:2917/64 scope link 2023-11-17T06:30:03.784 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:03.870 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5a:67:2b:ab:29:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5867:2bff:feab:2917/64 scope link 2023-11-17T06:30:03.871 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:03.874 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-17T06:30:03.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-17T06:30:03.875 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:04.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:04.073 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-11-17T06:30:04.073 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-11-17T06:30:04.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2023-11-17T06:30:04.073 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2023-11-17T06:30:04.073 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-11-17T06:30:04.136 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-17T06:30:04.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:04.136 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:04.151 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-17T06:30:04.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:04.152 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:04.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-11-17T06:30:04.288 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2023-11-17T06:30:04.353 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-11-17T06:30:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:04.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:04.357 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-11-17T06:30:04.419 INFO:teuthology.orchestra.run.smithi119.stdout:49 2023-11-17T06:30:04.420 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-11-17T06:30:04.420 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-17T06:30:04.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-11-17T06:30:04.505 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-11-17T06:30:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:04.571 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:04.572 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:04.573 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:04.574 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:04.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:04.575 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-11-17T06:30:04.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:2023-11-17T06:30:04.599+0000 7fad311ff640 -1 init, newargv = 0x5586dc1b7b40 newargc=15 2023-11-17T06:30:04.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[41894]: starting ceph client 2023-11-17T06:30:04.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[41894]: starting fuse 2023-11-17T06:30:04.616 INFO:teuthology.orchestra.run.smithi119.stdout:49 2023-11-17T06:30:04.616 INFO:teuthology.orchestra.run.smithi119.stdout:50 2023-11-17T06:30:04.617 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-11-17T06:30:04.617 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-11-17T06:30:04.618 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:04.619 DEBUG:teuthology.orchestra.run.smithi119:> 2023-11-17T06:30:04.619 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.3")) 2023-11-17T06:30:04.619 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-11-17T06:30:04.781 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.3.41894.asok 2023-11-17T06:30:04.787 INFO:teuthology.orchestra.run.smithi119.stderr:2023-11-17T06:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:04.804 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41894.asok 2023-11-17T06:30:04.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:04.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41894.asok status 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "3", 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-11-17T06:30:05.002 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "41894", 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4702, 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4702 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-11-17T06:30:05.003 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3632836803 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3632836803 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4702 192.168.0.2:0/3632836803", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.2:0/3632836803", 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-11-17T06:30:05.004 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2023-11-17T06:30:05.005 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 22, 2023-11-17T06:30:05.005 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:05.005 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-11-17T06:30:05.005 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-11-17T06:30:05.005 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-11-17T06:30:05.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.016 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-11-17T06:30:05.017 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:05.039 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-11-17T06:30:05.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:05.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:05.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.121 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-11-17T06:30:05.121 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:05.187 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-11-17T06:30:05.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:05.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:05.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.272 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-11-17T06:30:05.272 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:05.292 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-11-17T06:30:05.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:05.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:05.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.373 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-11-17T06:30:05.373 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:05.437 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-11-17T06:30:05.437 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:05.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:05.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:05.521 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-17T06:30:05.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:05.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 Processor -- start 2023-11-17T06:30:05.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 -- start start 2023-11-17T06:30:05.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb15015d4a0 0x7fb1500b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1500b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500d15e0 con 0x7fb1500cfb60 2023-11-17T06:30:05.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500d18c0 con 0x7fb15015d4a0 2023-11-17T06:30:05.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.712+0000 7fb155aff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500d1ba0 con 0x7fb1500b2730 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb15015d4a0 0x7fb1500b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb15015d4a0 0x7fb1500b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41924/0 (socket says 172.21.15.100:41924) 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 -- 172.21.15.100:0/113433254 learned_addr learned my addr 172.21.15.100:0/113433254 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb146ffd700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1500b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 -- 172.21.15.100:0/113433254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 msgr2=0x7fb1500b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1500b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 -- 172.21.15.100:0/113433254 >> v1:172.21.15.119:6789/0 conn(0x7fb1500cfb60 legacy=0x7fb1500d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 -- 172.21.15.100:0/113433254 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500d1e80 con 0x7fb15015d4a0 2023-11-17T06:30:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14f7fe700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b89d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb140009910 tx=0x7fb140009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e36f50d3b871d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14effd700 1 -- 172.21.15.100:0/113433254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140011830 con 0x7fb15015d4a0 2023-11-17T06:30:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14effd700 1 -- 172.21.15.100:0/113433254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140011990 con 0x7fb15015d4a0 2023-11-17T06:30:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb14effd700 1 -- 172.21.15.100:0/113433254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140011d40 con 0x7fb15015d4a0 2023-11-17T06:30:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 -- 172.21.15.100:0/113433254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 msgr2=0x7fb1500b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b89d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb140009910 tx=0x7fb140009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 -- 172.21.15.100:0/113433254 shutdown_connections 2023-11-17T06:30:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1500b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 --2- 172.21.15.100:0/113433254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b89d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 -- 172.21.15.100:0/113433254 >> 172.21.15.100:0/113433254 conn(0x7fb15006b430 msgr2=0x7fb15006b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 -- 172.21.15.100:0/113433254 shutdown_connections 2023-11-17T06:30:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.716+0000 7fb155aff700 1 -- 172.21.15.100:0/113433254 wait complete. 2023-11-17T06:30:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.720+0000 7fb155aff700 1 Processor -- start 2023-11-17T06:30:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.720+0000 7fb155aff700 1 -- start start 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.720+0000 7fb155aff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1501568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.720+0000 7fb155aff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1500cfb60 0x7fb1500b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.720+0000 7fb155aff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb155aff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150156e30 con 0x7fb15015d4a0 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb155aff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ca300 con 0x7fb1500cfb60 2023-11-17T06:30:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb155aff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ca5e0 con 0x7fb1500b2730 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41934/0 (socket says 172.21.15.100:41934) 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 -- 172.21.15.100:0/3609266588 learned_addr learned my addr 172.21.15.100:0/3609266588 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14f7fe700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1501568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb146ffd700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1500cfb60 0x7fb1500b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 -- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 msgr2=0x7fb1501568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1501568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 -- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1500cfb60 msgr2=0x7fb1500b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1500cfb60 0x7fb1500b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 -- 172.21.15.100:0/3609266588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009570 con 0x7fb15015d4a0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14ffff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc50 tx=0x7fb14800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800ad80 con 0x7fb15015d4a0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14800ce50 con 0x7fb15015d4a0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500ca8c0 con 0x7fb15015d4a0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148003c60 con 0x7fb15015d4a0 2023-11-17T06:30:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.724+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500cae80 con 0x7fb15015d4a0 2023-11-17T06:30:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.728+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500cf370 con 0x7fb15015d4a0 2023-11-17T06:30:05.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.728+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1480050d0 con 0x7fb15015d4a0 2023-11-17T06:30:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.732+0000 7fb14cff9700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 0x7fb130068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.732+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb148083f80 con 0x7fb15015d4a0 2023-11-17T06:30:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.732+0000 7fb14f7fe700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 0x7fb130068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.732+0000 7fb14f7fe700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 0x7fb130068a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb140014040 tx=0x7fb140008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.736+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1480513f0 con 0x7fb15015d4a0 2023-11-17T06:30:05.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.920+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb15004eea0 con 0x7fb15015d4a0 2023-11-17T06:30:05.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.920+0000 7fb14cff9700 1 -- 172.21.15.100:0/3609266588 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fb148054a10 con 0x7fb15015d4a0 2023-11-17T06:30:05.925 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:05.925 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:05.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 msgr2=0x7fb130068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 0x7fb130068a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb140014040 tx=0x7fb140008030 comp rx=0 tx=0).stop 2023-11-17T06:30:05.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 msgr2=0x7fb1500b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc50 tx=0x7fb14800a340 comp rx=0 tx=0).stop 2023-11-17T06:30:05.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 shutdown_connections 2023-11-17T06:30:05.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb130066540 0x7fb130068a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb15015d4a0 0x7fb1500b3110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1500cfb60 0x7fb1500b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 --2- 172.21.15.100:0/3609266588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1500b2730 0x7fb1501568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 >> 172.21.15.100:0/3609266588 conn(0x7fb15006b430 msgr2=0x7fb1500b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 shutdown_connections 2023-11-17T06:30:05.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:05.924+0000 7fb155aff700 1 -- 172.21.15.100:0/3609266588 wait complete. 2023-11-17T06:30:05.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:05.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:06.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.112+0000 7fbdff5ac700 1 Processor -- start 2023-11-17T06:30:06.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 -- start start 2023-11-17T06:30:06.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdf815d440 0x7fbdf80d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbdf80d1460 0x7fbdf80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80d05c0 con 0x7fbdf80d0150 2023-11-17T06:30:06.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80b62c0 con 0x7fbdf80d1460 2023-11-17T06:30:06.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdff5ac700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80d19b0 con 0x7fbdf815d440 2023-11-17T06:30:06.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdfdb49700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbdf80d0150 0x7fbdf80b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37198/0 (socket says 172.21.15.100:37198) 2023-11-17T06:30:06.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdfdb49700 1 -- 172.21.15.100:0/4270543779 learned_addr learned my addr 172.21.15.100:0/4270543779 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:06.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/4270543779 >> v2:172.21.15.100:3300/0 conn(0x7fbdf80d1460 0x7fbdf80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdfd348700 1 --2- 172.21.15.100:0/4270543779 >> v2:172.21.15.119:3300/0 conn(0x7fbdf815d440 0x7fbdf80d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdeffff700 1 -- 172.21.15.100:0/4270543779 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602391606 0 0) 0x7fbdf80d05c0 con 0x7fbdf80d0150 2023-11-17T06:30:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.116+0000 7fbdeffff700 1 -- 172.21.15.100:0/4270543779 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde40035d0 con 0x7fbdf80d0150 2023-11-17T06:30:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdfcb47700 1 -- 172.21.15.100:0/4270543779 >> v2:172.21.15.119:3300/0 conn(0x7fbdf815d440 msgr2=0x7fbdf80d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/4270543779 >> v2:172.21.15.119:3300/0 conn(0x7fbdf815d440 0x7fbdf80d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdfcb47700 1 -- 172.21.15.100:0/4270543779 >> v1:172.21.15.100:6789/0 conn(0x7fbdf80d0150 legacy=0x7fbdf80b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdfcb47700 1 -- 172.21.15.100:0/4270543779 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80d1c90 con 0x7fbdf80d1460 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/4270543779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d1460 0x7fbdf80cfc10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009850 tx=0x7fbde8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b61763c29ae3543 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdeffff700 1 -- 172.21.15.100:0/4270543779 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011830 con 0x7fbdf80d1460 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdeffff700 1 -- 172.21.15.100:0/4270543779 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8011990 con 0x7fbdf80d1460 2023-11-17T06:30:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdeffff700 1 -- 172.21.15.100:0/4270543779 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011d20 con 0x7fbdf80d1460 2023-11-17T06:30:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 -- 172.21.15.100:0/4270543779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d1460 msgr2=0x7fbdf80cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/4270543779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d1460 0x7fbdf80cfc10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009850 tx=0x7fbde8009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 -- 172.21.15.100:0/4270543779 shutdown_connections 2023-11-17T06:30:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/4270543779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d1460 0x7fbdf80cfc10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/4270543779 >> v2:172.21.15.119:3300/0 conn(0x7fbdf815d440 0x7fbdf80d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 -- 172.21.15.100:0/4270543779 >> 172.21.15.100:0/4270543779 conn(0x7fbdf806b4e0 msgr2=0x7fbdf806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 -- 172.21.15.100:0/4270543779 shutdown_connections 2023-11-17T06:30:06.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.120+0000 7fbdff5ac700 1 -- 172.21.15.100:0/4270543779 wait complete. 2023-11-17T06:30:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.124+0000 7fbdff5ac700 1 Processor -- start 2023-11-17T06:30:06.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.124+0000 7fbdff5ac700 1 -- start start 2023-11-17T06:30:06.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdf80d1460 0x7fbdf8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdf815d440 0x7fbdf80cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8153da0 con 0x7fbdf80d0150 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80cc310 con 0x7fbdf80d1460 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80b4c50 con 0x7fbdf815d440 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41944/0 (socket says 172.21.15.100:41944) 2023-11-17T06:30:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 -- 172.21.15.100:0/1648475521 learned_addr learned my addr 172.21.15.100:0/1648475521 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdf80d1460 0x7fbdf8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfdb49700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdf815d440 0x7fbdf80cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 -- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdf815d440 msgr2=0x7fbdf80cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdf815d440 0x7fbdf80cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 -- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdf80d1460 msgr2=0x7fbdf8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdf80d1460 0x7fbdf8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 -- 172.21.15.100:0/1648475521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80094b0 con 0x7fbdf80d0150 2023-11-17T06:30:06.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdfd348700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e840 tx=0x7fbdf400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40095a0 con 0x7fbdf80d0150 2023-11-17T06:30:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4013680 con 0x7fbdf80d0150 2023-11-17T06:30:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40139f0 con 0x7fbdf80d0150 2023-11-17T06:30:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80b4f30 con 0x7fbdf80d0150 2023-11-17T06:30:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.128+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf80cc5f0 con 0x7fbdf80d0150 2023-11-17T06:30:06.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.132+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf804eea0 con 0x7fbdf80d0150 2023-11-17T06:30:06.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.132+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbdf4013b50 con 0x7fbdf80d0150 2023-11-17T06:30:06.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.132+0000 7fbdedffb700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 0x7fbddc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.132+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdf4083cd0 con 0x7fbdf80d0150 2023-11-17T06:30:06.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.136+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 0x7fbddc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.136+0000 7fbdfcb47700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 0x7fbddc0689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.140+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbdf4051150 con 0x7fbdf80d0150 2023-11-17T06:30:06.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.316+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdf80d0950 con 0x7fbdf80d0150 2023-11-17T06:30:06.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.316+0000 7fbdedffb700 1 -- 172.21.15.100:0/1648475521 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbdf4017020 con 0x7fbdf80d0150 2023-11-17T06:30:06.319 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 msgr2=0x7fbddc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 0x7fbddc0689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde8008030 comp rx=0 tx=0).stop 2023-11-17T06:30:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 msgr2=0x7fbdf80b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e840 tx=0x7fbdf400eb50 comp rx=0 tx=0).stop 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 shutdown_connections 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdf815d440 0x7fbdf80cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdf80d1460 0x7fbdf8153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbddc066510 0x7fbddc0689d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 --2- 172.21.15.100:0/1648475521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf80d0150 0x7fbdf80b5730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 >> 172.21.15.100:0/1648475521 conn(0x7fbdf806b4e0 msgr2=0x7fbdf815b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 shutdown_connections 2023-11-17T06:30:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.320+0000 7fbdff5ac700 1 -- 172.21.15.100:0/1648475521 wait complete. 2023-11-17T06:30:06.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 Processor -- start 2023-11-17T06:30:06.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 -- start start 2023-11-17T06:30:06.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51d015d2a0 0x7f51d00ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00cf7e0 0x7f51d00705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d00ae580 con 0x7f51d0160d90 2023-11-17T06:30:06.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d015d680 con 0x7f51d015d2a0 2023-11-17T06:30:06.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.520+0000 7f51cf59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d006cfb0 con 0x7f51d00cf7e0 2023-11-17T06:30:06.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cdd9b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f51d0160d90 0x7f51d00cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37208/0 (socket says 172.21.15.100:37208) 2023-11-17T06:30:06.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cdd9b700 1 -- 172.21.15.100:0/343197753 learned_addr learned my addr 172.21.15.100:0/343197753 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 --2- 172.21.15.100:0/343197753 >> v2:172.21.15.119:3300/0 conn(0x7f51d015d2a0 0x7f51d00ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ced9d700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00cf7e0 0x7f51d00705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cd59a700 1 -- 172.21.15.100:0/343197753 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876508441 0 0) 0x7f51d00ae580 con 0x7f51d0160d90 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cd59a700 1 -- 172.21.15.100:0/343197753 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b80035d0 con 0x7f51d0160d90 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 -- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00cf7e0 msgr2=0x7f51d00705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00cf7e0 0x7f51d00705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 -- 172.21.15.100:0/343197753 >> v1:172.21.15.100:6789/0 conn(0x7f51d0160d90 legacy=0x7f51d00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 -- 172.21.15.100:0/343197753 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0161220 con 0x7f51d015d2a0 2023-11-17T06:30:06.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51ce59c700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d00ae040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009850 tx=0x7f51c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d8fbbe998d01b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cd59a700 1 -- 172.21.15.100:0/343197753 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0011830 con 0x7f51d015d2a0 2023-11-17T06:30:06.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cd59a700 1 -- 172.21.15.100:0/343197753 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0011990 con 0x7f51d015d2a0 2023-11-17T06:30:06.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cd59a700 1 -- 172.21.15.100:0/343197753 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0011d40 con 0x7f51d015d2a0 2023-11-17T06:30:06.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cf59e700 1 -- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 msgr2=0x7f51d00ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.524+0000 7f51cf59e700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d00ae040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009850 tx=0x7f51c0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 -- 172.21.15.100:0/343197753 shutdown_connections 2023-11-17T06:30:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00cf7e0 0x7f51d00705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 --2- 172.21.15.100:0/343197753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d00ae040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 -- 172.21.15.100:0/343197753 >> 172.21.15.100:0/343197753 conn(0x7f51d006a690 msgr2=0x7f51d006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 -- 172.21.15.100:0/343197753 shutdown_connections 2023-11-17T06:30:06.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.528+0000 7f51cf59e700 1 -- 172.21.15.100:0/343197753 wait complete. 2023-11-17T06:30:06.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 Processor -- start 2023-11-17T06:30:06.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- start start 2023-11-17T06:30:06.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00c5d80 0x7f51d00c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00c7450 con 0x7f51d00cf7e0 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00c6840 con 0x7f51d015d2a0 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00c6b20 con 0x7f51d00c5d80 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41946/0 (socket says 172.21.15.100:41946) 2023-11-17T06:30:06.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 -- 172.21.15.100:0/4244654150 learned_addr learned my addr 172.21.15.100:0/4244654150 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:06.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ced9d700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00c5d80 0x7f51d00c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cdd9b700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 -- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00c5d80 msgr2=0x7f51d00c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00c5d80 0x7f51d00c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 -- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 msgr2=0x7f51d015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 -- 172.21.15.100:0/4244654150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00094b0 con 0x7f51d00cf7e0 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cdd9b700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51ce59c700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51c00090b0 tx=0x7f51c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0004480 con 0x7f51d00cf7e0 2023-11-17T06:30:06.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c001f070 con 0x7f51d00cf7e0 2023-11-17T06:30:06.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d00c6e00 con 0x7f51d00cf7e0 2023-11-17T06:30:06.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0003900 con 0x7f51d00cf7e0 2023-11-17T06:30:06.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.532+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d0152f30 con 0x7f51d00cf7e0 2023-11-17T06:30:06.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.536+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d0067e10 con 0x7f51d00cf7e0 2023-11-17T06:30:06.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.536+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f51c0021030 con 0x7f51d00cf7e0 2023-11-17T06:30:06.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.540+0000 7f51beffd700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 0x7f51b0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.540+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51c0085140 con 0x7f51d00cf7e0 2023-11-17T06:30:06.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.540+0000 7f51cdd9b700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 0x7f51b0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.540+0000 7f51cdd9b700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 0x7f51b0068a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f51d00c57c0 tx=0x7f51c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.544+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f51c0052520 con 0x7f51d00cf7e0 2023-11-17T06:30:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.720+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51d0065e90 con 0x7f51d00cf7e0 2023-11-17T06:30:06.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.724+0000 7f51beffd700 1 -- 172.21.15.100:0/4244654150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51c0006ce0 con 0x7f51d00cf7e0 2023-11-17T06:30:06.727 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 msgr2=0x7f51b0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 0x7f51b0068a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f51d00c57c0 tx=0x7f51c4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 msgr2=0x7f51d01529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51c00090b0 tx=0x7f51c0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:06.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 shutdown_connections 2023-11-17T06:30:06.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51d00c5d80 0x7f51d00c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51d015d2a0 0x7f51d015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f51b0066540 0x7f51b0068a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 --2- 172.21.15.100:0/4244654150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51d00cf7e0 0x7f51d01529f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 >> 172.21.15.100:0/4244654150 conn(0x7f51d006a690 msgr2=0x7f51d00704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 shutdown_connections 2023-11-17T06:30:06.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.728+0000 7f51cf59e700 1 -- 172.21.15.100:0/4244654150 wait complete. 2023-11-17T06:30:06.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:06.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 Processor -- start 2023-11-17T06:30:06.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 -- start start 2023-11-17T06:30:06.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99e0158b70 0x7f99e015c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 0x7f99e0072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e0158f50 con 0x7f99e0071c70 2023-11-17T06:30:06.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00cb860 con 0x7f99e0158b70 2023-11-17T06:30:06.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.928+0000 7f99e4b9c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00cbb40 con 0x7f99e00cf7e0 2023-11-17T06:30:06.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99dffff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 0x7f99e0072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99e0158b70 0x7f99e015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99deffd700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f99e0071c70 0x7f99e00cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:60704/0 (socket says 172.21.15.100:60704) 2023-11-17T06:30:06.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99deffd700 1 -- 172.21.15.100:0/2633703951 learned_addr learned my addr 172.21.15.100:0/2633703951 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:06.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99de7fc700 1 -- 172.21.15.100:0/2633703951 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181349123 0 0) 0x7f99e0158f50 con 0x7f99e0071c70 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99de7fc700 1 -- 172.21.15.100:0/2633703951 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c80035d0 con 0x7f99e0071c70 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 -- 172.21.15.100:0/2633703951 >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 msgr2=0x7f99e0072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 --2- 172.21.15.100:0/2633703951 >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 0x7f99e0072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 -- 172.21.15.100:0/2633703951 >> v1:172.21.15.119:6789/0 conn(0x7f99e0071c70 legacy=0x7f99e00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 -- 172.21.15.100:0/2633703951 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00cbe20 con 0x7f99e0158b70 2023-11-17T06:30:06.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99dffff700 1 --2- 172.21.15.100:0/2633703951 >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 0x7f99e0072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:06.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99df7fe700 1 --2- 172.21.15.100:0/2633703951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0158b70 0x7f99e015c700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99e00c9280 tx=0x7f99d0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87203e128f554aa server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99de7fc700 1 -- 172.21.15.100:0/2633703951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011830 con 0x7f99e0158b70 2023-11-17T06:30:06.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99de7fc700 1 -- 172.21.15.100:0/2633703951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d0011990 con 0x7f99e0158b70 2023-11-17T06:30:06.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99de7fc700 1 -- 172.21.15.100:0/2633703951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0011d20 con 0x7f99e0158b70 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 -- 172.21.15.100:0/2633703951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0158b70 msgr2=0x7f99e015c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/2633703951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0158b70 0x7f99e015c700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99e00c9280 tx=0x7f99d0009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 -- 172.21.15.100:0/2633703951 shutdown_connections 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/2633703951 >> v2:172.21.15.119:3300/0 conn(0x7f99e00cf7e0 0x7f99e0072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/2633703951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0158b70 0x7f99e015c700 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 -- 172.21.15.100:0/2633703951 >> 172.21.15.100:0/2633703951 conn(0x7f99e006a690 msgr2=0x7f99e006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 -- 172.21.15.100:0/2633703951 shutdown_connections 2023-11-17T06:30:06.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.932+0000 7f99e4b9c700 1 -- 172.21.15.100:0/2633703951 wait complete. 2023-11-17T06:30:06.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.936+0000 7f99e4b9c700 1 Processor -- start 2023-11-17T06:30:06.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.936+0000 7f99e4b9c700 1 -- start start 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00cf7e0 0x7f99e00c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e0158b70 0x7f99e00c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b0500 con 0x7f99e0071c70 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c3150 con 0x7f99e0158b70 2023-11-17T06:30:06.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c3430 con 0x7f99e00cf7e0 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41964/0 (socket says 172.21.15.100:41964) 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 -- 172.21.15.100:0/322183667 learned_addr learned my addr 172.21.15.100:0/322183667 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99dffff700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e0158b70 0x7f99e00c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99deffd700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00cf7e0 0x7f99e00c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 -- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00cf7e0 msgr2=0x7f99e00c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00cf7e0 0x7f99e00c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 -- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e0158b70 msgr2=0x7f99e00c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e0158b70 0x7f99e00c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 -- 172.21.15.100:0/322183667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009a70 con 0x7f99e0071c70 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99df7fe700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99d0014040 tx=0x7f99d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0004610 con 0x7f99e0071c70 2023-11-17T06:30:06.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d001e070 con 0x7f99e0071c70 2023-11-17T06:30:06.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00038e0 con 0x7f99e0071c70 2023-11-17T06:30:06.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d00094b0 con 0x7f99e0071c70 2023-11-17T06:30:06.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.940+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e00cca20 con 0x7f99e0071c70 2023-11-17T06:30:06.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.944+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0067e10 con 0x7f99e0071c70 2023-11-17T06:30:06.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.944+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f99d0003a40 con 0x7f99e0071c70 2023-11-17T06:30:06.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.944+0000 7f99c7fff700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 0x7f99cc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.944+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d0084d70 con 0x7f99e0071c70 2023-11-17T06:30:06.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.944+0000 7f99deffd700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 0x7f99cc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.948+0000 7f99deffd700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 0x7f99cc068a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99e01f5740 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:06.952+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99d0052280 con 0x7f99e0071c70 2023-11-17T06:30:07.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99e00c3950 con 0x7f99e0071c70 2023-11-17T06:30:07.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99c7fff700 1 -- 172.21.15.100:0/322183667 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99d0020020 con 0x7f99e0071c70 2023-11-17T06:30:07.135 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:07.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 msgr2=0x7f99cc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 0x7f99cc068a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99e01f5740 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:07.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 msgr2=0x7f99e00affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99d0014040 tx=0x7f99d0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 shutdown_connections 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e0158b70 0x7f99e00c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00cf7e0 0x7f99e00c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f99cc066540 0x7f99cc068a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 --2- 172.21.15.100:0/322183667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e0071c70 0x7f99e00affc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 >> 172.21.15.100:0/322183667 conn(0x7f99e006a690 msgr2=0x7f99e00709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.132+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 shutdown_connections 2023-11-17T06:30:07.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.136+0000 7f99e4b9c700 1 -- 172.21.15.100:0/322183667 wait complete. 2023-11-17T06:30:07.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:07.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.332+0000 7fa22c9ea700 1 Processor -- start 2023-11-17T06:30:07.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.332+0000 7fa22c9ea700 1 -- start start 2023-11-17T06:30:07.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22c9ea700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa22806d2a0 0x7fa228167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22c9ea700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280cde60 con 0x7fa22815d450 2023-11-17T06:30:07.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22c9ea700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280c4b80 con 0x7fa2280ac8c0 2023-11-17T06:30:07.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22c9ea700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280cd600 con 0x7fa22806d2a0 2023-11-17T06:30:07.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa226d9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa22815d450 0x7fa2280c3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37214/0 (socket says 172.21.15.100:37214) 2023-11-17T06:30:07.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa226d9d700 1 -- 172.21.15.100:0/3476184770 learned_addr learned my addr 172.21.15.100:0/3476184770 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:07.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22759e700 1 --2- 172.21.15.100:0/3476184770 >> v2:172.21.15.119:3300/0 conn(0x7fa22806d2a0 0x7fa228167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22659c700 1 -- 172.21.15.100:0/3476184770 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644411068 0 0) 0x7fa2280cde60 con 0x7fa22815d450 2023-11-17T06:30:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22659c700 1 -- 172.21.15.100:0/3476184770 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2140035d0 con 0x7fa22815d450 2023-11-17T06:30:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22759e700 1 -- 172.21.15.100:0/3476184770 >> v1:172.21.15.119:6789/0 conn(0x7fa2280ac8c0 legacy=0x7fa2280c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22759e700 1 -- 172.21.15.100:0/3476184770 >> v1:172.21.15.100:6789/0 conn(0x7fa22815d450 legacy=0x7fa2280c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22759e700 1 -- 172.21.15.100:0/3476184770 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280ce450 con 0x7fa22806d2a0 2023-11-17T06:30:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22759e700 1 --2- 172.21.15.100:0/3476184770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22806d2a0 0x7fa228167e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa220009d90 tx=0x7fa22000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efeca97075215442 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22659c700 1 -- 172.21.15.100:0/3476184770 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000e070 con 0x7fa22806d2a0 2023-11-17T06:30:07.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22659c700 1 -- 172.21.15.100:0/3476184770 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000bb20 con 0x7fa22806d2a0 2023-11-17T06:30:07.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.336+0000 7fa22659c700 1 -- 172.21.15.100:0/3476184770 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220012430 con 0x7fa22806d2a0 2023-11-17T06:30:07.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 -- 172.21.15.100:0/3476184770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22806d2a0 msgr2=0x7fa228167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/3476184770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22806d2a0 0x7fa228167e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa220009d90 tx=0x7fa22000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 -- 172.21.15.100:0/3476184770 shutdown_connections 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/3476184770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22806d2a0 0x7fa228167e80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 -- 172.21.15.100:0/3476184770 >> 172.21.15.100:0/3476184770 conn(0x7fa2280cb730 msgr2=0x7fa2280cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 -- 172.21.15.100:0/3476184770 shutdown_connections 2023-11-17T06:30:07.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.340+0000 7fa22c9ea700 1 -- 172.21.15.100:0/3476184770 wait complete. 2023-11-17T06:30:07.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 Processor -- start 2023-11-17T06:30:07.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 -- start start 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa22806d2a0 0x7fa2280b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2280ac8c0 0x7fa22815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281f3520 con 0x7fa22815d450 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281f2b80 con 0x7fa2280ac8c0 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22c9ea700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281f2e60 con 0x7fa22806d2a0 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41970/0 (socket says 172.21.15.100:41970) 2023-11-17T06:30:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa21e59c700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2280ac8c0 0x7fa22815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 -- 172.21.15.100:0/4034051272 learned_addr learned my addr 172.21.15.100:0/4034051272 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa226d9d700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa22806d2a0 0x7fa2280b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 -- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa22806d2a0 msgr2=0x7fa2280b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa22806d2a0 0x7fa2280b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 -- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2280ac8c0 msgr2=0x7fa22815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2280ac8c0 0x7fa22815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.344+0000 7fa22759e700 1 -- 172.21.15.100:0/4034051272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009a70 con 0x7fa22815d450 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa22759e700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa220013000 tx=0x7fa220004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220012430 con 0x7fa22815d450 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220020070 con 0x7fa22815d450 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2281f3140 con 0x7fa22815d450 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220004280 con 0x7fa22815d450 2023-11-17T06:30:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281f3940 con 0x7fa22815d450 2023-11-17T06:30:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.348+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2281f3660 con 0x7fa22815d450 2023-11-17T06:30:07.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.352+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2200043e0 con 0x7fa22815d450 2023-11-17T06:30:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.352+0000 7fa21ffff700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 0x7fa208068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.352+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa220022070 con 0x7fa22815d450 2023-11-17T06:30:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.352+0000 7fa226d9d700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 0x7fa208068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.352+0000 7fa226d9d700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 0x7fa208068a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa218007fd0 tx=0x7fa218007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.360+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2281f3660 con 0x7fa22815d450 2023-11-17T06:30:07.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.540+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2281f3660 con 0x7fa22815d450 2023-11-17T06:30:07.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.544+0000 7fa21ffff700 1 -- 172.21.15.100:0/4034051272 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fa2281f3660 con 0x7fa22815d450 2023-11-17T06:30:07.548 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:07.548 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 msgr2=0x7fa208068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 0x7fa208068a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa218007fd0 tx=0x7fa218007de0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 msgr2=0x7fa2281585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa220013000 tx=0x7fa220004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 shutdown_connections 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa208066540 0x7fa208068a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22815d450 0x7fa2281585b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2280ac8c0 0x7fa22815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 --2- 172.21.15.100:0/4034051272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa22806d2a0 0x7fa2280b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 >> 172.21.15.100:0/4034051272 conn(0x7fa2280cb730 msgr2=0x7fa22815a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 shutdown_connections 2023-11-17T06:30:07.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.548+0000 7fa22c9ea700 1 -- 172.21.15.100:0/4034051272 wait complete. 2023-11-17T06:30:07.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:07.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.748+0000 7ff2020d6700 1 Processor -- start 2023-11-17T06:30:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.748+0000 7ff2020d6700 1 -- start start 2023-11-17T06:30:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1fc161590 0x7ff1fc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0c2390 0x7ff1fc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc0c9810 con 0x7ff1fc0cf610 2023-11-17T06:30:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc0cd980 con 0x7ff1fc161590 2023-11-17T06:30:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0cfac0 con 0x7ff1fc0c2390 2023-11-17T06:30:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1fc161590 0x7ff1fc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2018d5700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff1fc0cf610 0x7ff1fc165160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37224/0 (socket says 172.21.15.100:37224) 2023-11-17T06:30:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2018d5700 1 -- 172.21.15.100:0/479709919 learned_addr learned my addr 172.21.15.100:0/479709919 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2008d3700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0c2390 0x7ff1fc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff1f3fff700 1 -- 172.21.15.100:0/479709919 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221146324 0 0) 0x7ff1fc0c9810 con 0x7ff1fc0cf610 2023-11-17T06:30:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff1f3fff700 1 -- 172.21.15.100:0/479709919 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e80035d0 con 0x7ff1fc0cf610 2023-11-17T06:30:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 -- 172.21.15.100:0/479709919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0c2390 msgr2=0x7ff1fc0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0c2390 0x7ff1fc0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 -- 172.21.15.100:0/479709919 >> v1:172.21.15.100:6789/0 conn(0x7ff1fc0cf610 legacy=0x7ff1fc165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 -- 172.21.15.100:0/479709919 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0cd3c0 con 0x7ff1fc161590 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2010d4700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0ce4b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009850 tx=0x7ff1f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1686a9636d0138 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff1f3fff700 1 -- 172.21.15.100:0/479709919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011830 con 0x7ff1fc161590 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff1f3fff700 1 -- 172.21.15.100:0/479709919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8011990 con 0x7ff1fc161590 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff1f3fff700 1 -- 172.21.15.100:0/479709919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011d40 con 0x7ff1fc161590 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 -- 172.21.15.100:0/479709919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 msgr2=0x7ff1fc0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.752+0000 7ff2020d6700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0ce4b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009850 tx=0x7ff1f8009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:07.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 -- 172.21.15.100:0/479709919 shutdown_connections 2023-11-17T06:30:07.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0c2390 0x7ff1fc0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 --2- 172.21.15.100:0/479709919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0ce4b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 -- 172.21.15.100:0/479709919 >> 172.21.15.100:0/479709919 conn(0x7ff1fc06a690 msgr2=0x7ff1fc06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 -- 172.21.15.100:0/479709919 shutdown_connections 2023-11-17T06:30:07.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 -- 172.21.15.100:0/479709919 wait complete. 2023-11-17T06:30:07.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 Processor -- start 2023-11-17T06:30:07.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 -- start start 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.756+0000 7ff2020d6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc0c2390 0x7ff1fc158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0cf610 0x7ff1fc0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0c70b0 con 0x7ff1fc161590 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc072380 con 0x7ff1fc0c2390 2023-11-17T06:30:07.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15ca40 con 0x7ff1fc0cf610 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41990/0 (socket says 172.21.15.100:41990) 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 -- 172.21.15.100:0/226989868 learned_addr learned my addr 172.21.15.100:0/226989868 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2010d4700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc0c2390 0x7ff1fc158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2008d3700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0cf610 0x7ff1fc0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 -- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0cf610 msgr2=0x7ff1fc0c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0cf610 0x7ff1fc0c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 -- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc0c2390 msgr2=0x7ff1fc158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc0c2390 0x7ff1fc158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 -- 172.21.15.100:0/226989868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80094b0 con 0x7ff1fc161590 2023-11-17T06:30:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2018d5700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400cb40 tx=0x7ff1f400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4007500 con 0x7ff1fc161590 2023-11-17T06:30:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4007660 con 0x7ff1fc161590 2023-11-17T06:30:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc159490 con 0x7ff1fc161590 2023-11-17T06:30:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40079f0 con 0x7ff1fc161590 2023-11-17T06:30:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.760+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc15c3f0 con 0x7ff1fc161590 2023-11-17T06:30:07.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.764+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc067e10 con 0x7ff1fc161590 2023-11-17T06:30:07.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.764+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff1f401b3b0 con 0x7ff1fc161590 2023-11-17T06:30:07.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.764+0000 7ff1f1ffb700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 0x7ff1e0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.768+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1f40837b0 con 0x7ff1fc161590 2023-11-17T06:30:07.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.768+0000 7ff2010d4700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 0x7ff1e0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.768+0000 7ff2010d4700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 0x7ff1e0068a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80090b0 tx=0x7ff1f801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.772+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1f4050cc0 con 0x7ff1fc161590 2023-11-17T06:30:07.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1fc15cb80 con 0x7ff1fc161590 2023-11-17T06:30:07.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff1f1ffb700 1 -- 172.21.15.100:0/226989868 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1fc15cb80 con 0x7ff1fc161590 2023-11-17T06:30:07.951 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 msgr2=0x7ff1e0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 0x7ff1e0068a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80090b0 tx=0x7ff1f801c040 comp rx=0 tx=0).stop 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 msgr2=0x7ff1fc0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.948+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400cb40 tx=0x7ff1f400cb70 comp rx=0 tx=0).stop 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 shutdown_connections 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff1e0066540 0x7ff1e0068a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1fc161590 0x7ff1fc0c6740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1fc0cf610 0x7ff1fc0c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 --2- 172.21.15.100:0/226989868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc0c2390 0x7ff1fc158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 >> 172.21.15.100:0/226989868 conn(0x7ff1fc06a690 msgr2=0x7ff1fc0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 shutdown_connections 2023-11-17T06:30:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:07.952+0000 7ff2020d6700 1 -- 172.21.15.100:0/226989868 wait complete. 2023-11-17T06:30:07.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.148+0000 7f4555dad700 1 Processor -- start 2023-11-17T06:30:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.148+0000 7f4555dad700 1 -- start start 2023-11-17T06:30:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f4555dad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f455015d2b0 0x7f45500d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f4555dad700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4550160ce0 con 0x7f45500cd8b0 2023-11-17T06:30:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f4555dad700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500cdd40 con 0x7f455015ced0 2023-11-17T06:30:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f4555dad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500ce020 con 0x7f455015d2b0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454ffff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f45500cd8b0 0x7f4550161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37232/0 (socket says 172.21.15.100:37232) 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454ffff700 1 -- 172.21.15.100:0/1323345404 learned_addr learned my addr 172.21.15.100:0/1323345404 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f45555ac700 1 --2- 172.21.15.100:0/1323345404 >> v2:172.21.15.119:3300/0 conn(0x7f455015d2b0 0x7f45500d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101871804 0 0) 0x7f4550160ce0 con 0x7f45500cd8b0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45380035d0 con 0x7f45500cd8b0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114569805 0 0) 0x7f45500cdd40 con 0x7f455015ced0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550160ce0 con 0x7f455015ced0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f45555ac700 1 -- 172.21.15.100:0/1323345404 >> v1:172.21.15.119:6789/0 conn(0x7f455015ced0 legacy=0x7f45500d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878170811 0 0) 0x7f45380035d0 con 0x7f45500cd8b0 2023-11-17T06:30:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f45555ac700 1 -- 172.21.15.100:0/1323345404 >> v1:172.21.15.100:6789/0 conn(0x7f45500cd8b0 legacy=0x7f4550161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f45555ac700 1 -- 172.21.15.100:0/1323345404 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500ce300 con 0x7f455015d2b0 2023-11-17T06:30:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f45555ac700 1 --2- 172.21.15.100:0/1323345404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f455015d2b0 0x7f45500d2520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4548009d90 tx=0x7f454800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76720ce299b9e73 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454800e070 con 0x7f455015d2b0 2023-11-17T06:30:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548003a40 con 0x7f455015d2b0 2023-11-17T06:30:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.152+0000 7f454f7fe700 1 -- 172.21.15.100:0/1323345404 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544001670 con 0x7f455015d2b0 2023-11-17T06:30:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- 172.21.15.100:0/1323345404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f455015d2b0 msgr2=0x7f45500d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 --2- 172.21.15.100:0/1323345404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f455015d2b0 0x7f45500d2520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4548009d90 tx=0x7f454800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- 172.21.15.100:0/1323345404 shutdown_connections 2023-11-17T06:30:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 --2- 172.21.15.100:0/1323345404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f455015d2b0 0x7f45500d2520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- 172.21.15.100:0/1323345404 >> 172.21.15.100:0/1323345404 conn(0x7f455006b370 msgr2=0x7f455006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- 172.21.15.100:0/1323345404 shutdown_connections 2023-11-17T06:30:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- 172.21.15.100:0/1323345404 wait complete. 2023-11-17T06:30:08.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 Processor -- start 2023-11-17T06:30:08.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.156+0000 7f4555dad700 1 -- start start 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f455015ced0 0x7f45501f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45500b35d0 0x7f45500b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b4650 con 0x7f455015d2b0 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b4090 con 0x7f45500b35d0 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b4370 con 0x7f455015ced0 2023-11-17T06:30:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41996/0 (socket says 172.21.15.100:41996) 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4554dab700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f455015ced0 0x7f45501f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 -- 172.21.15.100:0/2357766206 learned_addr learned my addr 172.21.15.100:0/2357766206 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f45555ac700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45500b35d0 0x7f45500b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 -- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f455015ced0 msgr2=0x7f45501f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f455015ced0 0x7f45501f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 -- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45500b35d0 msgr2=0x7f45500b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45500b35d0 0x7f45500b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 -- 172.21.15.100:0/2357766206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009a70 con 0x7f455015d2b0 2023-11-17T06:30:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454ffff700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f454400c500 tx=0x7f454400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544004ca0 con 0x7f455015d2b0 2023-11-17T06:30:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544004e20 con 0x7f455015d2b0 2023-11-17T06:30:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544007310 con 0x7f455015d2b0 2023-11-17T06:30:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500c6d00 con 0x7f455015d2b0 2023-11-17T06:30:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.160+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45501f2a90 con 0x7f455015d2b0 2023-11-17T06:30:08.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.164+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500c7220 con 0x7f455015d2b0 2023-11-17T06:30:08.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.164+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4544007470 con 0x7f455015d2b0 2023-11-17T06:30:08.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.164+0000 7f454d7fa700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 0x7f453c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.164+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4544083aa0 con 0x7f455015d2b0 2023-11-17T06:30:08.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.164+0000 7f4554dab700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 0x7f453c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.168+0000 7f4554dab700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 0x7f453c0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45400011e0 tx=0x7f4540009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.168+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45500c7220 con 0x7f455015d2b0 2023-11-17T06:30:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.348+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45500c7220 con 0x7f455015d2b0 2023-11-17T06:30:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.352+0000 7f454d7fa700 1 -- 172.21.15.100:0/2357766206 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45500c7220 con 0x7f455015d2b0 2023-11-17T06:30:08.354 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 msgr2=0x7f453c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 0x7f453c0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45400011e0 tx=0x7f4540009040 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 msgr2=0x7f45500c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f454400c500 tx=0x7f454400c810 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 shutdown_connections 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45500b35d0 0x7f45500b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f453c066510 0x7f453c0689d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455015d2b0 0x7f45500c7500 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 --2- 172.21.15.100:0/2357766206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f455015ced0 0x7f45501f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 >> 172.21.15.100:0/2357766206 conn(0x7f455006b370 msgr2=0x7f455015c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 shutdown_connections 2023-11-17T06:30:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.356+0000 7f4555dad700 1 -- 172.21.15.100:0/2357766206 wait complete. 2023-11-17T06:30:08.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:08.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.552+0000 7f76d7cba700 1 Processor -- start 2023-11-17T06:30:08.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.552+0000 7f76d7cba700 1 -- start start 2023-11-17T06:30:08.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d7cba700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76d00b0d00 0x7f76d00c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d7cba700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d0165460 con 0x7f76d00ccaf0 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d7cba700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d0165740 con 0x7f76d00cc5a0 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d7cba700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d01660e0 con 0x7f76d00b0d00 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d6257700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f76d00ccaf0 0x7f76d00ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37234/0 (socket says 172.21.15.100:37234) 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d6257700 1 -- 172.21.15.100:0/2128475342 learned_addr learned my addr 172.21.15.100:0/2128475342 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2128475342 >> v2:172.21.15.119:3300/0 conn(0x7f76d00b0d00 0x7f76d00c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d4a54700 1 -- 172.21.15.100:0/2128475342 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624804675 0 0) 0x7f76d0165460 con 0x7f76d00ccaf0 2023-11-17T06:30:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d4a54700 1 -- 172.21.15.100:0/2128475342 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76bc0035d0 con 0x7f76d00ccaf0 2023-11-17T06:30:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d5a56700 1 -- 172.21.15.100:0/2128475342 >> v1:172.21.15.119:6789/0 conn(0x7f76d00cc5a0 legacy=0x7f76d00b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d5a56700 1 -- 172.21.15.100:0/2128475342 >> v1:172.21.15.100:6789/0 conn(0x7f76d00ccaf0 legacy=0x7f76d00ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d5a56700 1 -- 172.21.15.100:0/2128475342 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d0165a20 con 0x7f76d00b0d00 2023-11-17T06:30:08.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.556+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2128475342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00b0d00 0x7f76d00c1f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009850 tx=0x7f76cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc8be542b6db81c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d4a54700 1 -- 172.21.15.100:0/2128475342 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc011830 con 0x7f76d00b0d00 2023-11-17T06:30:08.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d4a54700 1 -- 172.21.15.100:0/2128475342 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc011990 con 0x7f76d00b0d00 2023-11-17T06:30:08.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d4a54700 1 -- 172.21.15.100:0/2128475342 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc011d40 con 0x7f76d00b0d00 2023-11-17T06:30:08.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 -- 172.21.15.100:0/2128475342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00b0d00 msgr2=0x7f76d00c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2128475342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00b0d00 0x7f76d00c1f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009850 tx=0x7f76cc009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 -- 172.21.15.100:0/2128475342 shutdown_connections 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2128475342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00b0d00 0x7f76d00c1f80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 -- 172.21.15.100:0/2128475342 >> 172.21.15.100:0/2128475342 conn(0x7f76d006a450 msgr2=0x7f76d006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 -- 172.21.15.100:0/2128475342 shutdown_connections 2023-11-17T06:30:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.560+0000 7f76d7cba700 1 -- 172.21.15.100:0/2128475342 wait complete. 2023-11-17T06:30:08.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 Processor -- start 2023-11-17T06:30:08.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 -- start start 2023-11-17T06:30:08.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 0x7f76d0161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00ccaf0 0x7f76d0148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0163510 con 0x7f76d00cc5a0 2023-11-17T06:30:08.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d01639a0 con 0x7f76d00ccaf0 2023-11-17T06:30:08.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d7cba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0162900 con 0x7f76d00b0d00 2023-11-17T06:30:08.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41998/0 (socket says 172.21.15.100:41998) 2023-11-17T06:30:08.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 -- 172.21.15.100:0/2286818613 learned_addr learned my addr 172.21.15.100:0/2286818613 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:08.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d6257700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00ccaf0 0x7f76d0148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 0x7f76d0161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 -- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 msgr2=0x7f76d0161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 0x7f76d0161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 -- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00ccaf0 msgr2=0x7f76d0148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00ccaf0 0x7f76d0148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 -- 172.21.15.100:0/2286818613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0094b0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 0x7f76d0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.564+0000 7f76d5255700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76c000c500 tx=0x7f76c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00052d0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d0162be0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c0005430 con 0x7f76d00cc5a0 2023-11-17T06:30:08.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00055a0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d01631a0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d004eea0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.568+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76c00038e0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.572+0000 7f76c67fc700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 0x7f76b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.572+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76c0083330 con 0x7f76d00cc5a0 2023-11-17T06:30:08.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.572+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 0x7f76b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.572+0000 7f76d5a56700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 0x7f76b40689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b1f60 tx=0x7f76cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.580+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76c00507b0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.756+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76d00cec50 con 0x7f76d00cc5a0 2023-11-17T06:30:08.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.756+0000 7f76c67fc700 1 -- 172.21.15.100:0/2286818613 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76c0053dd0 con 0x7f76d00cc5a0 2023-11-17T06:30:08.762 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:08.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 msgr2=0x7f76b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 0x7f76b40689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b1f60 tx=0x7f76cc008030 comp rx=0 tx=0).stop 2023-11-17T06:30:08.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 msgr2=0x7f76d00c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76c000c500 tx=0x7f76c000c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 shutdown_connections 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d00ccaf0 0x7f76d0148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76b4066510 0x7f76b40689d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d00cc5a0 0x7f76d00c2c30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 --2- 172.21.15.100:0/2286818613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d00b0d00 0x7f76d0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 >> 172.21.15.100:0/2286818613 conn(0x7f76d006a450 msgr2=0x7f76d006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 shutdown_connections 2023-11-17T06:30:08.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.760+0000 7f76d7cba700 1 -- 172.21.15.100:0/2286818613 wait complete. 2023-11-17T06:30:08.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:08.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.948+0000 7f97e36a8700 1 Processor -- start 2023-11-17T06:30:08.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 -- start start 2023-11-17T06:30:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97dc0b1150 0x7f97dc0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc0cf8a0 0x7f97dc15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc070ad0 con 0x7f97dc15b0a0 2023-11-17T06:30:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc071f20 con 0x7f97dc0b1150 2023-11-17T06:30:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e36a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0721a0 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97dc0b1150 0x7f97dc0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e1c45700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc0cf8a0 0x7f97dc15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97dc0b1150 0x7f97dc0cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42010/0 (socket says 172.21.15.100:42010) 2023-11-17T06:30:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 -- 172.21.15.100:0/1730337099 learned_addr learned my addr 172.21.15.100:0/1730337099 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e1444700 1 --1- 172.21.15.100:0/1730337099 >> v1:172.21.15.119:6789/0 conn(0x7f97dc15b0a0 0x7f97dc0b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:60736/0 (socket says 172.21.15.100:60736) 2023-11-17T06:30:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 -- 172.21.15.100:0/1730337099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc0cf8a0 msgr2=0x7f97dc15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 --2- 172.21.15.100:0/1730337099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc0cf8a0 0x7f97dc15ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97e0c43700 1 -- 172.21.15.100:0/1730337099 >> v1:172.21.15.119:6789/0 conn(0x7f97dc15b0a0 legacy=0x7f97dc0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.952+0000 7f97d3fff700 1 -- 172.21.15.100:0/1730337099 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436908921 0 0) 0x7f97dc070ad0 con 0x7f97dc15b0a0 2023-11-17T06:30:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e0c43700 1 -- 172.21.15.100:0/1730337099 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc072480 con 0x7f97dc0b1150 2023-11-17T06:30:08.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e0c43700 1 --2- 172.21.15.100:0/1730337099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0b1150 0x7f97dc0cb3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009910 tx=0x7f97cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a571f92c2576419d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97d3fff700 1 -- 172.21.15.100:0/1730337099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc011830 con 0x7f97dc0b1150 2023-11-17T06:30:08.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97d3fff700 1 -- 172.21.15.100:0/1730337099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc011990 con 0x7f97dc0b1150 2023-11-17T06:30:08.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97d3fff700 1 -- 172.21.15.100:0/1730337099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc011d40 con 0x7f97dc0b1150 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 -- 172.21.15.100:0/1730337099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0b1150 msgr2=0x7f97dc0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1730337099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0b1150 0x7f97dc0cb3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009910 tx=0x7f97cc009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 -- 172.21.15.100:0/1730337099 shutdown_connections 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1730337099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc0cf8a0 0x7f97dc15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1730337099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0b1150 0x7f97dc0cb3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 -- 172.21.15.100:0/1730337099 >> 172.21.15.100:0/1730337099 conn(0x7f97dc06a270 msgr2=0x7f97dc06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 -- 172.21.15.100:0/1730337099 shutdown_connections 2023-11-17T06:30:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.956+0000 7f97e36a8700 1 -- 172.21.15.100:0/1730337099 wait complete. 2023-11-17T06:30:08.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 Processor -- start 2023-11-17T06:30:08.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 -- start start 2023-11-17T06:30:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97dc0b1150 0x7f97dc1f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc15b0a0 0x7f97dc0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc157b80 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0c6bb0 con 0x7f97dc0b1150 2023-11-17T06:30:08.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e36a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1578a0 con 0x7f97dc15b0a0 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42022/0 (socket says 172.21.15.100:42022) 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 -- 172.21.15.100:0/1850775020 learned_addr learned my addr 172.21.15.100:0/1850775020 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e1444700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97dc0b1150 0x7f97dc1f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e1c45700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc15b0a0 0x7f97dc0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 -- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc15b0a0 msgr2=0x7f97dc0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc15b0a0 0x7f97dc0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 -- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97dc0b1150 msgr2=0x7f97dc1f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97dc0b1150 0x7f97dc1f0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 -- 172.21.15.100:0/1850775020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009570 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97e0c43700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009f70 tx=0x7f97cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc004300 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc01f070 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.960+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0036c0 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.964+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc0c6560 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.964+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1f0890 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.964+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0c63c0 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.964+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f97cc021030 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.968+0000 7f97d1ffb700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 0x7f97c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.968+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97cc085130 con 0x7f97dc0cf8a0 2023-11-17T06:30:08.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.968+0000 7f97e1444700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 0x7f97c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.968+0000 7f97e1444700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 0x7f97c00689d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97d8000f60 tx=0x7f97d8007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:08.972+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97dc0c63c0 con 0x7f97dc0cf8a0 2023-11-17T06:30:09.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.148+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97dc0c63c0 con 0x7f97dc0cf8a0 2023-11-17T06:30:09.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.152+0000 7f97d1ffb700 1 -- 172.21.15.100:0/1850775020 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f97dc0c63c0 con 0x7f97dc0cf8a0 2023-11-17T06:30:09.156 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:09.156 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 msgr2=0x7f97c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 0x7f97c00689d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97d8000f60 tx=0x7f97d8007e90 comp rx=0 tx=0).stop 2023-11-17T06:30:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 msgr2=0x7f97dc0c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009f70 tx=0x7f97cc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 shutdown_connections 2023-11-17T06:30:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97dc15b0a0 0x7f97dc0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f97c0066510 0x7f97c00689d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc0cf8a0 0x7f97dc0c8d20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 --2- 172.21.15.100:0/1850775020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97dc0b1150 0x7f97dc1f0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 >> 172.21.15.100:0/1850775020 conn(0x7f97dc06a270 msgr2=0x7f97dc0c56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 shutdown_connections 2023-11-17T06:30:09.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.156+0000 7f97e36a8700 1 -- 172.21.15.100:0/1850775020 wait complete. 2023-11-17T06:30:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:09.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:09.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.356+0000 7f7cf9bad700 1 Processor -- start 2023-11-17T06:30:09.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 -- start start 2023-11-17T06:30:09.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 0x7f7cf40ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cf4160d90 0x7f7cf40cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40cfa40 con 0x7f7cf40cf610 2023-11-17T06:30:09.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40ae580 con 0x7f7cf415d2a0 2023-11-17T06:30:09.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf9bad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf415d680 con 0x7f7cf4160d90 2023-11-17T06:30:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf8bab700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 0x7f7cf40ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf8bab700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 0x7f7cf40ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42026/0 (socket says 172.21.15.100:42026) 2023-11-17T06:30:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cf8bab700 1 -- 172.21.15.100:0/3646441807 learned_addr learned my addr 172.21.15.100:0/3646441807 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.360+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3646441807 >> v2:172.21.15.119:3300/0 conn(0x7f7cf4160d90 0x7f7cf40cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cebfff700 1 -- 172.21.15.100:0/3646441807 >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 msgr2=0x7f7cf40ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3646441807 >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 0x7f7cf40ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cebfff700 1 -- 172.21.15.100:0/3646441807 >> v1:172.21.15.119:6789/0 conn(0x7f7cf40cf610 legacy=0x7f7cf40ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cebfff700 1 -- 172.21.15.100:0/3646441807 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf406cfb0 con 0x7f7cf4160d90 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3646441807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4160d90 0x7f7cf40cf0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40cfbd0 tx=0x7f7ce4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a5f683011e6633b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7ceb7fe700 1 -- 172.21.15.100:0/3646441807 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004020 con 0x7f7cf4160d90 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7ceb7fe700 1 -- 172.21.15.100:0/3646441807 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4004180 con 0x7f7cf4160d90 2023-11-17T06:30:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7ceb7fe700 1 -- 172.21.15.100:0/3646441807 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004530 con 0x7f7cf4160d90 2023-11-17T06:30:09.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3646441807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4160d90 msgr2=0x7f7cf40cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3646441807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4160d90 0x7f7cf40cf0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40cfbd0 tx=0x7f7ce4009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3646441807 shutdown_connections 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3646441807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4160d90 0x7f7cf40cf0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3646441807 >> v2:172.21.15.100:3300/0 conn(0x7f7cf415d2a0 0x7f7cf40ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3646441807 >> 172.21.15.100:0/3646441807 conn(0x7f7cf406a690 msgr2=0x7f7cf406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3646441807 shutdown_connections 2023-11-17T06:30:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.364+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3646441807 wait complete. 2023-11-17T06:30:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 Processor -- start 2023-11-17T06:30:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 -- start start 2023-11-17T06:30:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cf415d2a0 0x7f7cf40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 0x7f7cf415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4149af0 con 0x7f7cf40cf610 2023-11-17T06:30:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4149dd0 con 0x7f7cf40c2a10 2023-11-17T06:30:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.368+0000 7f7cf9bad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf414a0b0 con 0x7f7cf415d2a0 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42028/0 (socket says 172.21.15.100:42028) 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 -- 172.21.15.100:0/3003967979 learned_addr learned my addr 172.21.15.100:0/3003967979 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cf415d2a0 0x7f7cf40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf93ac700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 0x7f7cf415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 -- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cf415d2a0 msgr2=0x7f7cf40c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cf415d2a0 0x7f7cf40c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 -- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 msgr2=0x7f7cf415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 0x7f7cf415fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 -- 172.21.15.100:0/3003967979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40094b0 con 0x7f7cf40cf610 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf93ac700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 0x7f7cf415fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf8bab700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000e930 tx=0x7f7cf000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00096c0 con 0x7f7cf40cf610 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000c850 con 0x7f7cf40cf610 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf414a390 con 0x7f7cf40cf610 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000cc00 con 0x7f7cf40cf610 2023-11-17T06:30:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf4149710 con 0x7f7cf40cf610 2023-11-17T06:30:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.372+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4067e10 con 0x7f7cf40cf610 2023-11-17T06:30:09.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.376+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7cf000cd60 con 0x7f7cf40cf610 2023-11-17T06:30:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.376+0000 7f7ce97fa700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 0x7f7ce0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.376+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cf0083e00 con 0x7f7cf40cf610 2023-11-17T06:30:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.376+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 0x7f7ce0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.376+0000 7f7cebfff700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 0x7f7ce0068a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4000c00 tx=0x7f7ce4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.384+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7cf0051310 con 0x7f7cf40cf610 2023-11-17T06:30:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.556+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cf4065e90 con 0x7f7cf40cf610 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.556+0000 7f7ce97fa700 1 -- 172.21.15.100:0/3003967979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cf0059e60 con 0x7f7cf40cf610 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 msgr2=0x7f7ce0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 0x7f7ce0068a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4000c00 tx=0x7f7ce4008030 comp rx=0 tx=0).stop 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 msgr2=0x7f7cf4149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000e930 tx=0x7f7cf000ecf0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 shutdown_connections 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf40c2a10 0x7f7cf415fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cf415d2a0 0x7f7cf40c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7ce0066540 0x7f7ce0068a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 --2- 172.21.15.100:0/3003967979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40cf610 0x7f7cf4149040 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 >> 172.21.15.100:0/3003967979 conn(0x7f7cf406a690 msgr2=0x7f7cf40b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 shutdown_connections 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:09.560+0000 7f7cf9bad700 1 -- 172.21.15.100:0/3003967979 wait complete. 2023-11-17T06:30:14.468 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:14.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.659+0000 7f315dbad700 1 Processor -- start 2023-11-17T06:30:14.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.659+0000 7f315dbad700 1 -- start start 2023-11-17T06:30:14.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315dbad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f315815ced0 0x7f31580d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315dbad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31580cd8b0 0x7f3158161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315dbad700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158160ce0 con 0x7f315815d2b0 2023-11-17T06:30:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315dbad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580cdd40 con 0x7f315815ced0 2023-11-17T06:30:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315dbad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580ce020 con 0x7f31580cd8b0 2023-11-17T06:30:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315d3ac700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f315815d2b0 0x7f31580d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58444/0 (socket says 172.21.15.100:58444) 2023-11-17T06:30:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315d3ac700 1 -- 172.21.15.100:0/1194261417 learned_addr learned my addr 172.21.15.100:0/1194261417 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 --2- 172.21.15.100:0/1194261417 >> v2:172.21.15.119:3300/0 conn(0x7f315815ced0 0x7f31580d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f3157fff700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31580cd8b0 0x7f3158161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 -- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31580cd8b0 msgr2=0x7f3158161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31580cd8b0 0x7f3158161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f31577fe700 1 -- 172.21.15.100:0/1194261417 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155067535 0 0) 0x7f3158160ce0 con 0x7f315815d2b0 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 -- 172.21.15.100:0/1194261417 >> v1:172.21.15.100:6789/0 conn(0x7f315815d2b0 legacy=0x7f31580d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 -- 172.21.15.100:0/1194261417 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580ce300 con 0x7f315815ced0 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f315cbab700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815ced0 0x7f31580d0fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f314c009880 tx=0x7f314c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d88cfcc0be21690 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.663+0000 7f31577fe700 1 -- 172.21.15.100:0/1194261417 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c011830 con 0x7f315815ced0 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f31577fe700 1 -- 172.21.15.100:0/1194261417 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c011990 con 0x7f315815ced0 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f31577fe700 1 -- 172.21.15.100:0/1194261417 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c011d20 con 0x7f315815ced0 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815ced0 msgr2=0x7f31580d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815ced0 0x7f31580d0fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f314c009880 tx=0x7f314c009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- 172.21.15.100:0/1194261417 shutdown_connections 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31580cd8b0 0x7f3158161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 --2- 172.21.15.100:0/1194261417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815ced0 0x7f31580d0fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- 172.21.15.100:0/1194261417 >> 172.21.15.100:0/1194261417 conn(0x7f315806b370 msgr2=0x7f315806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- 172.21.15.100:0/1194261417 shutdown_connections 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- 172.21.15.100:0/1194261417 wait complete. 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 Processor -- start 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.667+0000 7f315dbad700 1 -- start start 2023-11-17T06:30:14.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 0x7f31580cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 0x7f31580b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b6b60 con 0x7f31580b6170 2023-11-17T06:30:14.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b3a00 con 0x7f315815d2b0 2023-11-17T06:30:14.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b3c80 con 0x7f315815ced0 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44360/0 (socket says 172.21.15.100:44360) 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 -- 172.21.15.100:0/3058642293 learned_addr learned my addr 172.21.15.100:0/3058642293 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f3157fff700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 0x7f31580b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315cbab700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 0x7f31580cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 -- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 msgr2=0x7f31580cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 0x7f31580cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 -- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 msgr2=0x7f31580b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 0x7f31580b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 -- 172.21.15.100:0/3058642293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0094b0 con 0x7f31580b6170 2023-11-17T06:30:14.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f3157fff700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 0x7f31580b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:14.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315cbab700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 0x7f31580cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:14.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315d3ac700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f315000cca0 tx=0x7f315000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000aad0 con 0x7f31580b6170 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000ac50 con 0x7f31580b6170 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580b3f60 con 0x7f31580b6170 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500070d0 con 0x7f31580b6170 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.671+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580b4520 con 0x7f31580b6170 2023-11-17T06:30:14.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.675+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3158065e90 con 0x7f31580b6170 2023-11-17T06:30:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.675+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3150007230 con 0x7f31580b6170 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.679+0000 7f31557fa700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 0x7f313c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.679+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3150083c60 con 0x7f31580b6170 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.679+0000 7f315cbab700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 0x7f313c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.679+0000 7f315cbab700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 0x7f313c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f314c0090b0 tx=0x7f314c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.683+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3150051040 con 0x7f31580b6170 2023-11-17T06:30:14.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.859+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31580b8c90 con 0x7f31580b6170 2023-11-17T06:30:14.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.859+0000 7f31557fa700 1 -- 172.21.15.100:0/3058642293 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3150018020 con 0x7f31580b6170 2023-11-17T06:30:14.864 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 msgr2=0x7f313c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 0x7f313c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f314c0090b0 tx=0x7f314c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 msgr2=0x7f31580b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f315000cca0 tx=0x7f315000a060 comp rx=0 tx=0).stop 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 shutdown_connections 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f313c066510 0x7f313c0689d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31580b6170 0x7f31580b6620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315815d2b0 0x7f31580b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 --2- 172.21.15.100:0/3058642293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f315815ced0 0x7f31580cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 >> 172.21.15.100:0/3058642293 conn(0x7f315806b370 msgr2=0x7f315815d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 shutdown_connections 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:14.863+0000 7f315dbad700 1 -- 172.21.15.100:0/3058642293 wait complete. 2023-11-17T06:30:14.887 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.071+0000 7f5d7759e700 1 Processor -- start 2023-11-17T06:30:15.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.071+0000 7f5d7759e700 1 -- start start 2023-11-17T06:30:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7759e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d780d16f0 0x7f5d780d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780d2090 con 0x7f5d780cdc00 2023-11-17T06:30:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7759e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780b2940 con 0x7f5d780d16f0 2023-11-17T06:30:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780cedb0 con 0x7f5d78160a80 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d780d16f0 0x7f5d780d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d780d16f0 0x7f5d780d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44374/0 (socket says 172.21.15.100:44374) 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 -- 172.21.15.100:0/725052030 learned_addr learned my addr 172.21.15.100:0/725052030 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7659c700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 -- 172.21.15.100:0/725052030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 msgr2=0x7f5d780d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780d3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 -- 172.21.15.100:0/725052030 >> v1:172.21.15.119:6789/0 conn(0x7f5d780cdc00 legacy=0x7f5d780ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 -- 172.21.15.100:0/725052030 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780cf090 con 0x7f5d780d16f0 2023-11-17T06:30:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780d16f0 0x7f5d780d1b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009910 tx=0x7f5d6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9fdd2e94655b9a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.075+0000 7f5d7559a700 1 -- 172.21.15.100:0/725052030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011830 con 0x7f5d780d16f0 2023-11-17T06:30:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7559a700 1 -- 172.21.15.100:0/725052030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c011990 con 0x7f5d780d16f0 2023-11-17T06:30:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7559a700 1 -- 172.21.15.100:0/725052030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011d40 con 0x7f5d780d16f0 2023-11-17T06:30:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- 172.21.15.100:0/725052030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780d16f0 msgr2=0x7f5d780d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780d16f0 0x7f5d780d1b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009910 tx=0x7f5d6c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- 172.21.15.100:0/725052030 shutdown_connections 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780d16f0 0x7f5d780d1b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 --2- 172.21.15.100:0/725052030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- 172.21.15.100:0/725052030 >> 172.21.15.100:0/725052030 conn(0x7f5d7809c420 msgr2=0x7f5d780d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- 172.21.15.100:0/725052030 shutdown_connections 2023-11-17T06:30:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- 172.21.15.100:0/725052030 wait complete. 2023-11-17T06:30:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 Processor -- start 2023-11-17T06:30:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.079+0000 7f5d7759e700 1 -- start start 2023-11-17T06:30:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 0x7f5d780ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781e6b30 con 0x7f5d780cdc00 2023-11-17T06:30:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781e6e10 con 0x7f5d780d16f0 2023-11-17T06:30:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781e70f0 con 0x7f5d78160a80 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44376/0 (socket says 172.21.15.100:44376) 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 -- 172.21.15.100:0/4157238433 learned_addr learned my addr 172.21.15.100:0/4157238433 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d76d9d700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 0x7f5d780ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 -- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 msgr2=0x7f5d780cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 -- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 msgr2=0x7f5d780ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 0x7f5d780ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 -- 172.21.15.100:0/4157238433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009570 con 0x7f5d780cdc00 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 0x7f5d780ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7659c700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800e9d0 tx=0x7f5d6800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68009720 con 0x7f5d780cdc00 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800c850 con 0x7f5d780cdc00 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800cbc0 con 0x7f5d780cdc00 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d781e73d0 con 0x7f5d780cdc00 2023-11-17T06:30:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.083+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d780c94b0 con 0x7f5d780cdc00 2023-11-17T06:30:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.087+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d781e7560 con 0x7f5d780cdc00 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.087+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5d6800cd20 con 0x7f5d780cdc00 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.087+0000 7f5d66ffd700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 0x7f5d580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.087+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d68083f20 con 0x7f5d780cdc00 2023-11-17T06:30:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.087+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 0x7f5d580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.091+0000 7f5d75d9b700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 0x7f5d580689d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c014040 tx=0x7f5d6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.095+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d68051430 con 0x7f5d780cdc00 2023-11-17T06:30:15.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.267+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d781e6c70 con 0x7f5d780cdc00 2023-11-17T06:30:15.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.267+0000 7f5d66ffd700 1 -- 172.21.15.100:0/4157238433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d68017020 con 0x7f5d780cdc00 2023-11-17T06:30:15.273 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 msgr2=0x7f5d580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 0x7f5d580689d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c014040 tx=0x7f5d6c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 msgr2=0x7f5d781e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800e9d0 tx=0x7f5d6800ed90 comp rx=0 tx=0).stop 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 shutdown_connections 2023-11-17T06:30:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d78160a80 0x7f5d780cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d780d16f0 0x7f5d780ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5d58066510 0x7f5d580689d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 --2- 172.21.15.100:0/4157238433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d780cdc00 0x7f5d781e62e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 >> 172.21.15.100:0/4157238433 conn(0x7f5d7809c420 msgr2=0x7f5d7806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 shutdown_connections 2023-11-17T06:30:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.271+0000 7f5d7759e700 1 -- 172.21.15.100:0/4157238433 wait complete. 2023-11-17T06:30:15.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 Processor -- start 2023-11-17T06:30:15.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 -- start start 2023-11-17T06:30:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f40cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03f40b1150 0x7f03f415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f4070ad0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4071f20 con 0x7f03f40b1150 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.475+0000 7f03f9c0f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40cfd00 con 0x7f03f415b0a0 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03ebfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f03f40cf8a0 0x7f03f40b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58448/0 (socket says 172.21.15.100:58448) 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03ebfff700 1 -- 172.21.15.100:0/2709773594 learned_addr learned my addr 172.21.15.100:0/2709773594 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f3fff700 1 --2- 172.21.15.100:0/2709773594 >> v2:172.21.15.119:3300/0 conn(0x7f03f40b1150 0x7f03f415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 --2- 172.21.15.100:0/2709773594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f40cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f2ffd700 1 -- 172.21.15.100:0/2709773594 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649333381 0 0) 0x7f03f4070ad0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f2ffd700 1 -- 172.21.15.100:0/2709773594 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e00035d0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 -- 172.21.15.100:0/2709773594 >> v2:172.21.15.119:3300/0 conn(0x7f03f40b1150 msgr2=0x7f03f415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 --2- 172.21.15.100:0/2709773594 >> v2:172.21.15.119:3300/0 conn(0x7f03f40b1150 0x7f03f415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 -- 172.21.15.100:0/2709773594 >> v1:172.21.15.100:6789/0 conn(0x7f03f40cf8a0 legacy=0x7f03f40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 -- 172.21.15.100:0/2709773594 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40721a0 con 0x7f03f415b0a0 2023-11-17T06:30:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f37fe700 1 --2- 172.21.15.100:0/2709773594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f40cb3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009850 tx=0x7f03e4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd68d0aa8316f3f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f2ffd700 1 -- 172.21.15.100:0/2709773594 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011830 con 0x7f03f415b0a0 2023-11-17T06:30:15.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f2ffd700 1 -- 172.21.15.100:0/2709773594 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4011990 con 0x7f03f415b0a0 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f2ffd700 1 -- 172.21.15.100:0/2709773594 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011d40 con 0x7f03f415b0a0 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f9c0f700 1 -- 172.21.15.100:0/2709773594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 msgr2=0x7f03f40cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.479+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/2709773594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f40cb3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009850 tx=0x7f03e4009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 -- 172.21.15.100:0/2709773594 shutdown_connections 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/2709773594 >> v2:172.21.15.119:3300/0 conn(0x7f03f40b1150 0x7f03f415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/2709773594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f40cb3c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 -- 172.21.15.100:0/2709773594 >> 172.21.15.100:0/2709773594 conn(0x7f03f406a270 msgr2=0x7f03f406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 -- 172.21.15.100:0/2709773594 shutdown_connections 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 -- 172.21.15.100:0/2709773594 wait complete. 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 Processor -- start 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.483+0000 7f03f9c0f700 1 -- start start 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40b1150 0x7f03f41e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4155a30 con 0x7f03f40cf8a0 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4157160 con 0x7f03f40b1150 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4157440 con 0x7f03f415b0a0 2023-11-17T06:30:15.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40b1150 0x7f03f41e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44392/0 (socket says 172.21.15.100:44392) 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 -- 172.21.15.100:0/126170065 learned_addr learned my addr 172.21.15.100:0/126170065 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f3fff700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 -- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 msgr2=0x7f03f41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f41545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 -- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40b1150 msgr2=0x7f03f41e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40b1150 0x7f03f41e77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 -- 172.21.15.100:0/126170065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40094b0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03ebfff700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c700 tx=0x7f03dc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc005d90 con 0x7f03f40cf8a0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc0070d0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007480 con 0x7f03f40cf8a0 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f4157720 con 0x7f03f40cf8a0 2023-11-17T06:30:15.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.487+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f41f3d30 con 0x7f03f40cf8a0 2023-11-17T06:30:15.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.491+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f41f3f50 con 0x7f03f40cf8a0 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.491+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03dc0075e0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.495+0000 7f03f0ff9700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 0x7f03d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.495+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03dc083260 con 0x7f03f40cf8a0 2023-11-17T06:30:15.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.495+0000 7f03f37fe700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 0x7f03d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.495+0000 7f03f37fe700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 0x7f03d40689d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f03e40090b0 tx=0x7f03e401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.499+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03dc0506d0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.681 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.675+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03f404eea0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.679+0000 7f03f0ff9700 1 -- 172.21.15.100:0/126170065 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f03dc053cf0 con 0x7f03f40cf8a0 2023-11-17T06:30:15.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:15.685 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 msgr2=0x7f03d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 0x7f03d40689d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f03e40090b0 tx=0x7f03e401c040 comp rx=0 tx=0).stop 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 msgr2=0x7f03f40b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c700 tx=0x7f03dc00ca10 comp rx=0 tx=0).stop 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 shutdown_connections 2023-11-17T06:30:15.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415b0a0 0x7f03f41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f03d4066510 0x7f03d40689d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f40cf8a0 0x7f03f40b2e40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 --2- 172.21.15.100:0/126170065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40b1150 0x7f03f41e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 >> 172.21.15.100:0/126170065 conn(0x7f03f406a270 msgr2=0x7f03f40b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 shutdown_connections 2023-11-17T06:30:15.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.683+0000 7f03f9c0f700 1 -- 172.21.15.100:0/126170065 wait complete. 2023-11-17T06:30:15.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:15.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:15.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.895+0000 7f05f2cda700 1 Processor -- start 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 -- start start 2023-11-17T06:30:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec0b4db0 0x7f05ec06b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05ec06a270 0x7f05ec06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 0x7f05ec15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec15d7a0 con 0x7f05ec06a270 2023-11-17T06:30:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0cbdf0 con 0x7f05ec15dc30 2023-11-17T06:30:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.899+0000 7f05f2cda700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cb550 con 0x7f05ec0b4db0 2023-11-17T06:30:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05ec06a270 0x7f05ec06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f1cd8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec0b4db0 0x7f05ec06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f24d9700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 0x7f05ec15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05ec06a270 0x7f05ec06a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44396/0 (socket says 172.21.15.100:44396) 2023-11-17T06:30:15.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 -- 172.21.15.100:0/2840603758 learned_addr learned my addr 172.21.15.100:0/2840603758 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 -- 172.21.15.100:0/2840603758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec0b4db0 msgr2=0x7f05ec06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 --2- 172.21.15.100:0/2840603758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec0b4db0 0x7f05ec06b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 -- 172.21.15.100:0/2840603758 >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 msgr2=0x7f05ec15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 --2- 172.21.15.100:0/2840603758 >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 0x7f05ec15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 -- 172.21.15.100:0/2840603758 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0cb830 con 0x7f05ec06a270 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f24d9700 1 --2- 172.21.15.100:0/2840603758 >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 0x7f05ec15e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f14d7700 1 --2- 172.21.15.100:0/2840603758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec06a270 0x7f05ec06a6f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0739f0 tx=0x7f05dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6194ec646a052d3e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f0cd6700 1 -- 172.21.15.100:0/2840603758 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc011830 con 0x7f05ec06a270 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f0cd6700 1 -- 172.21.15.100:0/2840603758 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc011990 con 0x7f05ec06a270 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f0cd6700 1 -- 172.21.15.100:0/2840603758 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc011d20 con 0x7f05ec06a270 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f2cda700 1 -- 172.21.15.100:0/2840603758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec06a270 msgr2=0x7f05ec06a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.903+0000 7f05f2cda700 1 --2- 172.21.15.100:0/2840603758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec06a270 0x7f05ec06a6f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0739f0 tx=0x7f05dc009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- 172.21.15.100:0/2840603758 shutdown_connections 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- 172.21.15.100:0/2840603758 >> v2:172.21.15.119:3300/0 conn(0x7f05ec15dc30 0x7f05ec15e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- 172.21.15.100:0/2840603758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec06a270 0x7f05ec06a6f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- 172.21.15.100:0/2840603758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec0b4db0 0x7f05ec06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- 172.21.15.100:0/2840603758 >> 172.21.15.100:0/2840603758 conn(0x7f05ec0cf540 msgr2=0x7f05ec0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- 172.21.15.100:0/2840603758 shutdown_connections 2023-11-17T06:30:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- 172.21.15.100:0/2840603758 wait complete. 2023-11-17T06:30:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 Processor -- start 2023-11-17T06:30:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- start start 2023-11-17T06:30:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05ec06a270 0x7f05ec155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 0x7f05ec146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cdbc0 con 0x7f05ec0b4db0 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cd010 con 0x7f05ec06a270 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f2cda700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cd220 con 0x7f05ec15dc30 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f14d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f14d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44406/0 (socket says 172.21.15.100:44406) 2023-11-17T06:30:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.907+0000 7f05f14d7700 1 -- 172.21.15.100:0/1127850313 learned_addr learned my addr 172.21.15.100:0/1127850313 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f1cd8700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05ec06a270 0x7f05ec155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f24d9700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 0x7f05ec146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 -- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 msgr2=0x7f05ec146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 0x7f05ec146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 -- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05ec06a270 msgr2=0x7f05ec155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05ec06a270 0x7f05ec155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 -- 172.21.15.100:0/1127850313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4009a70 con 0x7f05ec0b4db0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f24d9700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 0x7f05ec146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f14d7700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0d03e0 tx=0x7f05dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0044d0 con 0x7f05ec0b4db0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc01f070 con 0x7f05ec0b4db0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc003900 con 0x7f05ec0b4db0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc009570 con 0x7f05ec0b4db0 2023-11-17T06:30:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec0cd7e0 con 0x7f05ec0b4db0 2023-11-17T06:30:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec0cdd00 con 0x7f05ec0b4db0 2023-11-17T06:30:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.911+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05dc003a60 con 0x7f05ec0b4db0 2023-11-17T06:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.915+0000 7f05e27fc700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 0x7f05d00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.915+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05dc021070 con 0x7f05ec0b4db0 2023-11-17T06:30:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.915+0000 7f05f1cd8700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 0x7f05d00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.915+0000 7f05f1cd8700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 0x7f05d00689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0b3240 tx=0x7f05e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:15.919+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05dc0b6090 con 0x7f05ec0b4db0 2023-11-17T06:30:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.095+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05ec065e90 con 0x7f05ec0b4db0 2023-11-17T06:30:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.095+0000 7f05e27fc700 1 -- 172.21.15.100:0/1127850313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05ec0cdd00 con 0x7f05ec0b4db0 2023-11-17T06:30:16.100 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 msgr2=0x7f05d00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 0x7f05d00689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0b3240 tx=0x7f05e8008040 comp rx=0 tx=0).stop 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 msgr2=0x7f05ec156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0d03e0 tx=0x7f05dc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 shutdown_connections 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05ec15dc30 0x7f05ec146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f05d0066510 0x7f05d00689d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05ec0b4db0 0x7f05ec156500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 --2- 172.21.15.100:0/1127850313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05ec06a270 0x7f05ec155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 >> 172.21.15.100:0/1127850313 conn(0x7f05ec0cf540 msgr2=0x7f05ec0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 shutdown_connections 2023-11-17T06:30:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.099+0000 7f05f2cda700 1 -- 172.21.15.100:0/1127850313 wait complete. 2023-11-17T06:30:16.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 Processor -- start 2023-11-17T06:30:16.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 -- start start 2023-11-17T06:30:16.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf540cd390 0x7fdf540ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf540cae40 0x7fdf540cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5415a950 con 0x7fdf540c5970 2023-11-17T06:30:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5415ac30 con 0x7fdf540cae40 2023-11-17T06:30:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.307+0000 7fdf5b97f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5415af10 con 0x7fdf540cd390 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf5971b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdf540c5970 0x7fdf540c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58460/0 (socket says 172.21.15.100:58460) 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf5971b700 1 -- 172.21.15.100:0/3701412615 learned_addr learned my addr 172.21.15.100:0/3701412615 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf59f1c700 1 --2- 172.21.15.100:0/3701412615 >> v2:172.21.15.100:3300/0 conn(0x7fdf540cae40 0x7fdf540cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/3701412615 >> v2:172.21.15.119:3300/0 conn(0x7fdf540cd390 0x7fdf540ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798230674 0 0) 0x7fdf5415a950 con 0x7fdf540c5970 2023-11-17T06:30:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf400035d0 con 0x7fdf540c5970 2023-11-17T06:30:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018514250 0 0) 0x7fdf400035d0 con 0x7fdf540c5970 2023-11-17T06:30:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 >> v2:172.21.15.119:3300/0 conn(0x7fdf540cd390 msgr2=0x7fdf540ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 --2- 172.21.15.100:0/3701412615 >> v2:172.21.15.119:3300/0 conn(0x7fdf540cd390 0x7fdf540ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 >> v2:172.21.15.100:3300/0 conn(0x7fdf540cae40 msgr2=0x7fdf540cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 --2- 172.21.15.100:0/3701412615 >> v2:172.21.15.100:3300/0 conn(0x7fdf540cae40 0x7fdf540cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5415b1f0 con 0x7fdf540c5970 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7fdf50001670 con 0x7fdf540c5970 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 >> v1:172.21.15.100:6789/0 conn(0x7fdf540c5970 legacy=0x7fdf540c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40003a20 0x7fdf40003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 0x7fdf40004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40005230 0x7fdf4000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5415ac30 con 0x7fdf40004870 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5415af10 con 0x7fdf40003a20 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4000bfc0 con 0x7fdf40005230 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf59f1c700 1 --2- 172.21.15.100:0/3701412615 >> v2:172.21.15.100:3300/0 conn(0x7fdf540cae40 0x7fdf540cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 0x7fdf40004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf5971b700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40003a20 0x7fdf40003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 -- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40005230 msgr2=0x7fdf4000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40005230 0x7fdf4000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 -- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40003a20 msgr2=0x7fdf40003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40003a20 0x7fdf40003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 -- 172.21.15.100:0/3701412615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400035d0 con 0x7fdf40004870 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf59f1c700 1 -- 172.21.15.100:0/3701412615 reap_dead start 2023-11-17T06:30:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf5971b700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40003a20 0x7fdf40003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 0x7fdf40004cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009b70 tx=0x7fdf400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c414920934c6bc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.311+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400e640 con 0x7fdf40004870 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4400e7a0 con 0x7fdf40004870 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf4bfff700 1 -- 172.21.15.100:0/3701412615 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400eb30 con 0x7fdf40004870 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 -- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 msgr2=0x7fdf40004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 0x7fdf40004cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009b70 tx=0x7fdf400058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 -- 172.21.15.100:0/3701412615 shutdown_connections 2023-11-17T06:30:16.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/3701412615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf40004870 0x7fdf40004cf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 -- 172.21.15.100:0/3701412615 >> 172.21.15.100:0/3701412615 conn(0x7fdf5406df00 msgr2=0x7fdf5406e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 -- 172.21.15.100:0/3701412615 shutdown_connections 2023-11-17T06:30:16.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.315+0000 7fdf5b97f700 1 -- 172.21.15.100:0/3701412615 wait complete. 2023-11-17T06:30:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 Processor -- start 2023-11-17T06:30:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 -- start start 2023-11-17T06:30:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40004870 0x7fdf54152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf541f19e0 0x7fdf5414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5414d8c0 con 0x7fdf5414ac40 2023-11-17T06:30:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540b3cd0 con 0x7fdf541f19e0 2023-11-17T06:30:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5b97f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5414b0c0 con 0x7fdf40004870 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44432/0 (socket says 172.21.15.100:44432) 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 -- 172.21.15.100:0/428971989 learned_addr learned my addr 172.21.15.100:0/428971989 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf5971b700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40004870 0x7fdf54152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf58f1a700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf541f19e0 0x7fdf5414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 -- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40004870 msgr2=0x7fdf54152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40004870 0x7fdf54152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 -- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf541f19e0 msgr2=0x7fdf5414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf541f19e0 0x7fdf5414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.319+0000 7fdf59f1c700 1 -- 172.21.15.100:0/428971989 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf540b3ee0 con 0x7fdf5414ac40 2023-11-17T06:30:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf59f1c700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf540c6db0 tx=0x7fdf4c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c010040 con 0x7fdf5414ac40 2023-11-17T06:30:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c003c40 con 0x7fdf5414ac40 2023-11-17T06:30:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf540b41c0 con 0x7fdf5414ac40 2023-11-17T06:30:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00b7e0 con 0x7fdf5414ac40 2023-11-17T06:30:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf540b4780 con 0x7fdf5414ac40 2023-11-17T06:30:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540b4970 con 0x7fdf5414ac40 2023-11-17T06:30:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.323+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf4c00b960 con 0x7fdf5414ac40 2023-11-17T06:30:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.327+0000 7fdf49ffb700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 0x7fdf38068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.327+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf4c0838c0 con 0x7fdf5414ac40 2023-11-17T06:30:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.327+0000 7fdf5971b700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 0x7fdf38068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.327+0000 7fdf5971b700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 0x7fdf38068a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf54063f70 tx=0x7fdf50007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.331+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf4c050d40 con 0x7fdf5414ac40 2023-11-17T06:30:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.503+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf5404eea0 con 0x7fdf5414ac40 2023-11-17T06:30:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf49ffb700 1 -- 172.21.15.100:0/428971989 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf4c054360 con 0x7fdf5414ac40 2023-11-17T06:30:16.510 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 msgr2=0x7fdf38068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 0x7fdf38068a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf54063f70 tx=0x7fdf50007040 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 msgr2=0x7fdf5414cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf540c6db0 tx=0x7fdf4c00b390 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 shutdown_connections 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf38066540 0x7fdf38068a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5414ac40 0x7fdf5414cb50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf541f19e0 0x7fdf5414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 --2- 172.21.15.100:0/428971989 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf40004870 0x7fdf54152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 >> 172.21.15.100:0/428971989 conn(0x7fdf5406df00 msgr2=0x7fdf5414bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.507+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 shutdown_connections 2023-11-17T06:30:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.511+0000 7fdf5b97f700 1 -- 172.21.15.100:0/428971989 wait complete. 2023-11-17T06:30:16.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:16.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.711+0000 7ff3580f3700 1 Processor -- start 2023-11-17T06:30:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.711+0000 7ff3580f3700 1 -- start start 2023-11-17T06:30:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff3580f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500cf5c0 0x7ff3500c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff3580f3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff3500c4e50 0x7ff35015e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff3580f3700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35015dfd0 con 0x7ff3500cfd90 2023-11-17T06:30:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff3580f3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35015b450 con 0x7ff3500c4e50 2023-11-17T06:30:16.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff3580f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35015e9a0 con 0x7ff3500cf5c0 2023-11-17T06:30:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff35568e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff3500c4e50 0x7ff35015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff35568e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff3500c4e50 0x7ff35015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:46488/0 (socket says 172.21.15.100:46488) 2023-11-17T06:30:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff355e8f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500cf5c0 0x7ff3500c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.715+0000 7ff35568e700 1 -- 172.21.15.100:0/946781193 learned_addr learned my addr 172.21.15.100:0/946781193 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:16.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff35568e700 1 -- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500cf5c0 msgr2=0x7ff3500c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff35568e700 1 --2- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500cf5c0 0x7ff3500c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff35568e700 1 -- 172.21.15.100:0/946781193 >> v1:172.21.15.119:6789/0 conn(0x7ff3500cfd90 legacy=0x7ff350071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff35568e700 1 -- 172.21.15.100:0/946781193 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500cf9a0 con 0x7ff3500c4e50 2023-11-17T06:30:16.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff35568e700 1 --2- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500c4e50 0x7ff35015e460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff340009910 tx=0x7ff340009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c922107694a21f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff354e8d700 1 -- 172.21.15.100:0/946781193 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340011830 con 0x7ff3500c4e50 2023-11-17T06:30:16.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff354e8d700 1 -- 172.21.15.100:0/946781193 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff340011990 con 0x7ff3500c4e50 2023-11-17T06:30:16.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff354e8d700 1 -- 172.21.15.100:0/946781193 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340011d40 con 0x7ff3500c4e50 2023-11-17T06:30:16.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 -- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500c4e50 msgr2=0x7ff35015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 --2- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500c4e50 0x7ff35015e460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff340009910 tx=0x7ff340009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 -- 172.21.15.100:0/946781193 shutdown_connections 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 --2- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500c4e50 0x7ff35015e460 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 --2- 172.21.15.100:0/946781193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500cf5c0 0x7ff3500c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 -- 172.21.15.100:0/946781193 >> 172.21.15.100:0/946781193 conn(0x7ff35006df00 msgr2=0x7ff35006e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 -- 172.21.15.100:0/946781193 shutdown_connections 2023-11-17T06:30:16.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.719+0000 7ff3580f3700 1 -- 172.21.15.100:0/946781193 wait complete. 2023-11-17T06:30:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 Processor -- start 2023-11-17T06:30:16.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 -- start start 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500c4e50 0x7ff3501f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 0x7ff3500b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501f6c30 con 0x7ff3500cfd90 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501616a0 con 0x7ff3500cf5c0 2023-11-17T06:30:16.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff3580f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501f6390 con 0x7ff3500c4e50 2023-11-17T06:30:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff356690700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff356690700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44436/0 (socket says 172.21.15.100:44436) 2023-11-17T06:30:16.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff356690700 1 -- 172.21.15.100:0/1780070065 learned_addr learned my addr 172.21.15.100:0/1780070065 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff355e8f700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500c4e50 0x7ff3501f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.723+0000 7ff35568e700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 0x7ff3500b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 -- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500c4e50 msgr2=0x7ff3501f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500c4e50 0x7ff3501f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 -- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 msgr2=0x7ff3500b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 0x7ff3500b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 -- 172.21.15.100:0/1780070065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009570 con 0x7ff3500cfd90 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff35568e700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 0x7ff3500b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff356690700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff34800cc50 tx=0x7ff34800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348003c20 con 0x7ff3500cfd90 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348003d80 con 0x7ff3500cfd90 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3501f6670 con 0x7ff3500cfd90 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800ab60 con 0x7ff3500cfd90 2023-11-17T06:30:16.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35015fe40 con 0x7ff3500cfd90 2023-11-17T06:30:16.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.727+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350160030 con 0x7ff3500cfd90 2023-11-17T06:30:16.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.731+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff34800acc0 con 0x7ff3500cfd90 2023-11-17T06:30:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.731+0000 7ff3467fc700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 0x7ff3340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.731+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff348083e90 con 0x7ff3500cfd90 2023-11-17T06:30:16.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.731+0000 7ff355e8f700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 0x7ff3340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.735+0000 7ff355e8f700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 0x7ff3340689d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009bf0 tx=0x7ff34c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.735+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3480513a0 con 0x7ff3500cfd90 2023-11-17T06:30:16.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.911+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff35004eea0 con 0x7ff3500cfd90 2023-11-17T06:30:16.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.911+0000 7ff3467fc700 1 -- 172.21.15.100:0/1780070065 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3480549c0 con 0x7ff3500cfd90 2023-11-17T06:30:16.917 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:16.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 msgr2=0x7ff3340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 0x7ff3340689d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009bf0 tx=0x7ff34c009240 comp rx=0 tx=0).stop 2023-11-17T06:30:16.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 msgr2=0x7ff3500aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff34800cc50 tx=0x7ff34800cf60 comp rx=0 tx=0).stop 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 shutdown_connections 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff334066510 0x7ff3340689d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3500cfd90 0x7ff3500aedf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3500cf5c0 0x7ff3500b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 --2- 172.21.15.100:0/1780070065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3500c4e50 0x7ff3501f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 >> 172.21.15.100:0/1780070065 conn(0x7ff35006df00 msgr2=0x7ff35015f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 shutdown_connections 2023-11-17T06:30:16.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:16.915+0000 7ff3580f3700 1 -- 172.21.15.100:0/1780070065 wait complete. 2023-11-17T06:30:16.951 INFO:tasks.cephfs_test_runner:Starting test: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:30:16.951 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:30:16.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:17.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.127+0000 7f3a224e5700 1 Processor -- start 2023-11-17T06:30:17.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.127+0000 7f3a224e5700 1 -- start start 2023-11-17T06:30:17.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a224e5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a224e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 0x7f3a1c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a224e5700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c06d160 con 0x7f3a1c144ac0 2023-11-17T06:30:17.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a224e5700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c06da00 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a224e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c06cf70 con 0x7f3a1c0cde70 2023-11-17T06:30:17.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44438/0 (socket says 172.21.15.100:44438) 2023-11-17T06:30:17.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 -- 172.21.15.100:0/2705759979 learned_addr learned my addr 172.21.15.100:0/2705759979 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:17.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a21ce4700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 0x7f3a1c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 -- 172.21.15.100:0/2705759979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 msgr2=0x7f3a1c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 0x7f3a1c0707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 -- 172.21.15.100:0/2705759979 >> v1:172.21.15.119:6789/0 conn(0x7f3a1c144ac0 legacy=0x7f3a1c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 -- 172.21.15.100:0/2705759979 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c06d440 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a21ce4700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 0x7f3a1c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.131+0000 7f3a20ce2700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009910 tx=0x7f3a0c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d14ef941f5168 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a13fff700 1 -- 172.21.15.100:0/2705759979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00ba60 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a13fff700 1 -- 172.21.15.100:0/2705759979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00bbc0 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a13fff700 1 -- 172.21.15.100:0/2705759979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c009e60 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 -- 172.21.15.100:0/2705759979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0c9a10 msgr2=0x7f3a1c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009910 tx=0x7f3a0c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 -- 172.21.15.100:0/2705759979 shutdown_connections 2023-11-17T06:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c0cde70 0x7f3a1c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 --2- 172.21.15.100:0/2705759979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c06ca30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 -- 172.21.15.100:0/2705759979 >> 172.21.15.100:0/2705759979 conn(0x7f3a1c0cb730 msgr2=0x7f3a1c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 -- 172.21.15.100:0/2705759979 shutdown_connections 2023-11-17T06:30:17.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 -- 172.21.15.100:0/2705759979 wait complete. 2023-11-17T06:30:17.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.135+0000 7f3a224e5700 1 Processor -- start 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 -- start start 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c144ac0 0x7f3a1c0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c136e00 con 0x7f3a1c0cde70 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b39c0 con 0x7f3a1c0c9a10 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0b3ca0 con 0x7f3a1c144ac0 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44448/0 (socket says 172.21.15.100:44448) 2023-11-17T06:30:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 -- 172.21.15.100:0/865570774 learned_addr learned my addr 172.21.15.100:0/865570774 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:17.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a214e3700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a21ce4700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c144ac0 0x7f3a1c0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 -- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c144ac0 msgr2=0x7f3a1c0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c144ac0 0x7f3a1c0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 -- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a1c0c9a10 msgr2=0x7f3a1c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 -- 172.21.15.100:0/865570774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009570 con 0x7f3a1c0cde70 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a20ce2700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c06f4c0 tx=0x7f3a0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c004510 con 0x7f3a1c0cde70 2023-11-17T06:30:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c01f070 con 0x7f3a1c0cde70 2023-11-17T06:30:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c0b3f80 con 0x7f3a1c0cde70 2023-11-17T06:30:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.139+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c003900 con 0x7f3a1c0cde70 2023-11-17T06:30:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.143+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c15b040 con 0x7f3a1c0cde70 2023-11-17T06:30:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.143+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c0b44a0 con 0x7f3a1c0cde70 2023-11-17T06:30:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.143+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a0c003a60 con 0x7f3a1c0cde70 2023-11-17T06:30:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.147+0000 7f3a11ffb700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 0x7f3a000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.147+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a0c021070 con 0x7f3a1c0cde70 2023-11-17T06:30:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.147+0000 7f3a214e3700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 0x7f3a000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.147+0000 7f3a214e3700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 0x7f3a000689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c06caa0 tx=0x7f3a18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.151+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a1c0b44a0 con 0x7f3a1c0cde70 2023-11-17T06:30:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.331+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a1c0b44a0 con 0x7f3a1c0cde70 2023-11-17T06:30:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a11ffb700 1 -- 172.21.15.100:0/865570774 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f3a1c0b44a0 con 0x7f3a1c0cde70 2023-11-17T06:30:17.339 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:17.339 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 msgr2=0x7f3a000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 0x7f3a000689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c06caa0 tx=0x7f3a18009040 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 msgr2=0x7f3a1c0c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c06f4c0 tx=0x7f3a0c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 shutdown_connections 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a1c144ac0 0x7f3a1c0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3a00066510 0x7f3a000689d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a1c0cde70 0x7f3a1c0c7f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 --2- 172.21.15.100:0/865570774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a1c0c9a10 0x7f3a1c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.335+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 >> 172.21.15.100:0/865570774 conn(0x7f3a1c0cb730 msgr2=0x7f3a1c0cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.339+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 shutdown_connections 2023-11-17T06:30:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.339+0000 7f3a224e5700 1 -- 172.21.15.100:0/865570774 wait complete. 2023-11-17T06:30:17.363 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:17.365 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:17.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.535+0000 7fa8a69bd700 1 Processor -- start 2023-11-17T06:30:17.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a69bd700 1 -- start start 2023-11-17T06:30:17.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a69bd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8a015aec0 0x7fa8a015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a69bd700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00cc400 con 0x7fa8a00b1520 2023-11-17T06:30:17.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a69bd700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00cdcc0 con 0x7fa8a00ce7a0 2023-11-17T06:30:17.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a69bd700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00ce380 con 0x7fa8a015aec0 2023-11-17T06:30:17.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a4f5a700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa8a00b1520 0x7fa8a00cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58464/0 (socket says 172.21.15.100:58464) 2023-11-17T06:30:17.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa8a4f5a700 1 -- 172.21.15.100:0/2733676358 learned_addr learned my addr 172.21.15.100:0/2733676358 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:17.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89ffff700 1 --2- 172.21.15.100:0/2733676358 >> v2:172.21.15.119:3300/0 conn(0x7fa8a015aec0 0x7fa8a015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948931030 0 0) 0x7fa8a00cdcc0 con 0x7fa8a00ce7a0 2023-11-17T06:30:17.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c0035d0 con 0x7fa8a00ce7a0 2023-11-17T06:30:17.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460892972 0 0) 0x7fa8a00cc400 con 0x7fa8a00b1520 2023-11-17T06:30:17.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89ffff700 1 -- 172.21.15.100:0/2733676358 >> v1:172.21.15.119:6789/0 conn(0x7fa8a00ce7a0 legacy=0x7fa8a00b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89ffff700 1 -- 172.21.15.100:0/2733676358 >> v1:172.21.15.100:6789/0 conn(0x7fa8a00b1520 legacy=0x7fa8a00cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.539+0000 7fa89ffff700 1 -- 172.21.15.100:0/2733676358 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00cdfa0 con 0x7fa8a015aec0 2023-11-17T06:30:17.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa89ffff700 1 --2- 172.21.15.100:0/2733676358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a015aec0 0x7fa8a015b2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e76730dcb2a4d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890011830 con 0x7fa8a015aec0 2023-11-17T06:30:17.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890011990 con 0x7fa8a015aec0 2023-11-17T06:30:17.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa89f7fe700 1 -- 172.21.15.100:0/2733676358 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890011d40 con 0x7fa8a015aec0 2023-11-17T06:30:17.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 -- 172.21.15.100:0/2733676358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a015aec0 msgr2=0x7fa8a015b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/2733676358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a015aec0 0x7fa8a015b2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:17.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 -- 172.21.15.100:0/2733676358 shutdown_connections 2023-11-17T06:30:17.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/2733676358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a015aec0 0x7fa8a015b2a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 -- 172.21.15.100:0/2733676358 >> 172.21.15.100:0/2733676358 conn(0x7fa8a006a450 msgr2=0x7fa8a006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 -- 172.21.15.100:0/2733676358 shutdown_connections 2023-11-17T06:30:17.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.543+0000 7fa8a69bd700 1 -- 172.21.15.100:0/2733676358 wait complete. 2023-11-17T06:30:17.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 Processor -- start 2023-11-17T06:30:17.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 -- start start 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8a00b1520 0x7fa8a0150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a00ce7a0 0x7fa8a00c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01508a0 con 0x7fa8a015aec0 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c6b60 con 0x7fa8a00ce7a0 2023-11-17T06:30:17.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a69bd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c6e40 con 0x7fa8a00b1520 2023-11-17T06:30:17.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44460/0 (socket says 172.21.15.100:44460) 2023-11-17T06:30:17.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 -- 172.21.15.100:0/3763087910 learned_addr learned my addr 172.21.15.100:0/3763087910 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:17.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa89ffff700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8a00b1520 0x7fa8a0150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8977fe700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a00ce7a0 0x7fa8a00c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 -- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8a00b1520 msgr2=0x7fa8a0150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8a00b1520 0x7fa8a0150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 -- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a00ce7a0 msgr2=0x7fa8a00c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a00ce7a0 0x7fa8a00c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 -- 172.21.15.100:0/3763087910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900094b0 con 0x7fa8a015aec0 2023-11-17T06:30:17.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.547+0000 7fa8a4f5a700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cba0 tx=0x7fa89800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800aaa0 con 0x7fa8a015aec0 2023-11-17T06:30:17.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800ac20 con 0x7fa8a015aec0 2023-11-17T06:30:17.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00c7120 con 0x7fa8a015aec0 2023-11-17T06:30:17.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980070d0 con 0x7fa8a015aec0 2023-11-17T06:30:17.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00c76e0 con 0x7fa8a015aec0 2023-11-17T06:30:17.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00c7900 con 0x7fa8a015aec0 2023-11-17T06:30:17.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.551+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa898007230 con 0x7fa8a015aec0 2023-11-17T06:30:17.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.555+0000 7fa89d7fa700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.555+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa898083920 con 0x7fa8a015aec0 2023-11-17T06:30:17.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.555+0000 7fa89ffff700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.555+0000 7fa89ffff700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 0x7fa8800689d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8900090b0 tx=0x7fa890008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.555+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa898050d20 con 0x7fa8a015aec0 2023-11-17T06:30:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.743+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8a004eea0 con 0x7fa8a015aec0 2023-11-17T06:30:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.743+0000 7fa89d7fa700 1 -- 172.21.15.100:0/3763087910 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa898018020 con 0x7fa8a015aec0 2023-11-17T06:30:17.747 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:17.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 msgr2=0x7fa8800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 0x7fa8800689d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8900090b0 tx=0x7fa890008030 comp rx=0 tx=0).stop 2023-11-17T06:30:17.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 msgr2=0x7fa8a00c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cba0 tx=0x7fa89800ceb0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 shutdown_connections 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a015aec0 0x7fa8a00c6530 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a00ce7a0 0x7fa8a00c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 --2- 172.21.15.100:0/3763087910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8a00b1520 0x7fa8a0150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 >> 172.21.15.100:0/3763087910 conn(0x7fa8a006a450 msgr2=0x7fa8a00cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 shutdown_connections 2023-11-17T06:30:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.747+0000 7fa8a69bd700 1 -- 172.21.15.100:0/3763087910 wait complete. 2023-11-17T06:30:17.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.943+0000 7fdfbe713700 1 Processor -- start 2023-11-17T06:30:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbe713700 1 -- start start 2023-11-17T06:30:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbe713700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbe713700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8160ce0 con 0x7fdfb815d2b0 2023-11-17T06:30:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbe713700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb80cdd40 con 0x7fdfb80cd8b0 2023-11-17T06:30:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbe713700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80ce020 con 0x7fdfb815ced0 2023-11-17T06:30:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbdf12700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdfb815d2b0 0x7fdfb80d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58468/0 (socket says 172.21.15.100:58468) 2023-11-17T06:30:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbdf12700 1 -- 172.21.15.100:0/2921684263 learned_addr learned my addr 172.21.15.100:0/2921684263 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfbd711700 1 --2- 172.21.15.100:0/2921684263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504158483 0 0) 0x7fdfb8160ce0 con 0x7fdfb815d2b0 2023-11-17T06:30:17.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.947+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa40035d0 con 0x7fdfb815d2b0 2023-11-17T06:30:17.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbd711700 1 -- 172.21.15.100:0/2921684263 >> v1:172.21.15.119:6789/0 conn(0x7fdfb80cd8b0 legacy=0x7fdfb8161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136497357 0 0) 0x7fdfa40035d0 con 0x7fdfb815d2b0 2023-11-17T06:30:17.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbd711700 1 -- 172.21.15.100:0/2921684263 >> v1:172.21.15.100:6789/0 conn(0x7fdfb815d2b0 legacy=0x7fdfb80d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbd711700 1 -- 172.21.15.100:0/2921684263 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80ce300 con 0x7fdfb815ced0 2023-11-17T06:30:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbd711700 1 --2- 172.21.15.100:0/2921684263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80d0fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098b0 tx=0x7fdfb4009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3d72d1f1865cf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00019f0 con 0x7fdfb815ced0 2023-11-17T06:30:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4010590 con 0x7fdfb815ced0 2023-11-17T06:30:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfaffff700 1 -- 172.21.15.100:0/2921684263 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4010940 con 0x7fdfb815ced0 2023-11-17T06:30:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 -- 172.21.15.100:0/2921684263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 msgr2=0x7fdfb80d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 --2- 172.21.15.100:0/2921684263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80d0fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40098b0 tx=0x7fdfb4009bc0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 -- 172.21.15.100:0/2921684263 shutdown_connections 2023-11-17T06:30:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 --2- 172.21.15.100:0/2921684263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80d0fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 -- 172.21.15.100:0/2921684263 >> 172.21.15.100:0/2921684263 conn(0x7fdfb806b370 msgr2=0x7fdfb806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 -- 172.21.15.100:0/2921684263 shutdown_connections 2023-11-17T06:30:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.951+0000 7fdfbe713700 1 -- 172.21.15.100:0/2921684263 wait complete. 2023-11-17T06:30:17.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 Processor -- start 2023-11-17T06:30:17.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 -- start start 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb815d2b0 0x7fdfb80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80c87c0 con 0x7fdfb80d3840 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80c7bd0 con 0x7fdfb815d2b0 2023-11-17T06:30:17.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbe713700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80c7e20 con 0x7fdfb815ced0 2023-11-17T06:30:17.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbdf12700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbcf10700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb815d2b0 0x7fdfb80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbdf12700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44470/0 (socket says 172.21.15.100:44470) 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbdf12700 1 -- 172.21.15.100:0/1698268617 learned_addr learned my addr 172.21.15.100:0/1698268617 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 -- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb815d2b0 msgr2=0x7fdfb80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb815d2b0 0x7fdfb80cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 -- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 msgr2=0x7fdfb8149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbd711700 1 -- 172.21.15.100:0/1698268617 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40094b0 con 0x7fdfb815ced0 2023-11-17T06:30:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.955+0000 7fdfbdf12700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfbd711700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80ca6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4015000 tx=0x7fdfb4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4010c10 con 0x7fdfb815ced0 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4010db0 con 0x7fdfb815ced0 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4003900 con 0x7fdfb815ced0 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb80c8100 con 0x7fdfb815ced0 2023-11-17T06:30:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb80ccf00 con 0x7fdfb815ced0 2023-11-17T06:30:17.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.959+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb80c8900 con 0x7fdfb815ced0 2023-11-17T06:30:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.963+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdfb4003a60 con 0x7fdfb815ced0 2023-11-17T06:30:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.963+0000 7fdfadffb700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 0x7fdf9c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.963+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfb4085090 con 0x7fdfb815ced0 2023-11-17T06:30:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.963+0000 7fdfbcf10700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 0x7fdf9c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.967+0000 7fdfbcf10700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 0x7fdf9c0689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80c6b10 tx=0x7fdfa8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:17.971+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdfb4052500 con 0x7fdfb815ced0 2023-11-17T06:30:18.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.147+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfb8065e90 con 0x7fdfb815ced0 2023-11-17T06:30:18.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.147+0000 7fdfadffb700 1 -- 172.21.15.100:0/1698268617 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfb4055b20 con 0x7fdfb815ced0 2023-11-17T06:30:18.153 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 msgr2=0x7fdf9c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 0x7fdf9c0689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80c6b10 tx=0x7fdfa8009040 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 msgr2=0x7fdfb80ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80ca6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4015000 tx=0x7fdfb4004770 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 shutdown_connections 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdf9c066510 0x7fdf9c0689d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfb80d3840 0x7fdfb8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb815d2b0 0x7fdfb80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 --2- 172.21.15.100:0/1698268617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdfb815ced0 0x7fdfb80ca6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 >> 172.21.15.100:0/1698268617 conn(0x7fdfb806b370 msgr2=0x7fdfb80b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 shutdown_connections 2023-11-17T06:30:18.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.151+0000 7fdfbe713700 1 -- 172.21.15.100:0/1698268617 wait complete. 2023-11-17T06:30:18.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:18.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 Processor -- start 2023-11-17T06:30:18.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 -- start start 2023-11-17T06:30:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 0x7f77c815b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c80cf200 0x7f77c80cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c815a3b0 con 0x7f77c815e870 2023-11-17T06:30:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80cfbb0 con 0x7f77c80cf200 2023-11-17T06:30:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd825700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ca590 con 0x7f77c8159fd0 2023-11-17T06:30:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd024700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c80cf200 0x7f77c80cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd024700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c80cf200 0x7f77c80cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44478/0 (socket says 172.21.15.100:44478) 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.351+0000 7f77cd024700 1 -- 172.21.15.100:0/2226487519 learned_addr learned my addr 172.21.15.100:0/2226487519 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cc823700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 0x7f77c815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd024700 1 -- 172.21.15.100:0/2226487519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 msgr2=0x7f77c815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd024700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 0x7f77c815b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd024700 1 -- 172.21.15.100:0/2226487519 >> v1:172.21.15.119:6789/0 conn(0x7f77c815e870 legacy=0x7f77c80c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd024700 1 -- 172.21.15.100:0/2226487519 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80ca840 con 0x7f77c80cf200 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cc823700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 0x7f77c815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:18.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd024700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c80cf200 0x7f77c80cf670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77c000d150 tx=0x7f77c000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eec91fd9f18a5cd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77c77fe700 1 -- 172.21.15.100:0/2226487519 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0010070 con 0x7f77c80cf200 2023-11-17T06:30:18.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77c77fe700 1 -- 172.21.15.100:0/2226487519 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000ddc0 con 0x7f77c80cf200 2023-11-17T06:30:18.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77c77fe700 1 -- 172.21.15.100:0/2226487519 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000b310 con 0x7f77c80cf200 2023-11-17T06:30:18.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 -- 172.21.15.100:0/2226487519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c80cf200 msgr2=0x7f77c80cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c80cf200 0x7f77c80cf670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77c000d150 tx=0x7f77c000d460 comp rx=0 tx=0).stop 2023-11-17T06:30:18.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 -- 172.21.15.100:0/2226487519 shutdown_connections 2023-11-17T06:30:18.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c80cf200 0x7f77c80cf670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 --2- 172.21.15.100:0/2226487519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c8159fd0 0x7f77c815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 -- 172.21.15.100:0/2226487519 >> 172.21.15.100:0/2226487519 conn(0x7f77c806a690 msgr2=0x7f77c806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 -- 172.21.15.100:0/2226487519 shutdown_connections 2023-11-17T06:30:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.355+0000 7f77cd825700 1 -- 172.21.15.100:0/2226487519 wait complete. 2023-11-17T06:30:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.359+0000 7f77cd825700 1 Processor -- start 2023-11-17T06:30:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.359+0000 7f77cd825700 1 -- start start 2023-11-17T06:30:18.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 0x7f77c80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c8159fd0 0x7f77c8158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c4690 con 0x7f77c815e870 2023-11-17T06:30:18.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8158120 con 0x7f77c8159fd0 2023-11-17T06:30:18.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c3a80 con 0x7f77c80cf200 2023-11-17T06:30:18.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd024700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd024700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44484/0 (socket says 172.21.15.100:44484) 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 0x7f77c80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd024700 1 -- 172.21.15.100:0/145019595 learned_addr learned my addr 172.21.15.100:0/145019595 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77c7fff700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c8159fd0 0x7f77c8158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 -- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c8159fd0 msgr2=0x7f77c8158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c8159fd0 0x7f77c8158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 -- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 msgr2=0x7f77c80c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 -- 172.21.15.100:0/145019595 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c000bd40 con 0x7f77c80cf200 2023-11-17T06:30:18.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd024700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:18.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cc823700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 0x7f77c80b18f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00e840 tx=0x7f77bc00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00c070 con 0x7f77c80cf200 2023-11-17T06:30:18.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc004250 con 0x7f77c80cf200 2023-11-17T06:30:18.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0036c0 con 0x7f77c80cf200 2023-11-17T06:30:18.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.363+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80c3d60 con 0x7f77c80cf200 2023-11-17T06:30:18.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.367+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80c4320 con 0x7f77c80cf200 2023-11-17T06:30:18.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.367+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c8067e10 con 0x7f77c80cf200 2023-11-17T06:30:18.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.367+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77bc003820 con 0x7f77c80cf200 2023-11-17T06:30:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.371+0000 7f77c57fa700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 0x7f77ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.371+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77bc083a20 con 0x7f77c80cf200 2023-11-17T06:30:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.371+0000 7f77c7fff700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 0x7f77ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.371+0000 7f77c7fff700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 0x7f77ac068a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77c815b3a0 tx=0x7f77b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.379+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77bc050e90 con 0x7f77c80cf200 2023-11-17T06:30:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.555+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77c8065e90 con 0x7f77c80cf200 2023-11-17T06:30:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.555+0000 7f77c57fa700 1 -- 172.21.15.100:0/145019595 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77bc0544b0 con 0x7f77c80cf200 2023-11-17T06:30:18.561 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 msgr2=0x7f77ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 0x7f77ac068a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77c815b3a0 tx=0x7f77b4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 msgr2=0x7f77c80b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 0x7f77c80b18f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00e840 tx=0x7f77bc00eb50 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 shutdown_connections 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f77ac066540 0x7f77ac068a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c815e870 0x7f77c80c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c8159fd0 0x7f77c8158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 --2- 172.21.15.100:0/145019595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77c80cf200 0x7f77c80b18f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 >> 172.21.15.100:0/145019595 conn(0x7f77c806a690 msgr2=0x7f77c8159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.559+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 shutdown_connections 2023-11-17T06:30:18.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.563+0000 7f77cd825700 1 -- 172.21.15.100:0/145019595 wait complete. 2023-11-17T06:30:18.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-17T06:30:18.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 Processor -- start 2023-11-17T06:30:18.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 -- start start 2023-11-17T06:30:18.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0d04b0 con 0x7f4b9c0b2730 2023-11-17T06:30:18.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0d15e0 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.771+0000 7f4ba34ba700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9c0b6880 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44498/0 (socket says 172.21.15.100:44498) 2023-11-17T06:30:18.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3627489189 learned_addr learned my addr 172.21.15.100:0/3627489189 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3627489189 >> v1:172.21.15.119:6789/0 conn(0x7f4b9c15d4a0 legacy=0x7f4b9c0b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3627489189 >> v1:172.21.15.100:6789/0 conn(0x7f4b9c0b2730 legacy=0x7f4b9c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3627489189 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0d18c0 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba1a57700 1 --2- 172.21.15.100:0/3627489189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009e50 tx=0x7f4b9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a12e458f46b38b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4b93fff700 1 -- 172.21.15.100:0/3627489189 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400e070 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4b93fff700 1 -- 172.21.15.100:0/3627489189 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9400b9c0 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4b93fff700 1 -- 172.21.15.100:0/3627489189 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400bd70 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3627489189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c0cfb60 msgr2=0x7f4b9c0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3627489189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009e50 tx=0x7f4b9400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3627489189 shutdown_connections 2023-11-17T06:30:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3627489189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c0cfb60 0x7f4b9c0cff70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3627489189 >> 172.21.15.100:0/3627489189 conn(0x7f4b9c06b430 msgr2=0x7f4b9c06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3627489189 shutdown_connections 2023-11-17T06:30:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.775+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3627489189 wait complete. 2023-11-17T06:30:18.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 Processor -- start 2023-11-17T06:30:18.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 -- start start 2023-11-17T06:30:18.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0b2730 0x7f4b9c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c0cfb60 0x7f4b9c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0b3a60 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c1f6110 con 0x7f4b9c0b2730 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba34ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c1f63f0 con 0x7f4b9c0cfb60 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba1a57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba1a57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44508/0 (socket says 172.21.15.100:44508) 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3940570736 learned_addr learned my addr 172.21.15.100:0/3940570736 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba1256700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0b2730 0x7f4b9c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.779+0000 7f4ba0a55700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c0cfb60 0x7f4b9c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c0cfb60 msgr2=0x7f4b9c0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c0cfb60 0x7f4b9c0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0b2730 msgr2=0x7f4b9c1f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0b2730 0x7f4b9c1f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 -- 172.21.15.100:0/3940570736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b94009b30 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba1a57700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b370 tx=0x7f4b94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94004250 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940043d0 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c1f66d0 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94004780 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c156d80 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.783+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c0cf370 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.791+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4b9401c440 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.791+0000 7f4b91ffb700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 0x7f4b800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.791+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b940857d0 con 0x7f4b9c15d4a0 2023-11-17T06:30:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.791+0000 7f4ba1256700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 0x7f4b800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.791+0000 7f4ba1256700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 0x7f4b800689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0cb720 tx=0x7f4b98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:18.795+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b94052ce0 con 0x7f4b9c15d4a0 2023-11-17T06:30:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.031+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f4b9c1f6bf0 con 0x7f4b9c15d4a0 2023-11-17T06:30:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.875+0000 7f4b91ffb700 1 -- 172.21.15.100:0/3940570736 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v85) v1 ==== 148+0+0 (secure 0 0 0) 0x7f4b9c1f6bf0 con 0x7f4b9c15d4a0 2023-11-17T06:30:19.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 msgr2=0x7f4b800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:19.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 0x7f4b800689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0cb720 tx=0x7f4b98009040 comp rx=0 tx=0).stop 2023-11-17T06:30:19.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 msgr2=0x7f4b9c0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:19.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b370 tx=0x7f4b94004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 shutdown_connections 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4b80066510 0x7f4b800689d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b9c15d4a0 0x7f4b9c0cbad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c0cfb60 0x7f4b9c0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 --2- 172.21.15.100:0/3940570736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0b2730 0x7f4b9c1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 >> 172.21.15.100:0/3940570736 conn(0x7f4b9c06b430 msgr2=0x7f4b9c0b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 shutdown_connections 2023-11-17T06:30:19.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:19.879+0000 7f4ba34ba700 1 -- 172.21.15.100:0/3940570736 wait complete. 2023-11-17T06:30:19.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-17T06:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 Processor -- start 2023-11-17T06:30:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 -- start start 2023-11-17T06:30:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ff415d2c0 0x7f4ff40d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ff40d01a0 0x7f4ff40b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff415d6a0 con 0x7f4ff40d2bc0 2023-11-17T06:30:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40d2150 con 0x7f4ff40d01a0 2023-11-17T06:30:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff9dbc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40d14d0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff95bb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ff40d01a0 0x7f4ff40b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff95bb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ff40d01a0 0x7f4ff40b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44524/0 (socket says 172.21.15.100:44524) 2023-11-17T06:30:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.087+0000 7f4ff95bb700 1 -- 172.21.15.100:0/2408158581 learned_addr learned my addr 172.21.15.100:0/2408158581 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff8dba700 1 --2- 172.21.15.100:0/2408158581 >> v2:172.21.15.119:3300/0 conn(0x7f4ff415d2c0 0x7f4ff40d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff95bb700 1 -- 172.21.15.100:0/2408158581 >> v2:172.21.15.119:3300/0 conn(0x7f4ff415d2c0 msgr2=0x7f4ff40d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff95bb700 1 --2- 172.21.15.100:0/2408158581 >> v2:172.21.15.119:3300/0 conn(0x7f4ff415d2c0 0x7f4ff40d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff95bb700 1 -- 172.21.15.100:0/2408158581 >> v1:172.21.15.119:6789/0 conn(0x7f4ff40d2bc0 legacy=0x7f4ff40cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff95bb700 1 -- 172.21.15.100:0/2408158581 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40d17b0 con 0x7f4ff40d01a0 2023-11-17T06:30:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff95bb700 1 --2- 172.21.15.100:0/2408158581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff40d01a0 0x7f4ff40b63d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ff406bf80 tx=0x7f4fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3599d61f39042f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff37fe700 1 -- 172.21.15.100:0/2408158581 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00e070 con 0x7f4ff40d01a0 2023-11-17T06:30:20.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff37fe700 1 -- 172.21.15.100:0/2408158581 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec00b910 con 0x7f4ff40d01a0 2023-11-17T06:30:20.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff37fe700 1 -- 172.21.15.100:0/2408158581 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00bcc0 con 0x7f4ff40d01a0 2023-11-17T06:30:20.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/2408158581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff40d01a0 msgr2=0x7f4ff40b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/2408158581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff40d01a0 0x7f4ff40b63d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ff406bf80 tx=0x7f4fec00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:20.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/2408158581 shutdown_connections 2023-11-17T06:30:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/2408158581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff40d01a0 0x7f4ff40b63d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/2408158581 >> v2:172.21.15.119:3300/0 conn(0x7f4ff415d2c0 0x7f4ff40d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/2408158581 >> 172.21.15.100:0/2408158581 conn(0x7f4ff406b370 msgr2=0x7f4ff406b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/2408158581 shutdown_connections 2023-11-17T06:30:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.091+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/2408158581 wait complete. 2023-11-17T06:30:20.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.095+0000 7f4ff9dbc700 1 Processor -- start 2023-11-17T06:30:20.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.095+0000 7f4ff9dbc700 1 -- start start 2023-11-17T06:30:20.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 0x7f4ff41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 0x7f4ff41554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40b6940 con 0x7f4ff415d2c0 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4155f30 con 0x7f4ff40d01a0 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff41f3760 con 0x7f4ff40d2bc0 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44534/0 (socket says 172.21.15.100:44534) 2023-11-17T06:30:20.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 -- 172.21.15.100:0/438090459 learned_addr learned my addr 172.21.15.100:0/438090459 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff8dba700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 0x7f4ff41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff3fff700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 0x7f4ff41554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 -- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 msgr2=0x7f4ff41554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 0x7f4ff41554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 -- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 msgr2=0x7f4ff41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 0x7f4ff41586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 -- 172.21.15.100:0/438090459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009b30 con 0x7f4ff415d2c0 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff8dba700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 0x7f4ff41586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff3fff700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 0x7f4ff41554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff95bb700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00b680 tx=0x7f4fec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0099b0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec0092e0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff4153830 con 0x7f4ff415d2c0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec01c640 con 0x7f4ff415d2c0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.099+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff4153df0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.103+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff40d1a70 con 0x7f4ff415d2c0 2023-11-17T06:30:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.103+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fec01c7a0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.103+0000 7f4ff17fa700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 0x7f4fd80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.103+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fec085ca0 con 0x7f4ff415d2c0 2023-11-17T06:30:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.107+0000 7f4ff8dba700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 0x7f4fd80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.107+0000 7f4ff8dba700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 0x7f4fd80689d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4156fd0 tx=0x7f4fe8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.111+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ff40d1a70 con 0x7f4ff415d2c0 2023-11-17T06:30:20.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.283+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4ff40d1a40 con 0x7f4ff415d2c0 2023-11-17T06:30:20.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.295+0000 7f4ff17fa700 1 -- 172.21.15.100:0/438090459 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4fec053230 con 0x7f4ff415d2c0 2023-11-17T06:30:20.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 msgr2=0x7f4fd80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 0x7f4fd80689d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4156fd0 tx=0x7f4fe8008040 comp rx=0 tx=0).stop 2023-11-17T06:30:20.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 msgr2=0x7f4ff41559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00b680 tx=0x7f4fec004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 shutdown_connections 2023-11-17T06:30:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4fd8066510 0x7f4fd80689d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff415d2c0 0x7f4ff41559f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ff40d2bc0 0x7f4ff41554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 --2- 172.21.15.100:0/438090459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ff40d01a0 0x7f4ff41586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 >> 172.21.15.100:0/438090459 conn(0x7f4ff406b370 msgr2=0x7f4ff40cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 shutdown_connections 2023-11-17T06:30:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.299+0000 7f4ff9dbc700 1 -- 172.21.15.100:0/438090459 wait complete. 2023-11-17T06:30:20.325 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-17T06:30:20.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:30:20.368 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:30:20.413 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-17T06:30:20.413 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:20.413 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:20.435 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:20.435 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:20.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.715+0000 7fdd5fb23700 1 Processor -- start 2023-11-17T06:30:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.715+0000 7fdd5fb23700 1 -- start start 2023-11-17T06:30:20.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.715+0000 7fdd5fb23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd5815b0a0 0x7fdd580cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd580cf8a0 0x7fdd580b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd58070ad0 con 0x7fdd580b0f80 2023-11-17T06:30:20.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5815fd40 con 0x7fdd580cf8a0 2023-11-17T06:30:20.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580b13f0 con 0x7fdd5815b0a0 2023-11-17T06:30:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5e0c0700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdd580b0f80 0x7fdd580c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58486/0 (socket says 172.21.15.100:58486) 2023-11-17T06:30:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5e0c0700 1 -- 172.21.15.100:0/2260983458 learned_addr learned my addr 172.21.15.100:0/2260983458 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/2260983458 >> v2:172.21.15.100:3300/0 conn(0x7fdd580cf8a0 0x7fdd580b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d8bf700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd5815b0a0 0x7fdd580cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5c8bd700 1 -- 172.21.15.100:0/2260983458 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206600320 0 0) 0x7fdd58070ad0 con 0x7fdd580b0f80 2023-11-17T06:30:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5c8bd700 1 -- 172.21.15.100:0/2260983458 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd440035d0 con 0x7fdd580b0f80 2023-11-17T06:30:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 -- 172.21.15.100:0/2260983458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd5815b0a0 msgr2=0x7fdd580cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd5815b0a0 0x7fdd580cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 -- 172.21.15.100:0/2260983458 >> v1:172.21.15.100:6789/0 conn(0x7fdd580b0f80 legacy=0x7fdd580c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 -- 172.21.15.100:0/2260983458 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58071f20 con 0x7fdd580cf8a0 2023-11-17T06:30:20.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580cf8a0 0x7fdd580b0a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009880 tx=0x7fdd48009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dba4b920c864068 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5c8bd700 1 -- 172.21.15.100:0/2260983458 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48011830 con 0x7fdd580cf8a0 2023-11-17T06:30:20.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5c8bd700 1 -- 172.21.15.100:0/2260983458 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48011990 con 0x7fdd580cf8a0 2023-11-17T06:30:20.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5c8bd700 1 -- 172.21.15.100:0/2260983458 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48011d20 con 0x7fdd580cf8a0 2023-11-17T06:30:20.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 -- 172.21.15.100:0/2260983458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580cf8a0 msgr2=0x7fdd580b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.719+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580cf8a0 0x7fdd580b0a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009880 tx=0x7fdd48009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- 172.21.15.100:0/2260983458 shutdown_connections 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580cf8a0 0x7fdd580b0a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/2260983458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd5815b0a0 0x7fdd580cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- 172.21.15.100:0/2260983458 >> 172.21.15.100:0/2260983458 conn(0x7fdd5806a270 msgr2=0x7fdd5806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- 172.21.15.100:0/2260983458 shutdown_connections 2023-11-17T06:30:20.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- 172.21.15.100:0/2260983458 wait complete. 2023-11-17T06:30:20.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 Processor -- start 2023-11-17T06:30:20.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- start start 2023-11-17T06:30:20.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd580cf8a0 0x7fdd5814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd5815b0a0 0x7fdd581f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581505e0 con 0x7fdd580b0f80 2023-11-17T06:30:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58152ef0 con 0x7fdd5815b0a0 2023-11-17T06:30:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.723+0000 7fdd5fb23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5814e170 con 0x7fdd580cf8a0 2023-11-17T06:30:20.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44558/0 (socket says 172.21.15.100:44558) 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 -- 172.21.15.100:0/1511135188 learned_addr learned my addr 172.21.15.100:0/1511135188 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5e0c0700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd5815b0a0 0x7fdd581f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd580cf8a0 0x7fdd5814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 -- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd580cf8a0 msgr2=0x7fdd5814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd580cf8a0 0x7fdd5814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 -- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd5815b0a0 msgr2=0x7fdd581f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd5815b0a0 0x7fdd581f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 -- 172.21.15.100:0/1511135188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480094b0 con 0x7fdd580b0f80 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5d8bf700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400e840 tx=0x7fdd5400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540095a0 con 0x7fdd580b0f80 2023-11-17T06:30:20.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54013680 con 0x7fdd580b0f80 2023-11-17T06:30:20.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd58153190 con 0x7fdd580b0f80 2023-11-17T06:30:20.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540139f0 con 0x7fdd580b0f80 2023-11-17T06:30:20.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.727+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd58150ab0 con 0x7fdd580b0f80 2023-11-17T06:30:20.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd54013b50 con 0x7fdd580b0f80 2023-11-17T06:30:20.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5804eea0 con 0x7fdd580b0f80 2023-11-17T06:30:20.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd4e7fc700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 0x7fdd3c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd54083c80 con 0x7fdd580b0f80 2023-11-17T06:30:20.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 0x7fdd3c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.731+0000 7fdd5d0be700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 0x7fdd3c0689d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009bd0 tx=0x7fdd48008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.735+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd54051080 con 0x7fdd580b0f80 2023-11-17T06:30:20.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.907+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd580cc240 con 0x7fdd580b0f80 2023-11-17T06:30:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.911+0000 7fdd4e7fc700 1 -- 172.21.15.100:0/1511135188 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fdd540546a0 con 0x7fdd580b0f80 2023-11-17T06:30:20.916 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:20.916 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 msgr2=0x7fdd3c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 0x7fdd3c0689d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009bd0 tx=0x7fdd48008030 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 msgr2=0x7fdd581500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400e840 tx=0x7fdd5400eb50 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 shutdown_connections 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd5815b0a0 0x7fdd581f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd580cf8a0 0x7fdd5814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdd3c066510 0x7fdd3c0689d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 --2- 172.21.15.100:0/1511135188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd580b0f80 0x7fdd581500a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 >> 172.21.15.100:0/1511135188 conn(0x7fdd5806a270 msgr2=0x7fdd58158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 shutdown_connections 2023-11-17T06:30:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:20.915+0000 7fdd5fb23700 1 -- 172.21.15.100:0/1511135188 wait complete. 2023-11-17T06:30:20.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:20.939 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:21.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 Processor -- start 2023-11-17T06:30:21.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 -- start start 2023-11-17T06:30:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 0x7f62fc0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f62fc0c9b10 0x7f62fc06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc06b450 con 0x7f62fc06c800 2023-11-17T06:30:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc072700 con 0x7f62fc0c9b10 2023-11-17T06:30:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fb59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc15d7a0 con 0x7f62fc15d3c0 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fad9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f62fc06c800 0x7f62fc160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58498/0 (socket says 172.21.15.100:58498) 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fad9d700 1 -- 172.21.15.100:0/4148901246 learned_addr learned my addr 172.21.15.100:0/4148901246 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62fa59c700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 0x7f62fc0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.111+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718512827 0 0) 0x7f62fc06b450 con 0x7f62fc06c800 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f9d9b700 1 --2- 172.21.15.100:0/4148901246 >> v2:172.21.15.119:3300/0 conn(0x7f62fc0c9b10 0x7f62fc06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e40035d0 con 0x7f62fc06c800 2023-11-17T06:30:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709583276 0 0) 0x7f62e40035d0 con 0x7f62fc06c800 2023-11-17T06:30:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 msgr2=0x7f62fc0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 0x7f62fc0cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 >> v2:172.21.15.119:3300/0 conn(0x7f62fc0c9b10 msgr2=0x7f62fc06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 --2- 172.21.15.100:0/4148901246 >> v2:172.21.15.119:3300/0 conn(0x7f62fc0c9b10 0x7f62fc06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0ca2d0 con 0x7f62fc06c800 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f62f40019f0 con 0x7f62fc06c800 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 >> v1:172.21.15.100:6789/0 conn(0x7f62fc06c800 legacy=0x7f62fc160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4003a20 0x7f62e4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 0x7f62e4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62e4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc072700 con 0x7f62e4004db0 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc15d7a0 con 0x7f62e4003a20 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e400bb60 con 0x7f62fc15d3c0 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62e4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fa59c700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4003a20 0x7f62e4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 -- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 msgr2=0x7f62e4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc15d3c0 0x7f62e4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 -- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4003a20 msgr2=0x7f62e4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4003a20 0x7f62e4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 -- 172.21.15.100:0/4148901246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40035d0 con 0x7f62e4004db0 2023-11-17T06:30:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62e4005230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a810 tx=0x7f62e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241fda3fbde43d35 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400a250 con 0x7f62e4004db0 2023-11-17T06:30:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f40072d0 con 0x7f62e4004db0 2023-11-17T06:30:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62f959a700 1 -- 172.21.15.100:0/4148901246 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4007680 con 0x7f62e4004db0 2023-11-17T06:30:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 -- 172.21.15.100:0/4148901246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 msgr2=0x7f62e4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 --2- 172.21.15.100:0/4148901246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62e4005230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a810 tx=0x7f62e40058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fad9d700 1 -- 172.21.15.100:0/4148901246 reap_dead start 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 -- 172.21.15.100:0/4148901246 shutdown_connections 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 -- 172.21.15.100:0/4148901246 >> 172.21.15.100:0/4148901246 conn(0x7f62fc0cf4c0 msgr2=0x7f62fc0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 -- 172.21.15.100:0/4148901246 shutdown_connections 2023-11-17T06:30:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.115+0000 7f62fb59e700 1 -- 172.21.15.100:0/4148901246 wait complete. 2023-11-17T06:30:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.119+0000 7f62fb59e700 1 Processor -- start 2023-11-17T06:30:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.119+0000 7f62fb59e700 1 -- start start 2023-11-17T06:30:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc0c3c70 0x7f62fc160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62fc0c2ff0 0x7f62fc0c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0c39b0 con 0x7f62e4004db0 2023-11-17T06:30:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0c4890 con 0x7f62fc0c2ff0 2023-11-17T06:30:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0c4b00 con 0x7f62fc0c3c70 2023-11-17T06:30:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44572/0 (socket says 172.21.15.100:44572) 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 -- 172.21.15.100:0/3065632275 learned_addr learned my addr 172.21.15.100:0/3065632275 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fad9d700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62fc0c2ff0 0x7f62fc0c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62f9d9b700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc0c3c70 0x7f62fc160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 -- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc0c3c70 msgr2=0x7f62fc160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc0c3c70 0x7f62fc160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 -- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62fc0c2ff0 msgr2=0x7f62fc0c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62fc0c2ff0 0x7f62fc0c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 -- 172.21.15.100:0/3065632275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0c4de0 con 0x7f62e4004db0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fa59c700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0108c0 tx=0x7f62ec010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec015880 con 0x7f62e4004db0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec00c050 con 0x7f62e4004db0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc0c50c0 con 0x7f62e4004db0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec015c00 con 0x7f62e4004db0 2023-11-17T06:30:21.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.123+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc157f90 con 0x7f62e4004db0 2023-11-17T06:30:21.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.127+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc065e90 con 0x7f62e4004db0 2023-11-17T06:30:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.127+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62ec016420 con 0x7f62e4004db0 2023-11-17T06:30:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.127+0000 7f62eaffd700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 0x7f62dc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.127+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62ec084520 con 0x7f62e4004db0 2023-11-17T06:30:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.131+0000 7f62f9d9b700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 0x7f62dc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.131+0000 7f62f9d9b700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 0x7f62dc0689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62fc1f03f0 tx=0x7f62f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.131+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62ec0519b0 con 0x7f62e4004db0 2023-11-17T06:30:21.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.307+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62fc0b5440 con 0x7f62e4004db0 2023-11-17T06:30:21.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.307+0000 7f62eaffd700 1 -- 172.21.15.100:0/3065632275 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62ec054fd0 con 0x7f62e4004db0 2023-11-17T06:30:21.454 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 msgr2=0x7f62dc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 0x7f62dc0689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62fc1f03f0 tx=0x7f62f0008040 comp rx=0 tx=0).stop 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 msgr2=0x7f62fc157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0108c0 tx=0x7f62ec010bd0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 shutdown_connections 2023-11-17T06:30:21.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62fc0c2ff0 0x7f62fc0c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62fc0c3c70 0x7f62fc160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f62dc066510 0x7f62dc0689d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 --2- 172.21.15.100:0/3065632275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62e4004db0 0x7f62fc157a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 >> 172.21.15.100:0/3065632275 conn(0x7f62fc0cf4c0 msgr2=0x7f62fc0ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 shutdown_connections 2023-11-17T06:30:21.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.311+0000 7f62fb59e700 1 -- 172.21.15.100:0/3065632275 wait complete. 2023-11-17T06:30:21.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:21.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 Processor -- start 2023-11-17T06:30:21.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 -- start start 2023-11-17T06:30:21.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd1d815b250 0x7fd1d8071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d80cb3b0 con 0x7fd1d80b1410 2023-11-17T06:30:21.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d80cf8a0 con 0x7fd1d80cad70 2023-11-17T06:30:21.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1dca63700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d80cc690 con 0x7fd1d815b250 2023-11-17T06:30:21.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1d6d9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd1d80b1410 0x7fd1d815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58506/0 (socket says 172.21.15.100:58506) 2023-11-17T06:30:21.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1d6d9d700 1 -- 172.21.15.100:0/2632780714 learned_addr learned my addr 172.21.15.100:0/2632780714 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:21.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1d659c700 1 --2- 172.21.15.100:0/2632780714 >> v2:172.21.15.119:3300/0 conn(0x7fd1d815b250 0x7fd1d8071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175053185 0 0) 0x7fd1d80cb3b0 con 0x7fd1d80b1410 2023-11-17T06:30:21.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.639+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c00035d0 con 0x7fd1d80b1410 2023-11-17T06:30:21.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486319857 0 0) 0x7fd1d80cf8a0 con 0x7fd1d80cad70 2023-11-17T06:30:21.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d659c700 1 -- 172.21.15.100:0/2632780714 >> v1:172.21.15.119:6789/0 conn(0x7fd1d80cad70 legacy=0x7fd1d80b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d659c700 1 -- 172.21.15.100:0/2632780714 >> v1:172.21.15.100:6789/0 conn(0x7fd1d80b1410 legacy=0x7fd1d815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d659c700 1 -- 172.21.15.100:0/2632780714 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d80cfb80 con 0x7fd1d815b250 2023-11-17T06:30:21.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d659c700 1 --2- 172.21.15.100:0/2632780714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d815b250 0x7fd1d8071fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009850 tx=0x7fd1c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1906faf1cea8f18 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00019f0 con 0x7fd1d815b250 2023-11-17T06:30:21.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8010590 con 0x7fd1d815b250 2023-11-17T06:30:21.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1d559a700 1 -- 172.21.15.100:0/2632780714 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8010940 con 0x7fd1d815b250 2023-11-17T06:30:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 -- 172.21.15.100:0/2632780714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d815b250 msgr2=0x7fd1d8071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2632780714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d815b250 0x7fd1d8071fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009850 tx=0x7fd1c8009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 -- 172.21.15.100:0/2632780714 shutdown_connections 2023-11-17T06:30:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2632780714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d815b250 0x7fd1d8071fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 -- 172.21.15.100:0/2632780714 >> 172.21.15.100:0/2632780714 conn(0x7fd1d806a450 msgr2=0x7fd1d806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:21.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 -- 172.21.15.100:0/2632780714 shutdown_connections 2023-11-17T06:30:21.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.643+0000 7fd1dca63700 1 -- 172.21.15.100:0/2632780714 wait complete. 2023-11-17T06:30:21.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 Processor -- start 2023-11-17T06:30:21.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 -- start start 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 0x7fd1d80c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d815b250 0x7fd1d80c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c9470 con 0x7fd1d80b1410 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c9750 con 0x7fd1d80cad70 2023-11-17T06:30:21.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1dca63700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c9a30 con 0x7fd1d815b250 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44574/0 (socket says 172.21.15.100:44574) 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 -- 172.21.15.100:0/2490284283 learned_addr learned my addr 172.21.15.100:0/2490284283 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d5d9b700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 0x7fd1d80c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 -- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d815b250 msgr2=0x7fd1d80c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d6d9d700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d815b250 0x7fd1d80c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d815b250 0x7fd1d80c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 -- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 msgr2=0x7fd1d80c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 0x7fd1d80c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 -- 172.21.15.100:0/2490284283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094b0 con 0x7fd1d80b1410 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d5d9b700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 0x7fd1d80c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.647+0000 7fd1d659c700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8013040 tx=0x7fd1c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80045d0 con 0x7fd1d80b1410 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80036c0 con 0x7fd1d80b1410 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d80c9d10 con 0x7fd1d80b1410 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8003a50 con 0x7fd1d80b1410 2023-11-17T06:30:21.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d80c1d40 con 0x7fd1d80b1410 2023-11-17T06:30:21.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.651+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d80ca230 con 0x7fd1d80b1410 2023-11-17T06:30:21.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.655+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1c8003bb0 con 0x7fd1d80b1410 2023-11-17T06:30:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.655+0000 7fd1c6ffd700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 0x7fd1b80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.655+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1c8085530 con 0x7fd1d80b1410 2023-11-17T06:30:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.655+0000 7fd1d5d9b700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 0x7fd1b80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:21.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.655+0000 7fd1d5d9b700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 0x7fd1b80689d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1d815c990 tx=0x7fd1cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:21.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.659+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1d80ca230 con 0x7fd1d80b1410 2023-11-17T06:30:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1d80ca230 con 0x7fd1d80b1410 2023-11-17T06:30:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1c6ffd700 1 -- 172.21.15.100:0/2490284283 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1d80ca230 con 0x7fd1d80b1410 2023-11-17T06:30:21.851 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 msgr2=0x7fd1b80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 0x7fd1b80689d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1d815c990 tx=0x7fd1cc009040 comp rx=0 tx=0).stop 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 msgr2=0x7fd1d8158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.847+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8013040 tx=0x7fd1c8004770 comp rx=0 tx=0).stop 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 shutdown_connections 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d815b250 0x7fd1d80c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d80cad70 0x7fd1d80c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd1b8066510 0x7fd1b80689d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 --2- 172.21.15.100:0/2490284283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d80b1410 0x7fd1d8158aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 >> 172.21.15.100:0/2490284283 conn(0x7fd1d806a450 msgr2=0x7fd1d80ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 shutdown_connections 2023-11-17T06:30:21.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:21.851+0000 7fd1dca63700 1 -- 172.21.15.100:0/2490284283 wait complete. 2023-11-17T06:30:21.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.059+0000 7f0926e23700 1 Processor -- start 2023-11-17T06:30:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.059+0000 7f0926e23700 1 -- start start 2023-11-17T06:30:22.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0926e23700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f092015aec0 0x7f092015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0926e23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0926e23700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200cc400 con 0x7f09200ce7a0 2023-11-17T06:30:22.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0926e23700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200ce380 con 0x7f092015aec0 2023-11-17T06:30:22.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0926e23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200cdcc0 con 0x7f09200b1520 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f091ffff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f09200ce7a0 0x7f09200b0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36734/0 (socket says 172.21.15.100:36734) 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f091ffff700 1 -- 172.21.15.100:0/2070654320 learned_addr learned my addr 172.21.15.100:0/2070654320 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 --2- 172.21.15.100:0/2070654320 >> v2:172.21.15.100:3300/0 conn(0x7f092015aec0 0x7f092015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f09253c0700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 -- 172.21.15.100:0/2070654320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 msgr2=0x7f09200cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:22.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 -- 172.21.15.100:0/2070654320 >> v1:172.21.15.100:6789/0 conn(0x7f09200ce7a0 legacy=0x7f09200b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 -- 172.21.15.100:0/2070654320 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200cdfa0 con 0x7f092015aec0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f091f7fe700 1 -- 172.21.15.100:0/2070654320 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696316073 0 0) 0x7f09200cc400 con 0x7f09200ce7a0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.063+0000 7f0924bbf700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015aec0 0x7f092015b2a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0914009850 tx=0x7f0914009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07c46065bc4f7b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f091f7fe700 1 -- 172.21.15.100:0/2070654320 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914011830 con 0x7f092015aec0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f091f7fe700 1 -- 172.21.15.100:0/2070654320 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0914011990 con 0x7f092015aec0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f091f7fe700 1 -- 172.21.15.100:0/2070654320 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914011d40 con 0x7f092015aec0 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 -- 172.21.15.100:0/2070654320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015aec0 msgr2=0x7f092015b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015aec0 0x7f092015b2a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0914009850 tx=0x7f0914009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 -- 172.21.15.100:0/2070654320 shutdown_connections 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 --2- 172.21.15.100:0/2070654320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015aec0 0x7f092015b2a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 -- 172.21.15.100:0/2070654320 >> 172.21.15.100:0/2070654320 conn(0x7f092006a450 msgr2=0x7f092006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 -- 172.21.15.100:0/2070654320 shutdown_connections 2023-11-17T06:30:22.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.067+0000 7f0926e23700 1 -- 172.21.15.100:0/2070654320 wait complete. 2023-11-17T06:30:22.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 Processor -- start 2023-11-17T06:30:22.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 -- start start 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f092015aec0 0x7f09200b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200b20c0 con 0x7f09200ce7a0 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200bf3f0 con 0x7f092015aec0 2023-11-17T06:30:22.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0926e23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200b4270 con 0x7f09200b1520 2023-11-17T06:30:22.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57012/0 (socket says 172.21.15.100:57012) 2023-11-17T06:30:22.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 -- 172.21.15.100:0/222634163 learned_addr learned my addr 172.21.15.100:0/222634163 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:22.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f0924bbf700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f09253c0700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f092015aec0 0x7f09200b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 -- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 msgr2=0x7f09200c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 -- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f092015aec0 msgr2=0x7f09200b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f092015aec0 0x7f09200b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.071+0000 7f091ffff700 1 -- 172.21.15.100:0/222634163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140094b0 con 0x7f09200ce7a0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f091ffff700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c750 tx=0x7f090c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c005d90 con 0x7f09200ce7a0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0070d0 con 0x7f09200ce7a0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200b4550 con 0x7f09200ce7a0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c007480 con 0x7f09200ce7a0 2023-11-17T06:30:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200b4b10 con 0x7f09200ce7a0 2023-11-17T06:30:22.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.075+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092004eea0 con 0x7f09200ce7a0 2023-11-17T06:30:22.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.079+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f090c0075e0 con 0x7f09200ce7a0 2023-11-17T06:30:22.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.079+0000 7f091d7fa700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 0x7f0904068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.079+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f090c0831e0 con 0x7f09200ce7a0 2023-11-17T06:30:22.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.079+0000 7f0924bbf700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 0x7f0904068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.079+0000 7f0924bbf700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 0x7f0904068a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09140090b0 tx=0x7f0914008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.087+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f090c0506f0 con 0x7f09200ce7a0 2023-11-17T06:30:22.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.259+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09200cd4b0 con 0x7f09200ce7a0 2023-11-17T06:30:22.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.259+0000 7f091d7fa700 1 -- 172.21.15.100:0/222634163 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f090c053d10 con 0x7f09200ce7a0 2023-11-17T06:30:22.263 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:22.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 msgr2=0x7f0904068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 0x7f0904068a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09140090b0 tx=0x7f0914008030 comp rx=0 tx=0).stop 2023-11-17T06:30:22.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 msgr2=0x7f09200b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c750 tx=0x7f090c00ca60 comp rx=0 tx=0).stop 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 shutdown_connections 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f092015aec0 0x7f09200b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0904066540 0x7f0904068a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce7a0 0x7f09200b1b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 --2- 172.21.15.100:0/222634163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09200b1520 0x7f09200c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 >> 172.21.15.100:0/222634163 conn(0x7f092006a450 msgr2=0x7f09200cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 shutdown_connections 2023-11-17T06:30:22.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.263+0000 7f0926e23700 1 -- 172.21.15.100:0/222634163 wait complete. 2023-11-17T06:30:22.290 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:22.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.467+0000 7ff89f59e700 1 Processor -- start 2023-11-17T06:30:22.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.467+0000 7ff89f59e700 1 -- start start 2023-11-17T06:30:22.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89f59e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8a00cd8c0 0x7ff8a00cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89f59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00ce260 con 0x7ff8a00c4b60 2023-11-17T06:30:22.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89f59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00c3b50 con 0x7ff8a01439b0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89f59e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a00c3da0 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff895d9b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8a00cd8c0 0x7ff8a00cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89ed9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff8a00c4b60 0x7ff8a00c5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36738/0 (socket says 172.21.15.100:36738) 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89ed9d700 1 -- 172.21.15.100:0/1547556819 learned_addr learned my addr 172.21.15.100:0/1547556819 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28343576 0 0) 0x7ff8a00ce260 con 0x7ff8a00c4b60 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c0035d0 con 0x7ff8a00c4b60 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234832665 0 0) 0x7ff8a00c3b50 con 0x7ff8a01439b0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff895d9b700 1 -- 172.21.15.100:0/1547556819 >> v1:172.21.15.119:6789/0 conn(0x7ff8a01439b0 legacy=0x7ff8a00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff895d9b700 1 -- 172.21.15.100:0/1547556819 >> v1:172.21.15.100:6789/0 conn(0x7ff8a00c4b60 legacy=0x7ff8a00c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff895d9b700 1 -- 172.21.15.100:0/1547556819 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00c4080 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff895d9b700 1 --2- 172.21.15.100:0/1547556819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a00cdd20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff888009850 tx=0x7ff888009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c57412377ac2d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011830 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888011990 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.471+0000 7ff89dd9b700 1 -- 172.21.15.100:0/1547556819 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011d00 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 -- 172.21.15.100:0/1547556819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 msgr2=0x7ff8a00cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 --2- 172.21.15.100:0/1547556819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a00cdd20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff888009850 tx=0x7ff888009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 -- 172.21.15.100:0/1547556819 shutdown_connections 2023-11-17T06:30:22.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 --2- 172.21.15.100:0/1547556819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a00cdd20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 -- 172.21.15.100:0/1547556819 >> 172.21.15.100:0/1547556819 conn(0x7ff8a00cb730 msgr2=0x7ff8a00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 -- 172.21.15.100:0/1547556819 shutdown_connections 2023-11-17T06:30:22.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.475+0000 7ff89f59e700 1 -- 172.21.15.100:0/1547556819 wait complete. 2023-11-17T06:30:22.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 Processor -- start 2023-11-17T06:30:22.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 -- start start 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a00c4b60 0x7ff8a006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 0x7ff8a00cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a01e3660 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00cd690 con 0x7ff8a00c4b60 2023-11-17T06:30:22.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89f59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a006cf50 con 0x7ff8a01439b0 2023-11-17T06:30:22.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57028/0 (socket says 172.21.15.100:57028) 2023-11-17T06:30:22.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff895d9b700 1 -- 172.21.15.100:0/3368971827 learned_addr learned my addr 172.21.15.100:0/3368971827 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89e59c700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a00c4b60 0x7ff8a006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.479+0000 7ff89ed9d700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 0x7ff8a00cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 -- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 msgr2=0x7ff8a00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 0x7ff8a00cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 -- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a00c4b60 msgr2=0x7ff8a006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a00c4b60 0x7ff8a006c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 -- 172.21.15.100:0/3368971827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880094b0 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff89ed9d700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 0x7ff8a00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff895d9b700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff888013000 tx=0x7ff888004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880045d0 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88801f070 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880038c0 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a006d230 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a006d510 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.483+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a0065e90 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.487+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff888003a20 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.487+0000 7ff8977fe700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 0x7ff880068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.487+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff888021070 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.487+0000 7ff89e59c700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 0x7ff880068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.487+0000 7ff89e59c700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 0x7ff880068a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8a013b7e0 tx=0x7ff890009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.491+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff888052b30 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8a00c4610 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff8977fe700 1 -- 172.21.15.100:0/3368971827 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff888056150 con 0x7ff8a00cd8c0 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 msgr2=0x7ff880068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 0x7ff880068a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8a013b7e0 tx=0x7ff890009040 comp rx=0 tx=0).stop 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 msgr2=0x7ff8a0154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff888013000 tx=0x7ff888004770 comp rx=0 tx=0).stop 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 shutdown_connections 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8a01439b0 0x7ff8a00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.679+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff880066540 0x7ff880068a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.683+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8a00cd8c0 0x7ff8a0154910 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.683+0000 7ff89f59e700 1 --2- 172.21.15.100:0/3368971827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8a00c4b60 0x7ff8a006c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.683+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 >> 172.21.15.100:0/3368971827 conn(0x7ff8a00cb730 msgr2=0x7ff8a00cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.683+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 shutdown_connections 2023-11-17T06:30:22.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.683+0000 7ff89f59e700 1 -- 172.21.15.100:0/3368971827 wait complete. 2023-11-17T06:30:22.689 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:22.707 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:22.707 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:22.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 Processor -- start 2023-11-17T06:30:22.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 -- start start 2023-11-17T06:30:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3dc40cf9e0 0x7f3dc40cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3dc40d1c60 0x7f3dc40d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40d0380 con 0x7f3dc415d1c0 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc41619b0 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc8886700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40d1180 con 0x7f3dc40d1c60 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3dc40cf9e0 0x7f3dc40cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc2d9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3dc415d1c0 0x7f3dc4160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36746/0 (socket says 172.21.15.100:36746) 2023-11-17T06:30:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc2d9d700 1 -- 172.21.15.100:0/2977057053 learned_addr learned my addr 172.21.15.100:0/2977057053 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.943+0000 7f3dc359e700 1 --2- 172.21.15.100:0/2977057053 >> v2:172.21.15.119:3300/0 conn(0x7f3dc40d1c60 0x7f3dc40d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc259c700 1 -- 172.21.15.100:0/2977057053 >> v2:172.21.15.119:3300/0 conn(0x7f3dc40d1c60 msgr2=0x7f3dc40d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc259c700 1 --2- 172.21.15.100:0/2977057053 >> v2:172.21.15.119:3300/0 conn(0x7f3dc40d1c60 0x7f3dc40d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc259c700 1 -- 172.21.15.100:0/2977057053 >> v1:172.21.15.100:6789/0 conn(0x7f3dc415d1c0 legacy=0x7f3dc4160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc1d9b700 1 -- 172.21.15.100:0/2977057053 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085396657 0 0) 0x7f3dc40d0380 con 0x7f3dc415d1c0 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc259c700 1 -- 172.21.15.100:0/2977057053 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40d1460 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc259c700 1 --2- 172.21.15.100:0/2977057053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc40cfe40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40cd5b0 tx=0x7f3db8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178ff2a178c52101 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc1d9b700 1 -- 172.21.15.100:0/2977057053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8011830 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc1d9b700 1 -- 172.21.15.100:0/2977057053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db8011990 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc1d9b700 1 -- 172.21.15.100:0/2977057053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8011d20 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 -- 172.21.15.100:0/2977057053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 msgr2=0x7f3dc40cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 --2- 172.21.15.100:0/2977057053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc40cfe40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40cd5b0 tx=0x7f3db8009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 -- 172.21.15.100:0/2977057053 shutdown_connections 2023-11-17T06:30:22.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 --2- 172.21.15.100:0/2977057053 >> v2:172.21.15.119:3300/0 conn(0x7f3dc40d1c60 0x7f3dc40d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 --2- 172.21.15.100:0/2977057053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc40cfe40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 -- 172.21.15.100:0/2977057053 >> 172.21.15.100:0/2977057053 conn(0x7f3dc40d2fd0 msgr2=0x7f3dc40d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 -- 172.21.15.100:0/2977057053 shutdown_connections 2023-11-17T06:30:22.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.947+0000 7f3dc8886700 1 -- 172.21.15.100:0/2977057053 wait complete. 2023-11-17T06:30:22.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 Processor -- start 2023-11-17T06:30:22.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 -- start start 2023-11-17T06:30:22.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3dc40d1c60 0x7f3dc415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc415d1c0 0x7f3dc40b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415dbd0 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415d5a0 con 0x7f3dc415d1c0 2023-11-17T06:30:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc8886700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41588d0 con 0x7f3dc40d1c60 2023-11-17T06:30:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57038/0 (socket says 172.21.15.100:57038) 2023-11-17T06:30:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 -- 172.21.15.100:0/984073956 learned_addr learned my addr 172.21.15.100:0/984073956 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc359e700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc415d1c0 0x7f3dc40b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc259c700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3dc40d1c60 0x7f3dc415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 -- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3dc40d1c60 msgr2=0x7f3dc415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3dc40d1c60 0x7f3dc415e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 -- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc415d1c0 msgr2=0x7f3dc40b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc415d1c0 0x7f3dc40b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.951+0000 7f3dc2d9d700 1 -- 172.21.15.100:0/984073956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80094b0 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dc2d9d700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c4e0 tx=0x7f3db400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4004ca0 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4004e20 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4007310 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc40b5270 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc415d860 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.955+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc4065e90 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.959+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3db4007470 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.959+0000 7f3dab7fe700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 0x7f3db00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.959+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3db4083bd0 con 0x7f3dc40cf9e0 2023-11-17T06:30:22.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.959+0000 7f3dc259c700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 0x7f3db00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.959+0000 7f3dc259c700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 0x7f3db00689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000c00 tx=0x7f3db8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:22.963+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3db4050fb0 con 0x7f3dc40cf9e0 2023-11-17T06:30:23.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.135+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dc40d1710 con 0x7f3dc40cf9e0 2023-11-17T06:30:23.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dab7fe700 1 -- 172.21.15.100:0/984073956 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f3db4007720 con 0x7f3dc40cf9e0 2023-11-17T06:30:23.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:23.143 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 msgr2=0x7f3db00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 0x7f3db00689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000c00 tx=0x7f3db8008030 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 msgr2=0x7f3dc4158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c4e0 tx=0x7f3db400c7f0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 shutdown_connections 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc415d1c0 0x7f3dc40b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3dc40d1c60 0x7f3dc415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3db0066510 0x7f3db00689d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 --2- 172.21.15.100:0/984073956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dc40cf9e0 0x7f3dc4158390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 >> 172.21.15.100:0/984073956 conn(0x7f3dc40d2fd0 msgr2=0x7f3dc4160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 shutdown_connections 2023-11-17T06:30:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.139+0000 7f3dc8886700 1 -- 172.21.15.100:0/984073956 wait complete. 2023-11-17T06:30:23.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:23.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:23.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.343+0000 7efdb655d700 1 Processor -- start 2023-11-17T06:30:23.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.343+0000 7efdb655d700 1 -- start start 2023-11-17T06:30:23.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb655d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efdb0161590 0x7efdb00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb655d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00c2390 0x7efdb00cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb655d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb00c9810 con 0x7efdb00cf610 2023-11-17T06:30:23.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb655d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb00cd980 con 0x7efdb0161590 2023-11-17T06:30:23.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb655d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00cfac0 con 0x7efdb00c2390 2023-11-17T06:30:23.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efdb0161590 0x7efdb00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb5d5c700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efdb00cf610 0x7efdb0165160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36748/0 (socket says 172.21.15.100:36748) 2023-11-17T06:30:23.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb5d5c700 1 -- 172.21.15.100:0/3064477801 learned_addr learned my addr 172.21.15.100:0/3064477801 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:23.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb4d5a700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00c2390 0x7efdb00cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 -- 172.21.15.100:0/3064477801 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00c2390 msgr2=0x7efdb00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:23.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00c2390 0x7efdb00cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 -- 172.21.15.100:0/3064477801 >> v1:172.21.15.100:6789/0 conn(0x7efdb00cf610 legacy=0x7efdb0165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 -- 172.21.15.100:0/3064477801 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00cd3c0 con 0x7efdb0161590 2023-11-17T06:30:23.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efda7fff700 1 -- 172.21.15.100:0/3064477801 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862218432 0 0) 0x7efdb00c9810 con 0x7efdb00cf610 2023-11-17T06:30:23.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.347+0000 7efdb555b700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb0161590 0x7efdb00ce4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efdac009850 tx=0x7efdac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8577f8bef98a59 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efda7fff700 1 -- 172.21.15.100:0/3064477801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011830 con 0x7efdb0161590 2023-11-17T06:30:23.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efda7fff700 1 -- 172.21.15.100:0/3064477801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac011990 con 0x7efdb0161590 2023-11-17T06:30:23.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efda7fff700 1 -- 172.21.15.100:0/3064477801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011d40 con 0x7efdb0161590 2023-11-17T06:30:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 -- 172.21.15.100:0/3064477801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb0161590 msgr2=0x7efdb00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb0161590 0x7efdb00ce4b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efdac009850 tx=0x7efdac009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 -- 172.21.15.100:0/3064477801 shutdown_connections 2023-11-17T06:30:23.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00c2390 0x7efdb00cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 --2- 172.21.15.100:0/3064477801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb0161590 0x7efdb00ce4b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 -- 172.21.15.100:0/3064477801 >> 172.21.15.100:0/3064477801 conn(0x7efdb006a690 msgr2=0x7efdb006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:23.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 -- 172.21.15.100:0/3064477801 shutdown_connections 2023-11-17T06:30:23.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.351+0000 7efdb655d700 1 -- 172.21.15.100:0/3064477801 wait complete. 2023-11-17T06:30:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.355+0000 7efdb655d700 1 Processor -- start 2023-11-17T06:30:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.355+0000 7efdb655d700 1 -- start start 2023-11-17T06:30:23.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 0x7efdb00c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57058/0 (socket says 172.21.15.100:57058) 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb0161590 0x7efdb01f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c5220 con 0x7efdb00c2390 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c6830 con 0x7efdb0161590 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c6b10 con 0x7efdb00cf610 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 -- 172.21.15.100:0/902627329 learned_addr learned my addr 172.21.15.100:0/902627329 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb4d5a700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 0x7efdb00c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 -- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 msgr2=0x7efdb00c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 0x7efdb00c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 -- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb0161590 msgr2=0x7efdb01f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb0161590 0x7efdb01f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0094b0 con 0x7efdb00c2390 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb4d5a700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 0x7efdb00c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb555b700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdac014040 tx=0x7efdac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac019ab0 con 0x7efdb00c2390 2023-11-17T06:30:23.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac01e070 con 0x7efdb00c2390 2023-11-17T06:30:23.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb00c6df0 con 0x7efdb00c2390 2023-11-17T06:30:23.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.359+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac019e50 con 0x7efdb00c2390 2023-11-17T06:30:23.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.363+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb00c73b0 con 0x7efdb00c2390 2023-11-17T06:30:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.363+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb0067e10 con 0x7efdb00c2390 2023-11-17T06:30:23.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.367+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efdac02d450 con 0x7efdb00c2390 2023-11-17T06:30:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.367+0000 7efda5ffb700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 0x7efd94068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.367+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdac084f00 con 0x7efdb00c2390 2023-11-17T06:30:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.367+0000 7efdb4d5a700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 0x7efd94068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.367+0000 7efdb4d5a700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 0x7efd94068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb0156de0 tx=0x7efda0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.375+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efdac052370 con 0x7efdb00c2390 2023-11-17T06:30:23.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.551+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdb00c75a0 con 0x7efdb00c2390 2023-11-17T06:30:23.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.551+0000 7efda5ffb700 1 -- 172.21.15.100:0/902627329 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdac015020 con 0x7efdb00c2390 2023-11-17T06:30:23.557 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:23.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 msgr2=0x7efd94068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 0x7efd94068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb0156de0 tx=0x7efda0008040 comp rx=0 tx=0).stop 2023-11-17T06:30:23.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 msgr2=0x7efdb00c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdac014040 tx=0x7efdac004770 comp rx=0 tx=0).stop 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 shutdown_connections 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb0161590 0x7efdb01f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efdb00cf610 0x7efdb00c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efd94066540 0x7efd94068a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 --2- 172.21.15.100:0/902627329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00c2390 0x7efdb00c6120 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 >> 172.21.15.100:0/902627329 conn(0x7efdb006a690 msgr2=0x7efdb00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 shutdown_connections 2023-11-17T06:30:23.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.555+0000 7efdb655d700 1 -- 172.21.15.100:0/902627329 wait complete. 2023-11-17T06:30:23.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.751+0000 7f92f5c58700 1 Processor -- start 2023-11-17T06:30:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.751+0000 7f92f5c58700 1 -- start start 2023-11-17T06:30:23.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5c58700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92f015ced0 0x7f92f00d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5c58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015d2b0 0x7f92f00d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5c58700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f0160ce0 con 0x7f92f00cd8b0 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5c58700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f00cdd40 con 0x7f92f015ced0 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5c58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00ce020 con 0x7f92f015d2b0 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92effff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f92f00cd8b0 0x7f92f0161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36754/0 (socket says 172.21.15.100:36754) 2023-11-17T06:30:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92effff700 1 -- 172.21.15.100:0/364824254 learned_addr learned my addr 172.21.15.100:0/364824254 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f4c56700 1 --2- 172.21.15.100:0/364824254 >> v2:172.21.15.119:3300/0 conn(0x7f92f015ced0 0x7f92f00d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.755+0000 7f92f5457700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015d2b0 0x7f92f00d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92ef7fe700 1 -- 172.21.15.100:0/364824254 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235233134 0 0) 0x7f92f0160ce0 con 0x7f92f00cd8b0 2023-11-17T06:30:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92ef7fe700 1 -- 172.21.15.100:0/364824254 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e00035d0 con 0x7f92f00cd8b0 2023-11-17T06:30:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f4c56700 1 -- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015d2b0 msgr2=0x7f92f00d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f4c56700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015d2b0 0x7f92f00d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f4c56700 1 -- 172.21.15.100:0/364824254 >> v1:172.21.15.100:6789/0 conn(0x7f92f00cd8b0 legacy=0x7f92f0161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f4c56700 1 -- 172.21.15.100:0/364824254 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00ce300 con 0x7f92f015ced0 2023-11-17T06:30:23.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f4c56700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015ced0 0x7f92f00d0fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009850 tx=0x7f92e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5544c562d716dc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92ef7fe700 1 -- 172.21.15.100:0/364824254 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011830 con 0x7f92f015ced0 2023-11-17T06:30:23.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92ef7fe700 1 -- 172.21.15.100:0/364824254 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e4011990 con 0x7f92f015ced0 2023-11-17T06:30:23.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92ef7fe700 1 -- 172.21.15.100:0/364824254 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011d40 con 0x7f92f015ced0 2023-11-17T06:30:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 -- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015ced0 msgr2=0x7f92f00d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015ced0 0x7f92f00d0fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009850 tx=0x7f92e4009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 -- 172.21.15.100:0/364824254 shutdown_connections 2023-11-17T06:30:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015d2b0 0x7f92f00d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 --2- 172.21.15.100:0/364824254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015ced0 0x7f92f00d0fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 -- 172.21.15.100:0/364824254 >> 172.21.15.100:0/364824254 conn(0x7f92f006b370 msgr2=0x7f92f006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 -- 172.21.15.100:0/364824254 shutdown_connections 2023-11-17T06:30:23.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.759+0000 7f92f5c58700 1 -- 172.21.15.100:0/364824254 wait complete. 2023-11-17T06:30:23.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 Processor -- start 2023-11-17T06:30:23.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 -- start start 2023-11-17T06:30:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 0x7f92f00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 0x7f92f00cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00cca70 con 0x7f92f014b420 2023-11-17T06:30:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00cbbf0 con 0x7f92f015d2b0 2023-11-17T06:30:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.763+0000 7f92f5c58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00cbe60 con 0x7f92f015ced0 2023-11-17T06:30:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5457700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5457700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57064/0 (socket says 172.21.15.100:57064) 2023-11-17T06:30:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 0x7f92f00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5457700 1 -- 172.21.15.100:0/879948894 learned_addr learned my addr 172.21.15.100:0/879948894 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92effff700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 0x7f92f00cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 -- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 msgr2=0x7f92f00cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 0x7f92f00cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 -- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 msgr2=0x7f92f014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 -- 172.21.15.100:0/879948894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40094b0 con 0x7f92f015ced0 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5457700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92effff700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 0x7f92f00cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f4c56700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 0x7f92f00cb170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e4016000 tx=0x7f92e4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4004590 con 0x7f92f015ced0 2023-11-17T06:30:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40036c0 con 0x7f92f015ced0 2023-11-17T06:30:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4003a50 con 0x7f92f015ced0 2023-11-17T06:30:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f00cc140 con 0x7f92f015ced0 2023-11-17T06:30:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.767+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00cc700 con 0x7f92f015ced0 2023-11-17T06:30:23.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.771+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f00c8220 con 0x7f92f015ced0 2023-11-17T06:30:23.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.771+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92e4003bb0 con 0x7f92f015ced0 2023-11-17T06:30:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.771+0000 7f92ed7fa700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 0x7f92d4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.771+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92e4021030 con 0x7f92f015ced0 2023-11-17T06:30:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.771+0000 7f92effff700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 0x7f92d4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.775+0000 7f92effff700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 0x7f92d4068a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f92f006c230 tx=0x7f92dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:23.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.783+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92e4052c40 con 0x7f92f015ced0 2023-11-17T06:30:23.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.963+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92f00b9060 con 0x7f92f015ced0 2023-11-17T06:30:23.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.967+0000 7f92ed7fa700 1 -- 172.21.15.100:0/879948894 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92e4003e60 con 0x7f92f015ced0 2023-11-17T06:30:23.971 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.967+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 msgr2=0x7f92d4068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.967+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 0x7f92d4068a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f92f006c230 tx=0x7f92dc009040 comp rx=0 tx=0).stop 2023-11-17T06:30:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.967+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 msgr2=0x7f92f00cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.967+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 0x7f92f00cb170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e4016000 tx=0x7f92e4004770 comp rx=0 tx=0).stop 2023-11-17T06:30:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 shutdown_connections 2023-11-17T06:30:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92d4066560 0x7f92d4068a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92f014b420 0x7f92f014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92f015d2b0 0x7f92f00cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 --2- 172.21.15.100:0/879948894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92f015ced0 0x7f92f00cb170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 >> 172.21.15.100:0/879948894 conn(0x7f92f006b370 msgr2=0x7f92f00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 shutdown_connections 2023-11-17T06:30:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:23.971+0000 7f92f5c58700 1 -- 172.21.15.100:0/879948894 wait complete. 2023-11-17T06:30:23.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:24.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.163+0000 7f8a55ce1700 1 Processor -- start 2023-11-17T06:30:24.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.163+0000 7f8a55ce1700 1 -- start start 2023-11-17T06:30:24.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a55ce1700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a50160a80 0x7f8a500d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a55ce1700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a500d16f0 0x7f8a500d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a55ce1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500d2090 con 0x7f8a500cdc00 2023-11-17T06:30:24.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a55ce1700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a500b2940 con 0x7f8a50160a80 2023-11-17T06:30:24.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a55ce1700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a500cedb0 con 0x7f8a500d16f0 2023-11-17T06:30:24.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a50160a80 0x7f8a500d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a554e0700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8a500cdc00 0x7f8a500ce070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36766/0 (socket says 172.21.15.100:36766) 2023-11-17T06:30:24.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a554e0700 1 -- 172.21.15.100:0/3941905795 learned_addr learned my addr 172.21.15.100:0/3941905795 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:24.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a4ffff700 1 --2- 172.21.15.100:0/3941905795 >> v2:172.21.15.119:3300/0 conn(0x7f8a500d16f0 0x7f8a500d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 -- 172.21.15.100:0/3941905795 >> v2:172.21.15.119:3300/0 conn(0x7f8a500d16f0 msgr2=0x7f8a500d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:24.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 --2- 172.21.15.100:0/3941905795 >> v2:172.21.15.119:3300/0 conn(0x7f8a500d16f0 0x7f8a500d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 -- 172.21.15.100:0/3941905795 >> v1:172.21.15.100:6789/0 conn(0x7f8a500cdc00 legacy=0x7f8a500ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 -- 172.21.15.100:0/3941905795 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500cf090 con 0x7f8a50160a80 2023-11-17T06:30:24.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a54cdf700 1 --2- 172.21.15.100:0/3941905795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a50160a80 0x7f8a500d3bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a5008b370 tx=0x7f8a44009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a91bda96230450e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a4f7fe700 1 -- 172.21.15.100:0/3941905795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011830 con 0x7f8a50160a80 2023-11-17T06:30:24.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a4f7fe700 1 -- 172.21.15.100:0/3941905795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a44011990 con 0x7f8a50160a80 2023-11-17T06:30:24.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.167+0000 7f8a4f7fe700 1 -- 172.21.15.100:0/3941905795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011d20 con 0x7f8a50160a80 2023-11-17T06:30:24.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 -- 172.21.15.100:0/3941905795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a50160a80 msgr2=0x7f8a500d3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/3941905795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a50160a80 0x7f8a500d3bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a5008b370 tx=0x7f8a44009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 -- 172.21.15.100:0/3941905795 shutdown_connections 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/3941905795 >> v2:172.21.15.119:3300/0 conn(0x7f8a500d16f0 0x7f8a500d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/3941905795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a50160a80 0x7f8a500d3bc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 -- 172.21.15.100:0/3941905795 >> 172.21.15.100:0/3941905795 conn(0x7f8a5009c420 msgr2=0x7f8a500d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 -- 172.21.15.100:0/3941905795 shutdown_connections 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.171+0000 7f8a55ce1700 1 -- 172.21.15.100:0/3941905795 wait complete. 2023-11-17T06:30:24.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 Processor -- start 2023-11-17T06:30:24.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 -- start start 2023-11-17T06:30:24.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a500d16f0 0x7f8a5015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a50160a80 0x7f8a500afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ca1c0 con 0x7f8a500cdc00 2023-11-17T06:30:24.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b62d0 con 0x7f8a50160a80 2023-11-17T06:30:24.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a55ce1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b65b0 con 0x7f8a500d16f0 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.175+0000 7f8a54cdf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57086/0 (socket says 172.21.15.100:57086) 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 -- 172.21.15.100:0/2585051580 learned_addr learned my addr 172.21.15.100:0/2585051580 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a554e0700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a50160a80 0x7f8a500afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a4ffff700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a500d16f0 0x7f8a5015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 -- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a500d16f0 msgr2=0x7f8a5015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a500d16f0 0x7f8a5015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 -- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a50160a80 msgr2=0x7f8a500afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a50160a80 0x7f8a500afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 -- 172.21.15.100:0/2585051580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440094b0 con 0x7f8a500cdc00 2023-11-17T06:30:24.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a54cdf700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009b70 tx=0x7f8a44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44004480 con 0x7f8a500cdc00 2023-11-17T06:30:24.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4401f070 con 0x7f8a500cdc00 2023-11-17T06:30:24.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440038e0 con 0x7f8a500cdc00 2023-11-17T06:30:24.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500b6890 con 0x7f8a500cdc00 2023-11-17T06:30:24.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.179+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500b7a20 con 0x7f8a500cdc00 2023-11-17T06:30:24.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.183+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a500ca330 con 0x7f8a500cdc00 2023-11-17T06:30:24.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.183+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8a44021030 con 0x7f8a500cdc00 2023-11-17T06:30:24.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.183+0000 7f8a4d7fa700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 0x7f8a34068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.183+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a44085320 con 0x7f8a500cdc00 2023-11-17T06:30:24.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.183+0000 7f8a4ffff700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 0x7f8a34068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.187+0000 7f8a4ffff700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 0x7f8a34068a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a5006d050 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.191+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8a44052930 con 0x7f8a500cdc00 2023-11-17T06:30:24.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.367+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a50065e90 con 0x7f8a500cdc00 2023-11-17T06:30:24.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.367+0000 7f8a4d7fa700 1 -- 172.21.15.100:0/2585051580 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a44055f50 con 0x7f8a500cdc00 2023-11-17T06:30:24.372 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 msgr2=0x7f8a34068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 0x7f8a34068a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a5006d050 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2023-11-17T06:30:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 msgr2=0x7f8a500b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009b70 tx=0x7f8a44004770 comp rx=0 tx=0).stop 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 shutdown_connections 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a50160a80 0x7f8a500afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a500d16f0 0x7f8a5015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8a34066560 0x7f8a34068a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 --2- 172.21.15.100:0/2585051580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a500cdc00 0x7f8a500b8870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 >> 172.21.15.100:0/2585051580 conn(0x7f8a5009c420 msgr2=0x7f8a5015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 shutdown_connections 2023-11-17T06:30:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.371+0000 7f8a55ce1700 1 -- 172.21.15.100:0/2585051580 wait complete. 2023-11-17T06:30:24.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:24.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.571+0000 7f8465663700 1 Processor -- start 2023-11-17T06:30:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.571+0000 7f8465663700 1 -- start start 2023-11-17T06:30:24.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8465663700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84600cf9e0 0x7f84600cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8465663700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84600d0380 con 0x7f84600d1c60 2023-11-17T06:30:24.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8465663700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84601619b0 con 0x7f846015d1c0 2023-11-17T06:30:24.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8465663700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84600d1180 con 0x7f84600cf9e0 2023-11-17T06:30:24.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8457fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84600cf9e0 0x7f84600cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f845f7fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f84600d1c60 0x7f84600d2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36772/0 (socket says 172.21.15.100:36772) 2023-11-17T06:30:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f845f7fe700 1 -- 172.21.15.100:0/224440300 learned_addr learned my addr 172.21.15.100:0/224440300 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8457fff700 1 -- 172.21.15.100:0/224440300 >> v1:172.21.15.119:6789/0 conn(0x7f846015d1c0 legacy=0x7f8460160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f845e7fc700 1 -- 172.21.15.100:0/224440300 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506279738 0 0) 0x7f84600d0380 con 0x7f84600d1c60 2023-11-17T06:30:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8457fff700 1 -- 172.21.15.100:0/224440300 >> v1:172.21.15.100:6789/0 conn(0x7f84600d1c60 legacy=0x7f84600d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8457fff700 1 -- 172.21.15.100:0/224440300 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600d1460 con 0x7f84600cf9e0 2023-11-17T06:30:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.575+0000 7f8457fff700 1 --2- 172.21.15.100:0/224440300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f84600cfe40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8448009850 tx=0x7f8448009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c307ece36f9bf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f845e7fc700 1 -- 172.21.15.100:0/224440300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011830 con 0x7f84600cf9e0 2023-11-17T06:30:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f845e7fc700 1 -- 172.21.15.100:0/224440300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448011990 con 0x7f84600cf9e0 2023-11-17T06:30:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f845e7fc700 1 -- 172.21.15.100:0/224440300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011d20 con 0x7f84600cf9e0 2023-11-17T06:30:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 -- 172.21.15.100:0/224440300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 msgr2=0x7f84600cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 --2- 172.21.15.100:0/224440300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f84600cfe40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8448009850 tx=0x7f8448009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:24.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 -- 172.21.15.100:0/224440300 shutdown_connections 2023-11-17T06:30:24.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 --2- 172.21.15.100:0/224440300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f84600cfe40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 -- 172.21.15.100:0/224440300 >> 172.21.15.100:0/224440300 conn(0x7f84600d2fd0 msgr2=0x7f84600d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:24.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 -- 172.21.15.100:0/224440300 shutdown_connections 2023-11-17T06:30:24.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.579+0000 7f8465663700 1 -- 172.21.15.100:0/224440300 wait complete. 2023-11-17T06:30:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 Processor -- start 2023-11-17T06:30:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 -- start start 2023-11-17T06:30:24.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84600d1c60 0x7f8460160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f846015d1c0 0x7f8460161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600cad00 con 0x7f84600cf9e0 2023-11-17T06:30:24.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460158c90 con 0x7f846015d1c0 2023-11-17T06:30:24.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8465663700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84600ca0a0 con 0x7f84600d1c60 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f845effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f845effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57102/0 (socket says 172.21.15.100:57102) 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f845effd700 1 -- 172.21.15.100:0/1420384305 learned_addr learned my addr 172.21.15.100:0/1420384305 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f8457fff700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84600d1c60 0x7f8460160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.583+0000 7f845f7fe700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f846015d1c0 0x7f8460161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 -- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84600d1c60 msgr2=0x7f8460160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84600d1c60 0x7f8460160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 -- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f846015d1c0 msgr2=0x7f8460161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f846015d1c0 0x7f8460161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 -- 172.21.15.100:0/1420384305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480094b0 con 0x7f84600cf9e0 2023-11-17T06:30:24.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f845effd700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f845000c530 tx=0x7f845000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000cea0 con 0x7f84600cf9e0 2023-11-17T06:30:24.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84500052d0 con 0x7f84600cf9e0 2023-11-17T06:30:24.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500036a0 con 0x7f84600cf9e0 2023-11-17T06:30:24.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84600ca360 con 0x7f84600cf9e0 2023-11-17T06:30:24.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84600ca920 con 0x7f84600cf9e0 2023-11-17T06:30:24.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.587+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460065e90 con 0x7f84600cf9e0 2023-11-17T06:30:24.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.591+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8450003800 con 0x7f84600cf9e0 2023-11-17T06:30:24.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.591+0000 7f84577fe700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 0x7f84400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.591+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84500831d0 con 0x7f84600cf9e0 2023-11-17T06:30:24.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.591+0000 7f8457fff700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 0x7f84400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.591+0000 7f8457fff700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 0x7f84400689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84480090b0 tx=0x7f8448008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.599+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84500505b0 con 0x7f84600cf9e0 2023-11-17T06:30:24.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.783+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84600d0c00 con 0x7f84600cf9e0 2023-11-17T06:30:24.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.787+0000 7f84577fe700 1 -- 172.21.15.100:0/1420384305 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8450053bd0 con 0x7f84600cf9e0 2023-11-17T06:30:24.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 msgr2=0x7f84400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 0x7f84400689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84480090b0 tx=0x7f8448008030 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 msgr2=0x7f8460158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f845000c530 tx=0x7f845000c840 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 shutdown_connections 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f846015d1c0 0x7f8460161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84600d1c60 0x7f8460160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8440066510 0x7f84400689d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 --2- 172.21.15.100:0/1420384305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84600cf9e0 0x7f8460158750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 >> 172.21.15.100:0/1420384305 conn(0x7f84600d2fd0 msgr2=0x7f84600b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 shutdown_connections 2023-11-17T06:30:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:24.791+0000 7f8465663700 1 -- 172.21.15.100:0/1420384305 wait complete. 2023-11-17T06:30:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:24.819 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:24.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:24.887 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:24.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:30:24.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:24.888 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:30:24.920 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:24.920 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:24.937 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:24.937 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:25.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.179+0000 7fd866006700 1 Processor -- start 2023-11-17T06:30:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 -- start start 2023-11-17T06:30:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8600cc880 0x7fd8600ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8600c4060 0x7fd8600c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600c4a00 0x7fd8600c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86006cf30 con 0x7fd8600c4060 2023-11-17T06:30:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86006c3f0 con 0x7fd8600cc880 2023-11-17T06:30:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd866006700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600cd570 con 0x7fd8600c4a00 2023-11-17T06:30:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd865004700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8600cc880 0x7fd8600ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd865004700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8600cc880 0x7fd8600ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:52478/0 (socket says 172.21.15.100:52478) 2023-11-17T06:30:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd865004700 1 -- 172.21.15.100:0/3890871767 learned_addr learned my addr 172.21.15.100:0/3890871767 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd864803700 1 --2- 172.21.15.100:0/3890871767 >> v2:172.21.15.100:3300/0 conn(0x7fd8600c4060 0x7fd8600c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd865805700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600c4a00 0x7fd8600c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.183+0000 7fd865004700 1 -- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600c4a00 msgr2=0x7fd8600c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd865004700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600c4a00 0x7fd8600c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd865004700 1 -- 172.21.15.100:0/3890871767 >> v2:172.21.15.100:3300/0 conn(0x7fd8600c4060 msgr2=0x7fd8600c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd865004700 1 --2- 172.21.15.100:0/3890871767 >> v2:172.21.15.100:3300/0 conn(0x7fd8600c4060 0x7fd8600c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd865004700 1 -- 172.21.15.100:0/3890871767 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600cd1a0 con 0x7fd8600cc880 2023-11-17T06:30:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd865004700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600cc880 0x7fd8600ccc60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd8600ae820 tx=0x7fd85c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584ff3e3f0eb8d17 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd857fff700 1 -- 172.21.15.100:0/3890871767 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00e070 con 0x7fd8600cc880 2023-11-17T06:30:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd857fff700 1 -- 172.21.15.100:0/3890871767 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00b910 con 0x7fd8600cc880 2023-11-17T06:30:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd857fff700 1 -- 172.21.15.100:0/3890871767 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00bcc0 con 0x7fd8600cc880 2023-11-17T06:30:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 -- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600cc880 msgr2=0x7fd8600ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600cc880 0x7fd8600ccc60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd8600ae820 tx=0x7fd85c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:25.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 -- 172.21.15.100:0/3890871767 shutdown_connections 2023-11-17T06:30:25.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600c4a00 0x7fd8600c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 --2- 172.21.15.100:0/3890871767 >> v2:172.21.15.100:3300/0 conn(0x7fd8600c4060 0x7fd8600c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 --2- 172.21.15.100:0/3890871767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600cc880 0x7fd8600ccc60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 -- 172.21.15.100:0/3890871767 >> 172.21.15.100:0/3890871767 conn(0x7fd8600cb730 msgr2=0x7fd8600cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:25.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 -- 172.21.15.100:0/3890871767 shutdown_connections 2023-11-17T06:30:25.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.187+0000 7fd866006700 1 -- 172.21.15.100:0/3890871767 wait complete. 2023-11-17T06:30:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.191+0000 7fd866006700 1 Processor -- start 2023-11-17T06:30:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.191+0000 7fd866006700 1 -- start start 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600c4a00 0x7fd8600c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600cc880 0x7fd8600c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600c71c0 con 0x7fd8600c4060 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8601f6e60 con 0x7fd8600c4a00 2023-11-17T06:30:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600c65b0 con 0x7fd8600cc880 2023-11-17T06:30:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57120/0 (socket says 172.21.15.100:57120) 2023-11-17T06:30:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 -- 172.21.15.100:0/1839915214 learned_addr learned my addr 172.21.15.100:0/1839915214 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd864803700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600c4a00 0x7fd8600c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865805700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600cc880 0x7fd8600c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 -- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600cc880 msgr2=0x7fd8600c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600cc880 0x7fd8600c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 -- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600c4a00 msgr2=0x7fd8600c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600c4a00 0x7fd8600c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 -- 172.21.15.100:0/1839915214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009b30 con 0x7fd8600c4060 2023-11-17T06:30:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd865004700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd85c003f70 tx=0x7fd85c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c004250 con 0x7fd8600c4060 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0043b0 con 0x7fd8600c4060 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8600c6890 con 0x7fd8600c4060 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c004760 con 0x7fd8600c4060 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.195+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8600c6e50 con 0x7fd8600c4060 2023-11-17T06:30:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.199+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8600cdde0 con 0x7fd8600c4060 2023-11-17T06:30:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.199+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd85c01c440 con 0x7fd8600c4060 2023-11-17T06:30:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.199+0000 7fd855ffb700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 0x7fd8440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.199+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd85c085360 con 0x7fd8600c4060 2023-11-17T06:30:25.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.203+0000 7fd864803700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 0x7fd8440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.203+0000 7fd864803700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 0x7fd8440689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8600b0660 tx=0x7fd850008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.207+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd85c0527f0 con 0x7fd8600c4060 2023-11-17T06:30:25.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.383+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8600cb520 con 0x7fd8600c4060 2023-11-17T06:30:25.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.383+0000 7fd855ffb700 1 -- 172.21.15.100:0/1839915214 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fd85c055e10 con 0x7fd8600c4060 2023-11-17T06:30:25.390 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:25.390 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 msgr2=0x7fd8440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 0x7fd8440689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8600b0660 tx=0x7fd850008040 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 msgr2=0x7fd8601f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd85c003f70 tx=0x7fd85c004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 shutdown_connections 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8600cc880 0x7fd8600c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600c4a00 0x7fd8600c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd844066510 0x7fd8440689d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 --2- 172.21.15.100:0/1839915214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8600c4060 0x7fd8601f6920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 >> 172.21.15.100:0/1839915214 conn(0x7fd8600cb730 msgr2=0x7fd860072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:25.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 shutdown_connections 2023-11-17T06:30:25.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.387+0000 7fd866006700 1 -- 172.21.15.100:0/1839915214 wait complete. 2023-11-17T06:30:25.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:25.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.595+0000 7f29e9cc1700 1 Processor -- start 2023-11-17T06:30:25.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.595+0000 7f29e9cc1700 1 -- start start 2023-11-17T06:30:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e9cc1700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29e415ced0 0x7f29e40d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e9cc1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e4160ce0 con 0x7f29e40cd8b0 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e9cc1700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e40cdd40 con 0x7f29e415d2b0 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e9cc1700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40ce020 con 0x7f29e415ced0 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e3fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f29e40cd8b0 0x7f29e4161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36786/0 (socket says 172.21.15.100:36786) 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e3fff700 1 -- 172.21.15.100:0/249640779 learned_addr learned my addr 172.21.15.100:0/249640779 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e8cbf700 1 --2- 172.21.15.100:0/249640779 >> v2:172.21.15.119:3300/0 conn(0x7f29e415ced0 0x7f29e40d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.599+0000 7f29e8cbf700 1 -- 172.21.15.100:0/249640779 >> v1:172.21.15.119:6789/0 conn(0x7f29e415d2b0 legacy=0x7f29e40d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e8cbf700 1 -- 172.21.15.100:0/249640779 >> v1:172.21.15.100:6789/0 conn(0x7f29e40cd8b0 legacy=0x7f29e4161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e37fe700 1 -- 172.21.15.100:0/249640779 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859334370 0 0) 0x7f29e4160ce0 con 0x7f29e40cd8b0 2023-11-17T06:30:25.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e8cbf700 1 -- 172.21.15.100:0/249640779 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40ce300 con 0x7f29e415ced0 2023-11-17T06:30:25.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e8cbf700 1 --2- 172.21.15.100:0/249640779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415ced0 0x7f29e40d0fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6cbe7070e50c11 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e37fe700 1 -- 172.21.15.100:0/249640779 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8011830 con 0x7f29e415ced0 2023-11-17T06:30:25.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e37fe700 1 -- 172.21.15.100:0/249640779 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8011990 con 0x7f29e415ced0 2023-11-17T06:30:25.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e37fe700 1 -- 172.21.15.100:0/249640779 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8011d20 con 0x7f29e415ced0 2023-11-17T06:30:25.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 -- 172.21.15.100:0/249640779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415ced0 msgr2=0x7f29e40d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/249640779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415ced0 0x7f29e40d0fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:25.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 -- 172.21.15.100:0/249640779 shutdown_connections 2023-11-17T06:30:25.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/249640779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415ced0 0x7f29e40d0fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 -- 172.21.15.100:0/249640779 >> 172.21.15.100:0/249640779 conn(0x7f29e406b370 msgr2=0x7f29e406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:25.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 -- 172.21.15.100:0/249640779 shutdown_connections 2023-11-17T06:30:25.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.603+0000 7f29e9cc1700 1 -- 172.21.15.100:0/249640779 wait complete. 2023-11-17T06:30:25.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.607+0000 7f29e9cc1700 1 Processor -- start 2023-11-17T06:30:25.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.607+0000 7f29e9cc1700 1 -- start start 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 0x7f29e40cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e40cad30 0x7f29e40cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40b52d0 con 0x7f29e415ced0 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40cc5c0 con 0x7f29e415d2b0 2023-11-17T06:30:25.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40ca250 con 0x7f29e40cad30 2023-11-17T06:30:25.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57136/0 (socket says 172.21.15.100:57136) 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 -- 172.21.15.100:0/3732548719 learned_addr learned my addr 172.21.15.100:0/3732548719 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e94c0700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e40cad30 0x7f29e40cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e3fff700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 0x7f29e40cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 -- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e40cad30 msgr2=0x7f29e40cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e40cad30 0x7f29e40cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 -- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 msgr2=0x7f29e40cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 0x7f29e40cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 -- 172.21.15.100:0/3732548719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80094b0 con 0x7f29e415ced0 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e3fff700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 0x7f29e40cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:25.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e8cbf700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80044f0 con 0x7f29e415ced0 2023-11-17T06:30:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d801f070 con 0x7f29e415ced0 2023-11-17T06:30:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e40ca530 con 0x7f29e415ced0 2023-11-17T06:30:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80038e0 con 0x7f29e415ced0 2023-11-17T06:30:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e40cc8a0 con 0x7f29e415ced0 2023-11-17T06:30:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.611+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e40b9060 con 0x7f29e415ced0 2023-11-17T06:30:25.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.615+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f29d8021030 con 0x7f29e415ced0 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.615+0000 7f29e17fa700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 0x7f29c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.615+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29d8085310 con 0x7f29e415ced0 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.615+0000 7f29e3fff700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 0x7f29c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.619+0000 7f29e3fff700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 0x7f29c80689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29e40cb6a0 tx=0x7f29d0007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:25.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.623+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29d80528a0 con 0x7f29e415ced0 2023-11-17T06:30:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.795+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29e40caa50 con 0x7f29e415ced0 2023-11-17T06:30:25.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.795+0000 7f29e17fa700 1 -- 172.21.15.100:0/3732548719 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29e40caa50 con 0x7f29e415ced0 2023-11-17T06:30:25.801 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 msgr2=0x7f29c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 0x7f29c80689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29e40cb6a0 tx=0x7f29d0007e70 comp rx=0 tx=0).stop 2023-11-17T06:30:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 msgr2=0x7f29e41f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8004770 comp rx=0 tx=0).stop 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 shutdown_connections 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e40cad30 0x7f29e40cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e415d2b0 0x7f29e40cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f29c8066510 0x7f29c80689d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 --2- 172.21.15.100:0/3732548719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29e415ced0 0x7f29e41f21b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 >> 172.21.15.100:0/3732548719 conn(0x7f29e406b370 msgr2=0x7f29e415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 shutdown_connections 2023-11-17T06:30:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.799+0000 7f29e9cc1700 1 -- 172.21.15.100:0/3732548719 wait complete. 2023-11-17T06:30:25.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.991+0000 7f81aba1e700 1 Processor -- start 2023-11-17T06:30:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 -- start start 2023-11-17T06:30:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f81a406a980 0x7f81a40b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a415a6c0 0x7f81a40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40c9fa0 con 0x7f81a415dc10 2023-11-17T06:30:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a415d130 con 0x7f81a406a980 2023-11-17T06:30:26.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81aba1e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a415d410 con 0x7f81a415a6c0 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f81a406a980 0x7f81a40b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a8fb9700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f81a415dc10 0x7f81a4159fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36800/0 (socket says 172.21.15.100:36800) 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a8fb9700 1 -- 172.21.15.100:0/908278722 learned_addr learned my addr 172.21.15.100:0/908278722 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a9fbb700 1 --2- 172.21.15.100:0/908278722 >> v2:172.21.15.119:3300/0 conn(0x7f81a415a6c0 0x7f81a40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 -- 172.21.15.100:0/908278722 >> v2:172.21.15.119:3300/0 conn(0x7f81a415a6c0 msgr2=0x7f81a40b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 --2- 172.21.15.100:0/908278722 >> v2:172.21.15.119:3300/0 conn(0x7f81a415a6c0 0x7f81a40b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 -- 172.21.15.100:0/908278722 >> v1:172.21.15.100:6789/0 conn(0x7f81a415dc10 legacy=0x7f81a4159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 -- 172.21.15.100:0/908278722 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a415d6f0 con 0x7f81a406a980 2023-11-17T06:30:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a3fff700 1 -- 172.21.15.100:0/908278722 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874515686 0 0) 0x7f81a40c9fa0 con 0x7f81a415dc10 2023-11-17T06:30:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.995+0000 7f81a97ba700 1 --2- 172.21.15.100:0/908278722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a406a980 0x7f81a40b0b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81a40b1910 tx=0x7f8194009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1669d226a120cb45 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81a3fff700 1 -- 172.21.15.100:0/908278722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011830 con 0x7f81a406a980 2023-11-17T06:30:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81a3fff700 1 -- 172.21.15.100:0/908278722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194011990 con 0x7f81a406a980 2023-11-17T06:30:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81a3fff700 1 -- 172.21.15.100:0/908278722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011d20 con 0x7f81a406a980 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 -- 172.21.15.100:0/908278722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a406a980 msgr2=0x7f81a40b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 --2- 172.21.15.100:0/908278722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a406a980 0x7f81a40b0b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81a40b1910 tx=0x7f8194009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 -- 172.21.15.100:0/908278722 shutdown_connections 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 --2- 172.21.15.100:0/908278722 >> v2:172.21.15.119:3300/0 conn(0x7f81a415a6c0 0x7f81a40b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 --2- 172.21.15.100:0/908278722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a406a980 0x7f81a40b0b40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 -- 172.21.15.100:0/908278722 >> 172.21.15.100:0/908278722 conn(0x7f81a4073810 msgr2=0x7f81a406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 -- 172.21.15.100:0/908278722 shutdown_connections 2023-11-17T06:30:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:25.999+0000 7f81aba1e700 1 -- 172.21.15.100:0/908278722 wait complete. 2023-11-17T06:30:26.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 Processor -- start 2023-11-17T06:30:26.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 -- start start 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a406a980 0x7f81a414ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a415dc10 0x7f81a414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a414b670 con 0x7f81a415a6c0 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40718f0 con 0x7f81a415dc10 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81aba1e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4071bd0 con 0x7f81a406a980 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57158/0 (socket says 172.21.15.100:57158) 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 -- 172.21.15.100:0/3916258121 learned_addr learned my addr 172.21.15.100:0/3916258121 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a97ba700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a406a980 0x7f81a414ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a9fbb700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a415dc10 0x7f81a414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 -- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a406a980 msgr2=0x7f81a414ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a406a980 0x7f81a414ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 -- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a415dc10 msgr2=0x7f81a414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a415dc10 0x7f81a414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.003+0000 7f81a8fb9700 1 -- 172.21.15.100:0/3916258121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940094b0 con 0x7f81a415a6c0 2023-11-17T06:30:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81a8fb9700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f819800c4e0 tx=0x7f819800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198004ca0 con 0x7f81a415a6c0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198004e20 con 0x7f81a415a6c0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198007310 con 0x7f81a415a6c0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4071eb0 con 0x7f81a415a6c0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4071530 con 0x7f81a415a6c0 2023-11-17T06:30:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.007+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a4071750 con 0x7f81a415a6c0 2023-11-17T06:30:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.011+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8198007470 con 0x7f81a415a6c0 2023-11-17T06:30:26.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.011+0000 7f81a1ffb700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 0x7f81900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.011+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8198083a00 con 0x7f81a415a6c0 2023-11-17T06:30:26.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.011+0000 7f81a97ba700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 0x7f81900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.011+0000 7f81a97ba700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 0x7f81900689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81940090b0 tx=0x7f8194008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.015+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81a4071750 con 0x7f81a415a6c0 2023-11-17T06:30:26.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.195+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81a4071750 con 0x7f81a415a6c0 2023-11-17T06:30:26.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.195+0000 7f81a1ffb700 1 -- 172.21.15.100:0/3916258121 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81a4071750 con 0x7f81a415a6c0 2023-11-17T06:30:26.200 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 msgr2=0x7f81900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 0x7f81900689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81940090b0 tx=0x7f8194008030 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 msgr2=0x7f81a414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f819800c4e0 tx=0x7f819800c7f0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 shutdown_connections 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a415dc10 0x7f81a414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8190066510 0x7f81900689d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a415a6c0 0x7f81a414f510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 --2- 172.21.15.100:0/3916258121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a406a980 0x7f81a414ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 >> 172.21.15.100:0/3916258121 conn(0x7f81a4073810 msgr2=0x7f81a406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 shutdown_connections 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.199+0000 7f81aba1e700 1 -- 172.21.15.100:0/3916258121 wait complete. 2023-11-17T06:30:26.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 Processor -- start 2023-11-17T06:30:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 -- start start 2023-11-17T06:30:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 0x7f50480cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5048165460 con 0x7f50480b0d00 2023-11-17T06:30:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5048165740 con 0x7f50480cc5a0 2023-11-17T06:30:26.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f504df62700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50481660e0 con 0x7f50480c1f80 2023-11-17T06:30:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f50477fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f50480b0d00 0x7f50480b10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36812/0 (socket says 172.21.15.100:36812) 2023-11-17T06:30:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f50477fe700 1 -- 172.21.15.100:0/2861426090 learned_addr learned my addr 172.21.15.100:0/2861426090 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.407+0000 7f5047fff700 1 --2- 172.21.15.100:0/2861426090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 0x7f50480cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f5047fff700 1 -- 172.21.15.100:0/2861426090 >> v1:172.21.15.119:6789/0 conn(0x7f50480cc5a0 legacy=0x7f50480ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f5047fff700 1 -- 172.21.15.100:0/2861426090 >> v1:172.21.15.100:6789/0 conn(0x7f50480b0d00 legacy=0x7f50480b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f5047fff700 1 -- 172.21.15.100:0/2861426090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048165a20 con 0x7f50480c1f80 2023-11-17T06:30:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f50467fc700 1 -- 172.21.15.100:0/2861426090 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223879568 0 0) 0x7f5048165740 con 0x7f50480cc5a0 2023-11-17T06:30:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f5047fff700 1 --2- 172.21.15.100:0/2861426090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 0x7f50480cd200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5040009dc0 tx=0x7f504000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ca135bf2550b0b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f50467fc700 1 -- 172.21.15.100:0/2861426090 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000e070 con 0x7f50480c1f80 2023-11-17T06:30:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f50467fc700 1 -- 172.21.15.100:0/2861426090 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000bbd0 con 0x7f50480c1f80 2023-11-17T06:30:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f50467fc700 1 -- 172.21.15.100:0/2861426090 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040012430 con 0x7f50480c1f80 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 -- 172.21.15.100:0/2861426090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 msgr2=0x7f50480cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 --2- 172.21.15.100:0/2861426090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 0x7f50480cd200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5040009dc0 tx=0x7f504000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 -- 172.21.15.100:0/2861426090 shutdown_connections 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 --2- 172.21.15.100:0/2861426090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480c1f80 0x7f50480cd200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 -- 172.21.15.100:0/2861426090 >> 172.21.15.100:0/2861426090 conn(0x7f504806a450 msgr2=0x7f504806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 -- 172.21.15.100:0/2861426090 shutdown_connections 2023-11-17T06:30:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.411+0000 7f504df62700 1 -- 172.21.15.100:0/2861426090 wait complete. 2023-11-17T06:30:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.415+0000 7f504df62700 1 Processor -- start 2023-11-17T06:30:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.415+0000 7f504df62700 1 -- start start 2023-11-17T06:30:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 0x7f504815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480cc5a0 0x7f50480c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504815b950 con 0x7f50480c1f80 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481f7c70 con 0x7f50480b0d00 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c2bf0 con 0x7f50480cc5a0 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57160/0 (socket says 172.21.15.100:57160) 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 -- 172.21.15.100:0/2920718647 learned_addr learned my addr 172.21.15.100:0/2920718647 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f50477fe700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 0x7f504815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5047fff700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480cc5a0 0x7f50480c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 -- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480cc5a0 msgr2=0x7f50480c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480cc5a0 0x7f50480c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 -- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 msgr2=0x7f504815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 0x7f504815b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 -- 172.21.15.100:0/2920718647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009a70 con 0x7f50480c1f80 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f50477fe700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 0x7f504815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f5046ffd700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c450 tx=0x7f503c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0054e0 con 0x7f50480c1f80 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00ce60 con 0x7f50480c1f80 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480c2ed0 con 0x7f50480c1f80 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0038e0 con 0x7f50480c1f80 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.419+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480b2100 con 0x7f50480c1f80 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.423+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480c2a50 con 0x7f50480c1f80 2023-11-17T06:30:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.423+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f503c003a40 con 0x7f50480c1f80 2023-11-17T06:30:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.427+0000 7f502ffff700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 0x7f50340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.427+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f503c0831d0 con 0x7f50480c1f80 2023-11-17T06:30:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.427+0000 7f50477fe700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 0x7f50340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.427+0000 7f50477fe700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 0x7f50340689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5038005930 tx=0x7f5038009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.431+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50480c2a50 con 0x7f50480c1f80 2023-11-17T06:30:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.607+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50480c33f0 con 0x7f50480c1f80 2023-11-17T06:30:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.607+0000 7f502ffff700 1 -- 172.21.15.100:0/2920718647 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f503c017020 con 0x7f50480c1f80 2023-11-17T06:30:26.613 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 msgr2=0x7f50340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 0x7f50340689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5038005930 tx=0x7f5038009040 comp rx=0 tx=0).stop 2023-11-17T06:30:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 msgr2=0x7f50480b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c450 tx=0x7f503c00c760 comp rx=0 tx=0).stop 2023-11-17T06:30:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 shutdown_connections 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50480cc5a0 0x7f50480c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5034066510 0x7f50340689d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50480c1f80 0x7f50480b1bc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 --2- 172.21.15.100:0/2920718647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50480b0d00 0x7f504815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 >> 172.21.15.100:0/2920718647 conn(0x7f504806a450 msgr2=0x7f5048070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 shutdown_connections 2023-11-17T06:30:26.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.611+0000 7f504df62700 1 -- 172.21.15.100:0/2920718647 wait complete. 2023-11-17T06:30:26.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 Processor -- start 2023-11-17T06:30:26.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 -- start start 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59140ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59140c4060 0x7f59140c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59140c4a00 0x7f59140c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591406cf30 con 0x7f59140c4a00 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140c53a0 con 0x7f59140c4060 2023-11-17T06:30:26.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591b3c8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591406c3f0 con 0x7f59140cc880 2023-11-17T06:30:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59140c4a00 0x7f59140c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59140c4a00 0x7f59140c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57176/0 (socket says 172.21.15.100:57176) 2023-11-17T06:30:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 -- 172.21.15.100:0/1438630870 learned_addr learned my addr 172.21.15.100:0/1438630870 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:26.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f5919bc5700 1 --2- 172.21.15.100:0/1438630870 >> v2:172.21.15.119:3300/0 conn(0x7f59140c4060 0x7f59140c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591a3c6700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59140ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 -- 172.21.15.100:0/1438630870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 msgr2=0x7f59140ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59140ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 -- 172.21.15.100:0/1438630870 >> v2:172.21.15.119:3300/0 conn(0x7f59140c4060 msgr2=0x7f59140c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 --2- 172.21.15.100:0/1438630870 >> v2:172.21.15.119:3300/0 conn(0x7f59140c4060 0x7f59140c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 -- 172.21.15.100:0/1438630870 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140cd570 con 0x7f59140c4a00 2023-11-17T06:30:26.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.815+0000 7f591abc7700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4a00 0x7f59140c4e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f591406e5c0 tx=0x7f590c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf52c1f4a73a068 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f59193c4700 1 -- 172.21.15.100:0/1438630870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c00e070 con 0x7f59140c4a00 2023-11-17T06:30:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f59193c4700 1 -- 172.21.15.100:0/1438630870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c00b890 con 0x7f59140c4a00 2023-11-17T06:30:26.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f59193c4700 1 -- 172.21.15.100:0/1438630870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c00bc40 con 0x7f59140c4a00 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 -- 172.21.15.100:0/1438630870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4a00 msgr2=0x7f59140c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4a00 0x7f59140c4e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f591406e5c0 tx=0x7f590c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 -- 172.21.15.100:0/1438630870 shutdown_connections 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4a00 0x7f59140c4e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 --2- 172.21.15.100:0/1438630870 >> v2:172.21.15.119:3300/0 conn(0x7f59140c4060 0x7f59140c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 --2- 172.21.15.100:0/1438630870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59140ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 -- 172.21.15.100:0/1438630870 >> 172.21.15.100:0/1438630870 conn(0x7f59140cb730 msgr2=0x7f59140cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 -- 172.21.15.100:0/1438630870 shutdown_connections 2023-11-17T06:30:26.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.819+0000 7f591b3c8700 1 -- 172.21.15.100:0/1438630870 wait complete. 2023-11-17T06:30:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 Processor -- start 2023-11-17T06:30:26.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 -- start start 2023-11-17T06:30:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59140c4a00 0x7f59141f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59141f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59141f6a70 con 0x7f59140c4060 2023-11-17T06:30:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59141f8430 con 0x7f59140c4a00 2023-11-17T06:30:26.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591b3c8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59141f8710 con 0x7f59140cc880 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57188/0 (socket says 172.21.15.100:57188) 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 -- 172.21.15.100:0/228530202 learned_addr learned my addr 172.21.15.100:0/228530202 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f5919bc5700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59140c4a00 0x7f59141f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591abc7700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59141f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 -- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 msgr2=0x7f59141f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59141f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 -- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59140c4a00 msgr2=0x7f59141f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59140c4a00 0x7f59141f94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 -- 172.21.15.100:0/228530202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009b30 con 0x7f59140c4060 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.823+0000 7f591a3c6700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f591000e870 tx=0x7f591000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100095c0 con 0x7f59140c4060 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910013680 con 0x7f59140c4060 2023-11-17T06:30:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59141f89f0 con 0x7f59140c4060 2023-11-17T06:30:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910013a10 con 0x7f59140c4060 2023-11-17T06:30:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59141f8fb0 con 0x7f59140c4060 2023-11-17T06:30:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59140cdde0 con 0x7f59140c4060 2023-11-17T06:30:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.827+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5910013b70 con 0x7f59140c4060 2023-11-17T06:30:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.831+0000 7f590affd700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 0x7f58f8068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.831+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5910083e00 con 0x7f59140c4060 2023-11-17T06:30:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.831+0000 7f5919bc5700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 0x7f58f8068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.831+0000 7f5919bc5700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 0x7f58f8068a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f59140c5820 tx=0x7f5904009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:26.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:26.835+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5910051260 con 0x7f59140c4060 2023-11-17T06:30:27.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5914065e90 con 0x7f59140c4060 2023-11-17T06:30:27.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f590affd700 1 -- 172.21.15.100:0/228530202 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5910017080 con 0x7f59140c4060 2023-11-17T06:30:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 msgr2=0x7f58f8068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 0x7f58f8068a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f59140c5820 tx=0x7f5904009240 comp rx=0 tx=0).stop 2023-11-17T06:30:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 msgr2=0x7f5914160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f591000e870 tx=0x7f591000eb80 comp rx=0 tx=0).stop 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 shutdown_connections 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59140cc880 0x7f59141f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59140c4a00 0x7f59141f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58f8066560 0x7f58f8068a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 --2- 172.21.15.100:0/228530202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59140c4060 0x7f5914160ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 >> 172.21.15.100:0/228530202 conn(0x7f59140cb730 msgr2=0x7f5914072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 shutdown_connections 2023-11-17T06:30:27.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.023+0000 7f591b3c8700 1 -- 172.21.15.100:0/228530202 wait complete. 2023-11-17T06:30:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:27.052 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:27.052 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:27.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:27.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 Processor -- start 2023-11-17T06:30:27.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 -- start start 2023-11-17T06:30:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 0x7f5834165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5834161d40 0x7f58341621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58340b0a40 0x7f58340b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340b1410 con 0x7f5834161d40 2023-11-17T06:30:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5834165380 con 0x7f58340cf990 2023-11-17T06:30:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f583a38b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340cfd70 con 0x7f58340b0a40 2023-11-17T06:30:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f582b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5834161d40 0x7f58341621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f5833fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 0x7f5834165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f582b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5834161d40 0x7f58341621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57196/0 (socket says 172.21.15.100:57196) 2023-11-17T06:30:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f582b7fe700 1 -- 172.21.15.100:0/874708139 learned_addr learned my addr 172.21.15.100:0/874708139 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.255+0000 7f5838928700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58340b0a40 0x7f58340b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 -- 172.21.15.100:0/874708139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58340b0a40 msgr2=0x7f58340b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58340b0a40 0x7f58340b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 -- 172.21.15.100:0/874708139 >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 msgr2=0x7f5834165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 --2- 172.21.15.100:0/874708139 >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 0x7f5834165d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 -- 172.21.15.100:0/874708139 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834158ce0 con 0x7f5834161d40 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f5833fff700 1 --2- 172.21.15.100:0/874708139 >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 0x7f5834165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f582b7fe700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5834161d40 0x7f58341621c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58340b50b0 tx=0x7f581c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147145665f41d9c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f58337fe700 1 -- 172.21.15.100:0/874708139 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011830 con 0x7f5834161d40 2023-11-17T06:30:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f58337fe700 1 -- 172.21.15.100:0/874708139 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c011990 con 0x7f5834161d40 2023-11-17T06:30:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f58337fe700 1 -- 172.21.15.100:0/874708139 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011d20 con 0x7f5834161d40 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 -- 172.21.15.100:0/874708139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5834161d40 msgr2=0x7f58341621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5834161d40 0x7f58341621c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58340b50b0 tx=0x7f581c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 -- 172.21.15.100:0/874708139 shutdown_connections 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58340b0a40 0x7f58340b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 --2- 172.21.15.100:0/874708139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5834161d40 0x7f58341621c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 --2- 172.21.15.100:0/874708139 >> v2:172.21.15.119:3300/0 conn(0x7f58340cf990 0x7f5834165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 -- 172.21.15.100:0/874708139 >> 172.21.15.100:0/874708139 conn(0x7f583406a270 msgr2=0x7f583406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 -- 172.21.15.100:0/874708139 shutdown_connections 2023-11-17T06:30:27.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.259+0000 7f583a38b700 1 -- 172.21.15.100:0/874708139 wait complete. 2023-11-17T06:30:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.263+0000 7f583a38b700 1 Processor -- start 2023-11-17T06:30:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.263+0000 7f583a38b700 1 -- start start 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58340b0a40 0x7f583415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 0x7f58341f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340b48d0 con 0x7f58340cf990 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340b4cf0 con 0x7f58340b0a40 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583415bd80 con 0x7f5834161d40 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57204/0 (socket says 172.21.15.100:57204) 2023-11-17T06:30:27.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 -- 172.21.15.100:0/3632329529 learned_addr learned my addr 172.21.15.100:0/3632329529 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f5833fff700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58340b0a40 0x7f583415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f5838928700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 0x7f58341f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 -- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 msgr2=0x7f58341f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 0x7f58341f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 -- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58340b0a40 msgr2=0x7f583415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58340b0a40 0x7f583415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 -- 172.21.15.100:0/3632329529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240094b0 con 0x7f58340cf990 2023-11-17T06:30:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f5838928700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 0x7f58341f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f582b7fe700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c004520 con 0x7f58340cf990 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c01e070 con 0x7f58340cf990 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c003900 con 0x7f58340cf990 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c009570 con 0x7f58340cf990 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.267+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58340b3f30 con 0x7f58340cf990 2023-11-17T06:30:27.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.271+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58340b4a10 con 0x7f58340cf990 2023-11-17T06:30:27.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.271+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f581c003a60 con 0x7f58340cf990 2023-11-17T06:30:27.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.275+0000 7f58317fa700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 0x7f58140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.275+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f581c020070 con 0x7f58340cf990 2023-11-17T06:30:27.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.275+0000 7f5833fff700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 0x7f58140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.275+0000 7f5833fff700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 0x7f58140689d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f583415f4c0 tx=0x7f5824008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.279+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58340b4a10 con 0x7f58340cf990 2023-11-17T06:30:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.459+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58340b4a10 con 0x7f58340cf990 2023-11-17T06:30:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.459+0000 7f58317fa700 1 -- 172.21.15.100:0/3632329529 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f58340b4a10 con 0x7f58340cf990 2023-11-17T06:30:27.465 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:27.465 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 msgr2=0x7f58140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 0x7f58140689d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f583415f4c0 tx=0x7f5824008040 comp rx=0 tx=0).stop 2023-11-17T06:30:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 msgr2=0x7f58340b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 shutdown_connections 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5834161d40 0x7f58341f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5814066510 0x7f58140689d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340cf990 0x7f58340b1e90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 --2- 172.21.15.100:0/3632329529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58340b0a40 0x7f583415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 >> 172.21.15.100:0/3632329529 conn(0x7f583406a270 msgr2=0x7f58340cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 shutdown_connections 2023-11-17T06:30:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.463+0000 7f583a38b700 1 -- 172.21.15.100:0/3632329529 wait complete. 2023-11-17T06:30:27.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:27.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.671+0000 7faf694ba700 1 Processor -- start 2023-11-17T06:30:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.671+0000 7faf694ba700 1 -- start start 2023-11-17T06:30:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.671+0000 7faf694ba700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf64160aa0 0x7faf640ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.671+0000 7faf694ba700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faf640d0440 0x7faf640d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640b0520 con 0x7faf640d10f0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640d1ac0 con 0x7faf640d0440 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640b24a0 con 0x7faf64160aa0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faf640d0440 0x7faf640d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf5bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faf640d10f0 0x7faf6406b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36824/0 (socket says 172.21.15.100:36824) 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf5bfff700 1 -- 172.21.15.100:0/3966631095 learned_addr learned my addr 172.21.15.100:0/3966631095 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf62ffd700 1 --2- 172.21.15.100:0/3966631095 >> v2:172.21.15.119:3300/0 conn(0x7faf64160aa0 0x7faf640ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 -- 172.21.15.100:0/3966631095 >> v2:172.21.15.119:3300/0 conn(0x7faf64160aa0 msgr2=0x7faf640ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 --2- 172.21.15.100:0/3966631095 >> v2:172.21.15.119:3300/0 conn(0x7faf64160aa0 0x7faf640ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 -- 172.21.15.100:0/3966631095 >> v1:172.21.15.100:6789/0 conn(0x7faf640d10f0 legacy=0x7faf6406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 -- 172.21.15.100:0/3966631095 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640b1400 con 0x7faf640d0440 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf627fc700 1 -- 172.21.15.100:0/3966631095 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355819217 0 0) 0x7faf640b0520 con 0x7faf640d10f0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf637fe700 1 --2- 172.21.15.100:0/3966631095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf640d0440 0x7faf640d1580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf640d1db0 tx=0x7faf5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80eb5d10b4aaa80d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf627fc700 1 -- 172.21.15.100:0/3966631095 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e070 con 0x7faf640d0440 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf627fc700 1 -- 172.21.15.100:0/3966631095 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00bb90 con 0x7faf640d0440 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf627fc700 1 -- 172.21.15.100:0/3966631095 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012430 con 0x7faf640d0440 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- 172.21.15.100:0/3966631095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf640d0440 msgr2=0x7faf640d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 --2- 172.21.15.100:0/3966631095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf640d0440 0x7faf640d1580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf640d1db0 tx=0x7faf5c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- 172.21.15.100:0/3966631095 shutdown_connections 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 --2- 172.21.15.100:0/3966631095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf640d0440 0x7faf640d1580 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 --2- 172.21.15.100:0/3966631095 >> v2:172.21.15.119:3300/0 conn(0x7faf64160aa0 0x7faf640ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- 172.21.15.100:0/3966631095 >> 172.21.15.100:0/3966631095 conn(0x7faf6408afe0 msgr2=0x7faf6409a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- 172.21.15.100:0/3966631095 shutdown_connections 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.675+0000 7faf694ba700 1 -- 172.21.15.100:0/3966631095 wait complete. 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.679+0000 7faf694ba700 1 Processor -- start 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.679+0000 7faf694ba700 1 -- start start 2023-11-17T06:30:27.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf640d0440 0x7faf64154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 0x7faf6415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c59c0 con 0x7faf64160aa0 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c4d40 con 0x7faf640d10f0 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf694ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c5020 con 0x7faf640d0440 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57220/0 (socket says 172.21.15.100:57220) 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 -- 172.21.15.100:0/3315481039 learned_addr learned my addr 172.21.15.100:0/3315481039 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf5bfff700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 0x7faf6415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf62ffd700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf640d0440 0x7faf64154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 -- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf640d0440 msgr2=0x7faf64154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf640d0440 0x7faf64154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 -- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 msgr2=0x7faf6415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 0x7faf6415c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 -- 172.21.15.100:0/3315481039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009a70 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf5bfff700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 0x7faf6415c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf637fe700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf5c014040 tx=0x7faf5c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012430 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.683+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c020070 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.687+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640c5300 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.687+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c004280 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.687+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf64155510 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.687+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf640c5b00 con 0x7faf64160aa0 2023-11-17T06:30:27.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.687+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faf5c0043e0 con 0x7faf64160aa0 2023-11-17T06:30:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.691+0000 7faf5b7fe700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 0x7faf440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.691+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf5c022070 con 0x7faf64160aa0 2023-11-17T06:30:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.691+0000 7faf62ffd700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 0x7faf440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.691+0000 7faf62ffd700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 0x7faf440689d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf54009a00 tx=0x7faf54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.695+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf5c0534c0 con 0x7faf64160aa0 2023-11-17T06:30:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.867+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf640b0220 con 0x7faf64160aa0 2023-11-17T06:30:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.867+0000 7faf5b7fe700 1 -- 172.21.15.100:0/3315481039 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf5c056ae0 con 0x7faf64160aa0 2023-11-17T06:30:27.872 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 msgr2=0x7faf440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 0x7faf440689d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf54009a00 tx=0x7faf54008040 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 msgr2=0x7faf6406f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf5c014040 tx=0x7faf5c004b40 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 shutdown_connections 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7faf44066510 0x7faf440689d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf64160aa0 0x7faf6406f770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf640d10f0 0x7faf6415c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 --2- 172.21.15.100:0/3315481039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf640d0440 0x7faf64154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 >> 172.21.15.100:0/3315481039 conn(0x7faf6408afe0 msgr2=0x7faf6409a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 shutdown_connections 2023-11-17T06:30:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:27.871+0000 7faf694ba700 1 -- 172.21.15.100:0/3315481039 wait complete. 2023-11-17T06:30:27.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.087+0000 7f5e11975700 1 Processor -- start 2023-11-17T06:30:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.087+0000 7f5e11975700 1 -- start start 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c0d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e0c0cd8b0 0x7f5e0c161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c160ce0 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0cdd40 con 0x7f5e0c0cd8b0 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0ce020 con 0x7f5e0c15ced0 2023-11-17T06:30:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57236/0 (socket says 172.21.15.100:57236) 2023-11-17T06:30:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 -- 172.21.15.100:0/2046570019 learned_addr learned my addr 172.21.15.100:0/2046570019 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0affd700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c0d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0a7fc700 1 --2- 172.21.15.100:0/2046570019 >> v2:172.21.15.119:3300/0 conn(0x7f5e0c0cd8b0 0x7f5e0c161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 -- 172.21.15.100:0/2046570019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 msgr2=0x7f5e0c0d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c0d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 -- 172.21.15.100:0/2046570019 >> v2:172.21.15.119:3300/0 conn(0x7f5e0c0cd8b0 msgr2=0x7f5e0c161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 --2- 172.21.15.100:0/2046570019 >> v2:172.21.15.119:3300/0 conn(0x7f5e0c0cd8b0 0x7f5e0c161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 -- 172.21.15.100:0/2046570019 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0ce300 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0affd700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c0d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e0b7fe700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009e50 tx=0x7f5e0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7833e2874e540a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e09ffb700 1 -- 172.21.15.100:0/2046570019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400e070 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e09ffb700 1 -- 172.21.15.100:0/2046570019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400b980 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e09ffb700 1 -- 172.21.15.100:0/2046570019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400bd30 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 -- 172.21.15.100:0/2046570019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 msgr2=0x7f5e0c1616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.091+0000 7f5e11975700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009e50 tx=0x7f5e0400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- 172.21.15.100:0/2046570019 shutdown_connections 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c1616b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- 172.21.15.100:0/2046570019 >> v2:172.21.15.119:3300/0 conn(0x7f5e0c0cd8b0 0x7f5e0c161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- 172.21.15.100:0/2046570019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c0d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- 172.21.15.100:0/2046570019 >> 172.21.15.100:0/2046570019 conn(0x7f5e0c06b370 msgr2=0x7f5e0c06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- 172.21.15.100:0/2046570019 shutdown_connections 2023-11-17T06:30:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- 172.21.15.100:0/2046570019 wait complete. 2023-11-17T06:30:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 Processor -- start 2023-11-17T06:30:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- start start 2023-11-17T06:30:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e0c0cca00 0x7f5e0c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0cce90 con 0x7f5e0c15d2b0 2023-11-17T06:30:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1f6cf0 con 0x7f5e0c0cca00 2023-11-17T06:30:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e11975700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1f28c0 con 0x7f5e0c15ced0 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.095+0000 7f5e0a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:34840/0 (socket says 172.21.15.100:34840) 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 -- 172.21.15.100:0/2244414737 learned_addr learned my addr 172.21.15.100:0/2244414737 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0b7fe700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e0c0cca00 0x7f5e0c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 -- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e0c0cca00 msgr2=0x7f5e0c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e0c0cca00 0x7f5e0c0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 -- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 msgr2=0x7f5e0c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 -- 172.21.15.100:0/2244414737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009b30 con 0x7f5e0c15ced0 2023-11-17T06:30:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e0affd700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00e870 tx=0x7f5dfc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc013610 con 0x7f5e0c15ced0 2023-11-17T06:30:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc013770 con 0x7f5e0c15ced0 2023-11-17T06:30:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc013b00 con 0x7f5e0c15ced0 2023-11-17T06:30:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c1f2ba0 con 0x7f5e0c15ced0 2023-11-17T06:30:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1f3160 con 0x7f5e0c15ced0 2023-11-17T06:30:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.099+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c065e90 con 0x7f5e0c15ced0 2023-11-17T06:30:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.103+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5dfc013c60 con 0x7f5e0c15ced0 2023-11-17T06:30:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.103+0000 7f5df3fff700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 0x7f5df8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.103+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dfc083d30 con 0x7f5e0c15ced0 2023-11-17T06:30:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.103+0000 7f5e0a7fc700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 0x7f5df8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.107+0000 7f5e0a7fc700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 0x7f5df8068a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b2130 tx=0x7f5e00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.111+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dfc0511a0 con 0x7f5e0c15ced0 2023-11-17T06:30:28.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.283+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e0c1f2a00 con 0x7f5e0c15ced0 2023-11-17T06:30:28.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.283+0000 7f5df3fff700 1 -- 172.21.15.100:0/2244414737 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e0c1f2a00 con 0x7f5e0c15ced0 2023-11-17T06:30:28.290 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 msgr2=0x7f5df8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 0x7f5df8068a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b2130 tx=0x7f5e00008040 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 msgr2=0x7f5e0c1f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00e870 tx=0x7f5dfc00eb80 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 shutdown_connections 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e0c0cca00 0x7f5e0c0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5df8066540 0x7f5df8068a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e0c15d2b0 0x7f5e0c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 --2- 172.21.15.100:0/2244414737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e0c15ced0 0x7f5e0c1f67b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 >> 172.21.15.100:0/2244414737 conn(0x7f5e0c06b370 msgr2=0x7f5e0c0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 shutdown_connections 2023-11-17T06:30:28.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.291+0000 7f5e11975700 1 -- 172.21.15.100:0/2244414737 wait complete. 2023-11-17T06:30:28.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:28.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.499+0000 7fc790de6700 1 Processor -- start 2023-11-17T06:30:28.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.499+0000 7fc790de6700 1 -- start start 2023-11-17T06:30:28.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc790de6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc78c159980 0x7fc78c070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc790de6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c06cb10 0x7fc78c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc790de6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0ccc40 con 0x7fc78c1595a0 2023-11-17T06:30:28.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc790de6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0c9b10 con 0x7fc78c159980 2023-11-17T06:30:28.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc790de6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c9df0 con 0x7fc78c06cb10 2023-11-17T06:30:28.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc78c159980 0x7fc78c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc78c159980 0x7fc78c070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57266/0 (socket says 172.21.15.100:57266) 2023-11-17T06:30:28.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 -- 172.21.15.100:0/3265557222 learned_addr learned my addr 172.21.15.100:0/3265557222 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78b7fe700 1 --1- 172.21.15.100:0/3265557222 >> v1:172.21.15.119:6789/0 conn(0x7fc78c1595a0 0x7fc78c0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:35928/0 (socket says 172.21.15.100:35928) 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78bfff700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c06cb10 0x7fc78c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 -- 172.21.15.100:0/3265557222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c06cb10 msgr2=0x7fc78c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c06cb10 0x7fc78c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 -- 172.21.15.100:0/3265557222 >> v1:172.21.15.119:6789/0 conn(0x7fc78c1595a0 legacy=0x7fc78c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 -- 172.21.15.100:0/3265557222 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0ca0d0 con 0x7fc78c159980 2023-11-17T06:30:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78a7fc700 1 -- 172.21.15.100:0/3265557222 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148306577 0 0) 0x7fc78c0ccc40 con 0x7fc78c1595a0 2023-11-17T06:30:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78affd700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c159980 0x7fc78c070330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc780009910 tx=0x7fc780009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b98b7e9004b709 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78a7fc700 1 -- 172.21.15.100:0/3265557222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000ba60 con 0x7fc78c159980 2023-11-17T06:30:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78a7fc700 1 -- 172.21.15.100:0/3265557222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000bbc0 con 0x7fc78c159980 2023-11-17T06:30:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.503+0000 7fc78a7fc700 1 -- 172.21.15.100:0/3265557222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780009e60 con 0x7fc78c159980 2023-11-17T06:30:28.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 -- 172.21.15.100:0/3265557222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c159980 msgr2=0x7fc78c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c159980 0x7fc78c070330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc780009910 tx=0x7fc780009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:28.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 -- 172.21.15.100:0/3265557222 shutdown_connections 2023-11-17T06:30:28.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c06cb10 0x7fc78c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 --2- 172.21.15.100:0/3265557222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c159980 0x7fc78c070330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 -- 172.21.15.100:0/3265557222 >> 172.21.15.100:0/3265557222 conn(0x7fc78c06a690 msgr2=0x7fc78c06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 -- 172.21.15.100:0/3265557222 shutdown_connections 2023-11-17T06:30:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.507+0000 7fc790de6700 1 -- 172.21.15.100:0/3265557222 wait complete. 2023-11-17T06:30:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 Processor -- start 2023-11-17T06:30:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 -- start start 2023-11-17T06:30:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 0x7fc78c1679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c159980 0x7fc78c1501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c1f2bd0 con 0x7fc78c06cb10 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c167f10 con 0x7fc78c1595a0 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc790de6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0b2980 con 0x7fc78c159980 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57272/0 (socket says 172.21.15.100:57272) 2023-11-17T06:30:28.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 -- 172.21.15.100:0/2881913861 learned_addr learned my addr 172.21.15.100:0/2881913861 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78affd700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 0x7fc78c1679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78bfff700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c159980 0x7fc78c1501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 -- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c159980 msgr2=0x7fc78c1501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c159980 0x7fc78c1501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 -- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 msgr2=0x7fc78c1679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 0x7fc78c1679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 -- 172.21.15.100:0/2881913861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780009570 con 0x7fc78c06cb10 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78affd700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 0x7fc78c1679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.511+0000 7fc78b7fe700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c580 tx=0x7fc77c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c004ca0 con 0x7fc78c06cb10 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c004e20 con 0x7fc78c06cb10 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c0b2c60 con 0x7fc78c06cb10 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c007310 con 0x7fc78c06cb10 2023-11-17T06:30:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c0b3220 con 0x7fc78c06cb10 2023-11-17T06:30:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c067e10 con 0x7fc78c06cb10 2023-11-17T06:30:28.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.515+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc77c007470 con 0x7fc78c06cb10 2023-11-17T06:30:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.519+0000 7fc773fff700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 0x7fc7780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.519+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc77c083c80 con 0x7fc78c06cb10 2023-11-17T06:30:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.519+0000 7fc78affd700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 0x7fc7780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.519+0000 7fc78affd700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 0x7fc7780689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc78c06eb40 tx=0x7fc780008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.523+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc77c051080 con 0x7fc78c06cb10 2023-11-17T06:30:28.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.703+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc78c065e90 con 0x7fc78c06cb10 2023-11-17T06:30:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc773fff700 1 -- 172.21.15.100:0/2881913861 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc77c007720 con 0x7fc78c06cb10 2023-11-17T06:30:28.710 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 msgr2=0x7fc7780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 0x7fc7780689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc78c06eb40 tx=0x7fc780008030 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 msgr2=0x7fc78c0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c580 tx=0x7fc77c00c940 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 shutdown_connections 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc78c159980 0x7fc78c1501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc78c1595a0 0x7fc78c1679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc778066510 0x7fc7780689d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 --2- 172.21.15.100:0/2881913861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc78c06cb10 0x7fc78c0b22a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 >> 172.21.15.100:0/2881913861 conn(0x7fc78c06a690 msgr2=0x7fc78c0709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 shutdown_connections 2023-11-17T06:30:28.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.707+0000 7fc790de6700 1 -- 172.21.15.100:0/2881913861 wait complete. 2023-11-17T06:30:28.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.915+0000 7f76d9839700 1 Processor -- start 2023-11-17T06:30:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.915+0000 7f76d9839700 1 -- start start 2023-11-17T06:30:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.915+0000 7f76d9839700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d40d1760 0x7f76d40cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.915+0000 7f76d9839700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40cfa50 0x7f76d40cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.915+0000 7f76d9839700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d40cfeb0 con 0x7f76d415b240 2023-11-17T06:30:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40d1bc0 con 0x7f76d40cfa50 2023-11-17T06:30:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40b2260 con 0x7f76d40d1760 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40cfa50 0x7f76d40cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40cfa50 0x7f76d40cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57274/0 (socket says 172.21.15.100:57274) 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 -- 172.21.15.100:0/3786758131 learned_addr learned my addr 172.21.15.100:0/3786758131 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d2ffd700 1 --1- 172.21.15.100:0/3786758131 >> v1:172.21.15.119:6789/0 conn(0x7f76d415b240 0x7f76d40b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:35942/0 (socket says 172.21.15.100:35942) 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d27fc700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d40d1760 0x7f76d40cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 -- 172.21.15.100:0/3786758131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d40d1760 msgr2=0x7f76d40cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d40d1760 0x7f76d40cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 -- 172.21.15.100:0/3786758131 >> v1:172.21.15.119:6789/0 conn(0x7f76d415b240 legacy=0x7f76d40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 -- 172.21.15.100:0/3786758131 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40b2540 con 0x7f76d40cfa50 2023-11-17T06:30:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d37fe700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cfa50 0x7f76d40cc2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009e50 tx=0x7f76cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca48cfd5bb9dc2e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d1ffb700 1 -- 172.21.15.100:0/3786758131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00e070 con 0x7f76d40cfa50 2023-11-17T06:30:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d1ffb700 1 -- 172.21.15.100:0/3786758131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00b910 con 0x7f76d40cfa50 2023-11-17T06:30:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d1ffb700 1 -- 172.21.15.100:0/3786758131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00bcc0 con 0x7f76d40cfa50 2023-11-17T06:30:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- 172.21.15.100:0/3786758131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cfa50 msgr2=0x7f76d40cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cfa50 0x7f76d40cc2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009e50 tx=0x7f76cc00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- 172.21.15.100:0/3786758131 shutdown_connections 2023-11-17T06:30:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cfa50 0x7f76d40cc2d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 --2- 172.21.15.100:0/3786758131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d40d1760 0x7f76d40cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- 172.21.15.100:0/3786758131 >> 172.21.15.100:0/3786758131 conn(0x7f76d406aca0 msgr2=0x7f76d409a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- 172.21.15.100:0/3786758131 shutdown_connections 2023-11-17T06:30:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.919+0000 7f76d9839700 1 -- 172.21.15.100:0/3786758131 wait complete. 2023-11-17T06:30:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.923+0000 7f76d9839700 1 Processor -- start 2023-11-17T06:30:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.923+0000 7f76d9839700 1 -- start start 2023-11-17T06:30:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 0x7f76d41f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d415b240 0x7f76d40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415d190 con 0x7f76d40d1760 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415d470 con 0x7f76d40cfa50 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415d750 con 0x7f76d415b240 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57280/0 (socket says 172.21.15.100:57280) 2023-11-17T06:30:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 -- 172.21.15.100:0/1734592017 learned_addr learned my addr 172.21.15.100:0/1734592017 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d37fe700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d415b240 0x7f76d40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d2ffd700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 0x7f76d41f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 -- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d415b240 msgr2=0x7f76d40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d415b240 0x7f76d40cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 -- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 msgr2=0x7f76d41f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 0x7f76d41f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 -- 172.21.15.100:0/1734592017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009b30 con 0x7f76d40d1760 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d2ffd700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 0x7f76d41f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d27fc700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76c800e840 tx=0x7f76c800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c80095a0 con 0x7f76d40d1760 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800c690 con 0x7f76d40d1760 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d415da30 con 0x7f76d40d1760 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800ca00 con 0x7f76d40d1760 2023-11-17T06:30:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.927+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d41f3020 con 0x7f76d40d1760 2023-11-17T06:30:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.931+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d404eea0 con 0x7f76d40d1760 2023-11-17T06:30:28.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.931+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76c800cb60 con 0x7f76d40d1760 2023-11-17T06:30:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.931+0000 7f76bbfff700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 0x7f76c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.931+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76c8083e10 con 0x7f76d40d1760 2023-11-17T06:30:28.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.935+0000 7f76d2ffd700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 0x7f76c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.935+0000 7f76d2ffd700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 0x7f76c00689d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000fb0 tx=0x7f76c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:28.939+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76c8087030 con 0x7f76d40d1760 2023-11-17T06:30:29.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.119+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76d40cbd80 con 0x7f76d40d1760 2023-11-17T06:30:29.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76bbfff700 1 -- 172.21.15.100:0/1734592017 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76c8051280 con 0x7f76d40d1760 2023-11-17T06:30:29.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 msgr2=0x7f76c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 0x7f76c00689d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000fb0 tx=0x7f76c4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 msgr2=0x7f76d415c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76c800e840 tx=0x7f76c800ec00 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 shutdown_connections 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76d415b240 0x7f76d40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f76c0066510 0x7f76c00689d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40d1760 0x7f76d415c820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 --2- 172.21.15.100:0/1734592017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40cfa50 0x7f76d41f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 >> 172.21.15.100:0/1734592017 conn(0x7f76d406aca0 msgr2=0x7f76d406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 shutdown_connections 2023-11-17T06:30:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.123+0000 7f76d9839700 1 -- 172.21.15.100:0/1734592017 wait complete. 2023-11-17T06:30:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:29.151 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-11-17T06:30:29.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:29.152 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:29.214 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:29.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:30:29.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:29.215 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-17T06:30:29.256 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:29.256 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:29.274 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:29.274 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:29.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:29.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.567+0000 7fca9f876700 1 Processor -- start 2023-11-17T06:30:29.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 -- start start 2023-11-17T06:30:29.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca980cf990 0x7fca98165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca980b1150 0x7fca981621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980cfd70 con 0x7fca98161d40 2023-11-17T06:30:29.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca98165380 con 0x7fca980cf990 2023-11-17T06:30:29.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9f876700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca98158ce0 con 0x7fca980b1150 2023-11-17T06:30:29.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9d612700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca980cf990 0x7fca98165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9d612700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca980cf990 0x7fca98165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57290/0 (socket says 172.21.15.100:57290) 2023-11-17T06:30:29.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9d612700 1 -- 172.21.15.100:0/2460039644 learned_addr learned my addr 172.21.15.100:0/2460039644 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:29.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.571+0000 7fca9de13700 1 --2- 172.21.15.100:0/2460039644 >> v2:172.21.15.119:3300/0 conn(0x7fca980b1150 0x7fca981621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9d612700 1 -- 172.21.15.100:0/2460039644 >> v2:172.21.15.119:3300/0 conn(0x7fca980b1150 msgr2=0x7fca981621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9d612700 1 --2- 172.21.15.100:0/2460039644 >> v2:172.21.15.119:3300/0 conn(0x7fca980b1150 0x7fca981621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9d612700 1 -- 172.21.15.100:0/2460039644 >> v1:172.21.15.119:6789/0 conn(0x7fca98161d40 legacy=0x7fca980b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9d612700 1 -- 172.21.15.100:0/2460039644 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca981662d0 con 0x7fca980cf990 2023-11-17T06:30:29.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9d612700 1 --2- 172.21.15.100:0/2460039644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980cf990 0x7fca98165d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca9815c3e0 tx=0x7fca9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d7d9ab18c92f9a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca8ffff700 1 -- 172.21.15.100:0/2460039644 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400e070 con 0x7fca980cf990 2023-11-17T06:30:29.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca8ffff700 1 -- 172.21.15.100:0/2460039644 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400b9c0 con 0x7fca980cf990 2023-11-17T06:30:29.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca8ffff700 1 -- 172.21.15.100:0/2460039644 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400bd70 con 0x7fca980cf990 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 -- 172.21.15.100:0/2460039644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980cf990 msgr2=0x7fca98165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 --2- 172.21.15.100:0/2460039644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980cf990 0x7fca98165d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca9815c3e0 tx=0x7fca9400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 -- 172.21.15.100:0/2460039644 shutdown_connections 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 --2- 172.21.15.100:0/2460039644 >> v2:172.21.15.119:3300/0 conn(0x7fca980b1150 0x7fca981621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 --2- 172.21.15.100:0/2460039644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980cf990 0x7fca98165d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 -- 172.21.15.100:0/2460039644 >> 172.21.15.100:0/2460039644 conn(0x7fca9806a270 msgr2=0x7fca9806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 -- 172.21.15.100:0/2460039644 shutdown_connections 2023-11-17T06:30:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.575+0000 7fca9f876700 1 -- 172.21.15.100:0/2460039644 wait complete. 2023-11-17T06:30:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 Processor -- start 2023-11-17T06:30:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 -- start start 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 0x7fca98158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca98161d40 0x7fca980ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9815a2f0 con 0x7fca980b1150 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca981596e0 con 0x7fca98161d40 2023-11-17T06:30:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9f876700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca981599c0 con 0x7fca980cf990 2023-11-17T06:30:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9d612700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9d612700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57292/0 (socket says 172.21.15.100:57292) 2023-11-17T06:30:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9d612700 1 -- 172.21.15.100:0/2708238064 learned_addr learned my addr 172.21.15.100:0/2708238064 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.579+0000 7fca9de13700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca98161d40 0x7fca980ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9ce11700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 0x7fca98158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 -- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 msgr2=0x7fca98158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 0x7fca98158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 -- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca98161d40 msgr2=0x7fca980ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca98161d40 0x7fca980ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 -- 172.21.15.100:0/2708238064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009b30 con 0x7fca980b1150 2023-11-17T06:30:29.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9ce11700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 0x7fca98158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9d612700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca980b16c0 tx=0x7fca94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94004310 con 0x7fca980b1150 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94004470 con 0x7fca980b1150 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94004820 con 0x7fca980b1150 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca98159ca0 con 0x7fca980b1150 2023-11-17T06:30:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca981593f0 con 0x7fca980b1150 2023-11-17T06:30:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.583+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98073ce0 con 0x7fca980b1150 2023-11-17T06:30:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.587+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca9401c440 con 0x7fca980b1150 2023-11-17T06:30:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.587+0000 7fca8dffb700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 0x7fca7c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.587+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca94085470 con 0x7fca980b1150 2023-11-17T06:30:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.587+0000 7fca9ce11700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 0x7fca7c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.587+0000 7fca9ce11700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 0x7fca7c068a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca980c9c80 tx=0x7fca88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.595+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca94052860 con 0x7fca980b1150 2023-11-17T06:30:29.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.771+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca9804eea0 con 0x7fca980b1150 2023-11-17T06:30:29.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.771+0000 7fca8dffb700 1 -- 172.21.15.100:0/2708238064 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fca94055e80 con 0x7fca980b1150 2023-11-17T06:30:29.778 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:29.778 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:29.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 msgr2=0x7fca7c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 0x7fca7c068a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca980c9c80 tx=0x7fca88009040 comp rx=0 tx=0).stop 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 msgr2=0x7fca9815b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca980b16c0 tx=0x7fca94004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 shutdown_connections 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca98161d40 0x7fca980ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca980cf990 0x7fca98158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca7c066540 0x7fca7c068a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 --2- 172.21.15.100:0/2708238064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca980b1150 0x7fca9815b060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 >> 172.21.15.100:0/2708238064 conn(0x7fca9806a270 msgr2=0x7fca9806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 shutdown_connections 2023-11-17T06:30:29.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.775+0000 7fca9f876700 1 -- 172.21.15.100:0/2708238064 wait complete. 2023-11-17T06:30:29.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:29.803 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.967+0000 7fa00bfff700 1 Processor -- start 2023-11-17T06:30:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.967+0000 7fa00bfff700 1 -- start start 2023-11-17T06:30:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa00c1589d0 0x7fa00c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa00c0b1b70 0x7fa00c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0b23c0 con 0x7fa00c15efb0 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0b3040 con 0x7fa00c1589d0 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c15f420 con 0x7fa00c0b1b70 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa00c1589d0 0x7fa00c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa00c1589d0 0x7fa00c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57304/0 (socket says 172.21.15.100:57304) 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 -- 172.21.15.100:0/2620261045 learned_addr learned my addr 172.21.15.100:0/2620261045 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa0027fc700 1 --2- 172.21.15.100:0/2620261045 >> v2:172.21.15.119:3300/0 conn(0x7fa00c0b1b70 0x7fa00c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 -- 172.21.15.100:0/2620261045 >> v2:172.21.15.119:3300/0 conn(0x7fa00c0b1b70 msgr2=0x7fa00c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 --2- 172.21.15.100:0/2620261045 >> v2:172.21.15.119:3300/0 conn(0x7fa00c0b1b70 0x7fa00c15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 -- 172.21.15.100:0/2620261045 >> v1:172.21.15.119:6789/0 conn(0x7fa00c15efb0 legacy=0x7fa00c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 -- 172.21.15.100:0/2620261045 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0b26a0 con 0x7fa00c1589d0 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00affd700 1 --2- 172.21.15.100:0/2620261045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c06ce90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa00c15fb90 tx=0x7f9ffc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f7a4d15eeeea52 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00a7fc700 1 -- 172.21.15.100:0/2620261045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc011830 con 0x7fa00c1589d0 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00a7fc700 1 -- 172.21.15.100:0/2620261045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc011990 con 0x7fa00c1589d0 2023-11-17T06:30:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00a7fc700 1 -- 172.21.15.100:0/2620261045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc011d40 con 0x7fa00c1589d0 2023-11-17T06:30:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 -- 172.21.15.100:0/2620261045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 msgr2=0x7fa00c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.971+0000 7fa00bfff700 1 --2- 172.21.15.100:0/2620261045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c06ce90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa00c15fb90 tx=0x7f9ffc009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 -- 172.21.15.100:0/2620261045 shutdown_connections 2023-11-17T06:30:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 --2- 172.21.15.100:0/2620261045 >> v2:172.21.15.119:3300/0 conn(0x7fa00c0b1b70 0x7fa00c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 --2- 172.21.15.100:0/2620261045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c06ce90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 -- 172.21.15.100:0/2620261045 >> 172.21.15.100:0/2620261045 conn(0x7fa00c06a270 msgr2=0x7fa00c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 -- 172.21.15.100:0/2620261045 shutdown_connections 2023-11-17T06:30:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 -- 172.21.15.100:0/2620261045 wait complete. 2023-11-17T06:30:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 Processor -- start 2023-11-17T06:30:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.975+0000 7fa00bfff700 1 -- start start 2023-11-17T06:30:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa00c0b1b70 0x7fa00c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa00c15efb0 0x7fa00c0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1562a0 con 0x7fa00c1589d0 2023-11-17T06:30:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c13f8b0 con 0x7fa00c0b1b70 2023-11-17T06:30:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c155a00 con 0x7fa00c15efb0 2023-11-17T06:30:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57308/0 (socket says 172.21.15.100:57308) 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 -- 172.21.15.100:0/3979463742 learned_addr learned my addr 172.21.15.100:0/3979463742 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00affd700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa00c0b1b70 0x7fa00c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00b7fe700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa00c15efb0 0x7fa00c0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 -- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa00c15efb0 msgr2=0x7fa00c0af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa00c15efb0 0x7fa00c0af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 -- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa00c0b1b70 msgr2=0x7fa00c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa00c0b1b70 0x7fa00c13f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 -- 172.21.15.100:0/3979463742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc009570 con 0x7fa00c1589d0 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa0027fc700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400efc0 tx=0x7f9ff400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4009ea0 con 0x7fa00c1589d0 2023-11-17T06:30:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400f040 con 0x7fa00c1589d0 2023-11-17T06:30:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4014480 con 0x7fa00c1589d0 2023-11-17T06:30:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c155ce0 con 0x7fa00c1589d0 2023-11-17T06:30:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.979+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0cddf0 con 0x7fa00c1589d0 2023-11-17T06:30:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.983+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c061eb0 con 0x7fa00c1589d0 2023-11-17T06:30:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.983+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ff40145e0 con 0x7fa00c1589d0 2023-11-17T06:30:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.983+0000 7fa003fff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.983+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ff4084790 con 0x7fa00c1589d0 2023-11-17T06:30:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.983+0000 7fa00affd700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.987+0000 7fa00affd700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:29.991+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ff4051c10 con 0x7fa00c1589d0 2023-11-17T06:30:30.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.163+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa00c0ad0b0 con 0x7fa00c1589d0 2023-11-17T06:30:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.163+0000 7fa003fff700 1 -- 172.21.15.100:0/3979463742 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ff4018020 con 0x7fa00c1589d0 2023-11-17T06:30:30.168 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 msgr2=0x7f9fec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc008030 comp rx=0 tx=0).stop 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 msgr2=0x7fa00c155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400efc0 tx=0x7f9ff400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 shutdown_connections 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa00c15efb0 0x7fa00c0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa00c1589d0 0x7fa00c155140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 --2- 172.21.15.100:0/3979463742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa00c0b1b70 0x7fa00c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 >> 172.21.15.100:0/3979463742 conn(0x7fa00c06a270 msgr2=0x7fa00c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 shutdown_connections 2023-11-17T06:30:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.167+0000 7fa00bfff700 1 -- 172.21.15.100:0/3979463742 wait complete. 2023-11-17T06:30:30.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.371+0000 7fd61759e700 1 Processor -- start 2023-11-17T06:30:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 -- start start 2023-11-17T06:30:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd618070560 0x7fd6180cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd61815b230 0x7fd6180cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6180cc580 con 0x7fd61815ae50 2023-11-17T06:30:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6180cba00 con 0x7fd61815b230 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd61759e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6180cbce0 con 0x7fd618070560 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd61815b230 0x7fd6180cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd61815b230 0x7fd6180cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57316/0 (socket says 172.21.15.100:57316) 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 -- 172.21.15.100:0/1185714491 learned_addr learned my addr 172.21.15.100:0/1185714491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd615d9b700 1 --2- 172.21.15.100:0/1185714491 >> v2:172.21.15.119:3300/0 conn(0x7fd618070560 0x7fd6180cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 -- 172.21.15.100:0/1185714491 >> v2:172.21.15.119:3300/0 conn(0x7fd618070560 msgr2=0x7fd6180cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 --2- 172.21.15.100:0/1185714491 >> v2:172.21.15.119:3300/0 conn(0x7fd618070560 0x7fd6180cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 -- 172.21.15.100:0/1185714491 >> v1:172.21.15.119:6789/0 conn(0x7fd61815ae50 legacy=0x7fd618071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.375+0000 7fd616d9d700 1 -- 172.21.15.100:0/1185714491 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180cbfc0 con 0x7fd61815b230 2023-11-17T06:30:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd616d9d700 1 --2- 172.21.15.100:0/1185714491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815b230 0x7fd6180cf610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6180709d0 tx=0x7fd61000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977d6fb87a701bc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61559a700 1 -- 172.21.15.100:0/1185714491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000e070 con 0x7fd61815b230 2023-11-17T06:30:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61559a700 1 -- 172.21.15.100:0/1185714491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000b910 con 0x7fd61815b230 2023-11-17T06:30:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61559a700 1 -- 172.21.15.100:0/1185714491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000bcc0 con 0x7fd61815b230 2023-11-17T06:30:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 -- 172.21.15.100:0/1185714491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815b230 msgr2=0x7fd6180cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 --2- 172.21.15.100:0/1185714491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815b230 0x7fd6180cf610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6180709d0 tx=0x7fd61000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 -- 172.21.15.100:0/1185714491 shutdown_connections 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 --2- 172.21.15.100:0/1185714491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815b230 0x7fd6180cf610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 --2- 172.21.15.100:0/1185714491 >> v2:172.21.15.119:3300/0 conn(0x7fd618070560 0x7fd6180cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 -- 172.21.15.100:0/1185714491 >> 172.21.15.100:0/1185714491 conn(0x7fd61806a690 msgr2=0x7fd61806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 -- 172.21.15.100:0/1185714491 shutdown_connections 2023-11-17T06:30:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.379+0000 7fd61759e700 1 -- 172.21.15.100:0/1185714491 wait complete. 2023-11-17T06:30:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 Processor -- start 2023-11-17T06:30:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 -- start start 2023-11-17T06:30:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd618070560 0x7fd6180c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd61815b230 0x7fd61815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61814fed0 con 0x7fd61815ae50 2023-11-17T06:30:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618150150 con 0x7fd61815b230 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181503f0 con 0x7fd618070560 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd615d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd615d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57320/0 (socket says 172.21.15.100:57320) 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd615d9b700 1 -- 172.21.15.100:0/513897539 learned_addr learned my addr 172.21.15.100:0/513897539 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd616d9d700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd61815b230 0x7fd61815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.383+0000 7fd61659c700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd618070560 0x7fd6180c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 -- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd618070560 msgr2=0x7fd6180c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd618070560 0x7fd6180c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 -- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd61815b230 msgr2=0x7fd61815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd61815b230 0x7fd61815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 -- 172.21.15.100:0/513897539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009b30 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd615d9b700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00ebe0 tx=0x7fd60c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c009740 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00c850 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00cbe0 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6181506d0 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd618150c90 con 0x7fd61815ae50 2023-11-17T06:30:30.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.387+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618067e10 con 0x7fd61815ae50 2023-11-17T06:30:30.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.391+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd60c00cd40 con 0x7fd61815ae50 2023-11-17T06:30:30.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.391+0000 7fd606ffd700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 0x7fd5f80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.391+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd60c083ff0 con 0x7fd61815ae50 2023-11-17T06:30:30.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.391+0000 7fd61659c700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 0x7fd5f80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.395+0000 7fd61659c700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 0x7fd5f80689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd608000f60 tx=0x7fd608009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.399+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd60c0b5090 con 0x7fd61815ae50 2023-11-17T06:30:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.587+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd618150e80 con 0x7fd61815ae50 2023-11-17T06:30:30.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.587+0000 7fd606ffd700 1 -- 172.21.15.100:0/513897539 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd60c054e80 con 0x7fd61815ae50 2023-11-17T06:30:30.591 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:30.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 msgr2=0x7fd5f80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 0x7fd5f80689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd608000f60 tx=0x7fd608009040 comp rx=0 tx=0).stop 2023-11-17T06:30:30.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 msgr2=0x7fd6181511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00ebe0 tx=0x7fd60c00eef0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 shutdown_connections 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd61815b230 0x7fd61815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd5f8066510 0x7fd5f80689d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61815ae50 0x7fd6181511b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 --2- 172.21.15.100:0/513897539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd618070560 0x7fd6180c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 >> 172.21.15.100:0/513897539 conn(0x7fd61806a690 msgr2=0x7fd6180ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 shutdown_connections 2023-11-17T06:30:30.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.591+0000 7fd61759e700 1 -- 172.21.15.100:0/513897539 wait complete. 2023-11-17T06:30:30.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.795+0000 7f90810ba700 1 Processor -- start 2023-11-17T06:30:30.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.795+0000 7f90810ba700 1 -- start start 2023-11-17T06:30:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c15aec0 0x7f907c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f907c0ce7a0 0x7f907c0b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f907c0b1350 0x7f907c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c0ce380 con 0x7f907c0ce7a0 2023-11-17T06:30:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c0b17e0 con 0x7f907c0b1350 2023-11-17T06:30:30.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f90810ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0cc400 con 0x7f907c15aec0 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f907a59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f907c0ce7a0 0x7f907c0b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f907a59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f907c0ce7a0 0x7f907c0b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57326/0 (socket says 172.21.15.100:57326) 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f907ad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c15aec0 0x7f907c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.799+0000 7f907a59c700 1 -- 172.21.15.100:0/2356987903 learned_addr learned my addr 172.21.15.100:0/2356987903 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907b59e700 1 --2- 172.21.15.100:0/2356987903 >> v2:172.21.15.119:3300/0 conn(0x7f907c0b1350 0x7f907c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 -- 172.21.15.100:0/2356987903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c15aec0 msgr2=0x7f907c15b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 --2- 172.21.15.100:0/2356987903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c15aec0 0x7f907c15b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 -- 172.21.15.100:0/2356987903 >> v2:172.21.15.119:3300/0 conn(0x7f907c0b1350 msgr2=0x7f907c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 --2- 172.21.15.100:0/2356987903 >> v2:172.21.15.119:3300/0 conn(0x7f907c0b1350 0x7f907c0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 -- 172.21.15.100:0/2356987903 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0cdcc0 con 0x7f907c0ce7a0 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f907a59c700 1 --2- 172.21.15.100:0/2356987903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c0ce7a0 0x7f907c0b0e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b1a00 tx=0x7f9070009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7964a8439934f2c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f9079d9b700 1 -- 172.21.15.100:0/2356987903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070011830 con 0x7f907c0ce7a0 2023-11-17T06:30:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f9079d9b700 1 -- 172.21.15.100:0/2356987903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070011990 con 0x7f907c0ce7a0 2023-11-17T06:30:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f9079d9b700 1 -- 172.21.15.100:0/2356987903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070011d20 con 0x7f907c0ce7a0 2023-11-17T06:30:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 -- 172.21.15.100:0/2356987903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c0ce7a0 msgr2=0x7f907c0b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 --2- 172.21.15.100:0/2356987903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c0ce7a0 0x7f907c0b0e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b1a00 tx=0x7f9070009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 -- 172.21.15.100:0/2356987903 shutdown_connections 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 --2- 172.21.15.100:0/2356987903 >> v2:172.21.15.119:3300/0 conn(0x7f907c0b1350 0x7f907c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 --2- 172.21.15.100:0/2356987903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c0ce7a0 0x7f907c0b0e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 --2- 172.21.15.100:0/2356987903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c15aec0 0x7f907c15b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 -- 172.21.15.100:0/2356987903 >> 172.21.15.100:0/2356987903 conn(0x7f907c06a450 msgr2=0x7f907c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 -- 172.21.15.100:0/2356987903 shutdown_connections 2023-11-17T06:30:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.803+0000 7f90810ba700 1 -- 172.21.15.100:0/2356987903 wait complete. 2023-11-17T06:30:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 Processor -- start 2023-11-17T06:30:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 -- start start 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c0b1350 0x7f907c0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c1f3950 0x7f907c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c14ccd0 con 0x7f907c15aec0 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c1547d0 con 0x7f907c0b1350 2023-11-17T06:30:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f90810ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c2af0 con 0x7f907c1f3950 2023-11-17T06:30:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f907a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f907a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57328/0 (socket says 172.21.15.100:57328) 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.807+0000 7f907a59c700 1 -- 172.21.15.100:0/740667285 learned_addr learned my addr 172.21.15.100:0/740667285 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907b59e700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c1f3950 0x7f907c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907ad9d700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c0b1350 0x7f907c0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 -- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c1f3950 msgr2=0x7f907c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c1f3950 0x7f907c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 -- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c0b1350 msgr2=0x7f907c0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c0b1350 0x7f907c0c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 -- 172.21.15.100:0/740667285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009570 con 0x7f907c15aec0 2023-11-17T06:30:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f907a59c700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9070013000 tx=0x7f9070004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700044d0 con 0x7f907c15aec0 2023-11-17T06:30:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907001f070 con 0x7f907c15aec0 2023-11-17T06:30:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c0c2dd0 con 0x7f907c15aec0 2023-11-17T06:30:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070003900 con 0x7f907c15aec0 2023-11-17T06:30:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c0c5770 con 0x7f907c15aec0 2023-11-17T06:30:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.811+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c0c2940 con 0x7f907c15aec0 2023-11-17T06:30:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.815+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9070003a60 con 0x7f907c15aec0 2023-11-17T06:30:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.815+0000 7f90637fe700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 0x7f90680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.815+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9070021070 con 0x7f907c15aec0 2023-11-17T06:30:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.815+0000 7f907ad9d700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 0x7f90680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.815+0000 7f907ad9d700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 0x7f90680689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f906c009b80 tx=0x7f906c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:30.819+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90700525b0 con 0x7f907c15aec0 2023-11-17T06:30:31.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f907c0c32f0 con 0x7f907c15aec0 2023-11-17T06:30:31.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90637fe700 1 -- 172.21.15.100:0/740667285 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9070015020 con 0x7f907c15aec0 2023-11-17T06:30:31.007 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 msgr2=0x7f90680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 0x7f90680689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f906c009b80 tx=0x7f906c008040 comp rx=0 tx=0).stop 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 msgr2=0x7f907c0c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.003+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9070013000 tx=0x7f9070004770 comp rx=0 tx=0).stop 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 shutdown_connections 2023-11-17T06:30:31.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c1f3950 0x7f907c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9068066510 0x7f90680689d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f907c15aec0 0x7f907c0c5230 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 --2- 172.21.15.100:0/740667285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c0b1350 0x7f907c0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 >> 172.21.15.100:0/740667285 conn(0x7f907c06a450 msgr2=0x7f907c0ac9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 shutdown_connections 2023-11-17T06:30:31.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.007+0000 7f90810ba700 1 -- 172.21.15.100:0/740667285 wait complete. 2023-11-17T06:30:31.032 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.215+0000 7f60a5476700 1 Processor -- start 2023-11-17T06:30:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.215+0000 7f60a5476700 1 -- start start 2023-11-17T06:30:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 0x7f60a0160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f60a0161380 0x7f60a00cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00d0330 con 0x7f60a00cff20 2023-11-17T06:30:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a01619b0 con 0x7f60a0161380 2023-11-17T06:30:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00d1180 con 0x7f60a015d1c0 2023-11-17T06:30:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609effd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 0x7f60a0160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609f7fe700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f60a00cff20 0x7f60a00b4a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:35978/0 (socket says 172.21.15.100:35978) 2023-11-17T06:30:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609f7fe700 1 -- 172.21.15.100:0/1571309353 learned_addr learned my addr 172.21.15.100:0/1571309353 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 --2- 172.21.15.100:0/1571309353 >> v2:172.21.15.100:3300/0 conn(0x7f60a0161380 0x7f60a00cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 -- 172.21.15.100:0/1571309353 >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 msgr2=0x7f60a0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 --2- 172.21.15.100:0/1571309353 >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 0x7f60a0160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 -- 172.21.15.100:0/1571309353 >> v1:172.21.15.119:6789/0 conn(0x7f60a00cff20 legacy=0x7f60a00b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 -- 172.21.15.100:0/1571309353 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00d1460 con 0x7f60a0161380 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609effd700 1 --2- 172.21.15.100:0/1571309353 >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 0x7f60a0160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:31.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609e7fc700 1 --2- 172.21.15.100:0/1571309353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a00cf9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f60a00cf9b0 tx=0x7f6094009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ad11e43e3296a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609dffb700 1 -- 172.21.15.100:0/1571309353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011830 con 0x7f60a0161380 2023-11-17T06:30:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609dffb700 1 -- 172.21.15.100:0/1571309353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094011990 con 0x7f60a0161380 2023-11-17T06:30:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f609dffb700 1 -- 172.21.15.100:0/1571309353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011d20 con 0x7f60a0161380 2023-11-17T06:30:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 -- 172.21.15.100:0/1571309353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 msgr2=0x7f60a00cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.219+0000 7f60a5476700 1 --2- 172.21.15.100:0/1571309353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a00cf9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f60a00cf9b0 tx=0x7f6094009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- 172.21.15.100:0/1571309353 shutdown_connections 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 --2- 172.21.15.100:0/1571309353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a00cf9e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 --2- 172.21.15.100:0/1571309353 >> v2:172.21.15.119:3300/0 conn(0x7f60a015d1c0 0x7f60a0160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- 172.21.15.100:0/1571309353 >> 172.21.15.100:0/1571309353 conn(0x7f60a00d2fd0 msgr2=0x7f60a00d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- 172.21.15.100:0/1571309353 shutdown_connections 2023-11-17T06:30:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- 172.21.15.100:0/1571309353 wait complete. 2023-11-17T06:30:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 Processor -- start 2023-11-17T06:30:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- start start 2023-11-17T06:30:31.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60a00cff20 0x7f60a01f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60a015d1c0 0x7f60a015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015fa90 con 0x7f60a0161380 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015ee10 con 0x7f60a015d1c0 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.223+0000 7f60a5476700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015f0f0 con 0x7f60a00cff20 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57336/0 (socket says 172.21.15.100:57336) 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 -- 172.21.15.100:0/1415130935 learned_addr learned my addr 172.21.15.100:0/1415130935 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609e7fc700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60a015d1c0 0x7f60a015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609effd700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60a00cff20 0x7f60a01f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 -- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60a00cff20 msgr2=0x7f60a01f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60a00cff20 0x7f60a01f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 -- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60a015d1c0 msgr2=0x7f60a015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60a015d1c0 0x7f60a015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 -- 172.21.15.100:0/1415130935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900094b0 con 0x7f60a0161380 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f609f7fe700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f609800cbc0 tx=0x7f609800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800a7b0 con 0x7f60a0161380 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800a910 con 0x7f60a0161380 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60940094b0 con 0x7f60a0161380 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800ac80 con 0x7f60a0161380 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a015f6b0 con 0x7f60a0161380 2023-11-17T06:30:31.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.227+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a015fbd0 con 0x7f60a0161380 2023-11-17T06:30:31.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.231+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f609801b3b0 con 0x7f60a0161380 2023-11-17T06:30:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.231+0000 7f60877fe700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 0x7f608c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.231+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6098083610 con 0x7f60a0161380 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.231+0000 7f609effd700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 0x7f608c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.231+0000 7f609effd700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 0x7f608c0689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d10 tx=0x7f6090008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.239+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60a015fbd0 con 0x7f60a0161380 2023-11-17T06:30:31.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.427+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60a015fbd0 con 0x7f60a0161380 2023-11-17T06:30:31.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.427+0000 7f60877fe700 1 -- 172.21.15.100:0/1415130935 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f60a015fbd0 con 0x7f60a0161380 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 msgr2=0x7f608c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 0x7f608c0689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d10 tx=0x7f6090008040 comp rx=0 tx=0).stop 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 msgr2=0x7f60a0149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f609800cbc0 tx=0x7f609800cbf0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 shutdown_connections 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f608c066510 0x7f608c0689d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60a0161380 0x7f60a0149210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60a015d1c0 0x7f60a015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 --2- 172.21.15.100:0/1415130935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60a00cff20 0x7f60a01f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 >> 172.21.15.100:0/1415130935 conn(0x7f60a00d2fd0 msgr2=0x7f60a00c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 shutdown_connections 2023-11-17T06:30:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.431+0000 7f60a5476700 1 -- 172.21.15.100:0/1415130935 wait complete. 2023-11-17T06:30:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:31.461 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:30:31.461 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:31.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:31.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 Processor -- start 2023-11-17T06:30:31.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 -- start start 2023-11-17T06:30:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f980c9a10 0x7f2f9806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2f980cde70 0x7f2f980707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9806d160 con 0x7f2f98144ac0 2023-11-17T06:30:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9806da00 con 0x7f2f980cde70 2023-11-17T06:30:31.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f9c825700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9806cf70 con 0x7f2f980c9a10 2023-11-17T06:30:31.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f97fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2f980cde70 0x7f2f980707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f977fe700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2f98144ac0 0x7f2f980c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:35986/0 (socket says 172.21.15.100:35986) 2023-11-17T06:30:31.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f977fe700 1 -- 172.21.15.100:0/2535559236 learned_addr learned my addr 172.21.15.100:0/2535559236 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:31.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.703+0000 7f2f96ffd700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f980c9a10 0x7f2f9806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f967fc700 1 -- 172.21.15.100:0/2535559236 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179963332 0 0) 0x7f2f9806d160 con 0x7f2f98144ac0 2023-11-17T06:30:31.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f967fc700 1 -- 172.21.15.100:0/2535559236 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f800035d0 con 0x7f2f98144ac0 2023-11-17T06:30:31.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f97fff700 1 -- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f980c9a10 msgr2=0x7f2f9806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:31.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f97fff700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f980c9a10 0x7f2f9806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f97fff700 1 -- 172.21.15.100:0/2535559236 >> v1:172.21.15.119:6789/0 conn(0x7f2f98144ac0 legacy=0x7f2f980c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f97fff700 1 -- 172.21.15.100:0/2535559236 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9806d440 con 0x7f2f980cde70 2023-11-17T06:30:31.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f97fff700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980707b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009d90 tx=0x7f2f9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8dfacab46277b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f967fc700 1 -- 172.21.15.100:0/2535559236 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000e070 con 0x7f2f980cde70 2023-11-17T06:30:31.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f967fc700 1 -- 172.21.15.100:0/2535559236 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000bb20 con 0x7f2f980cde70 2023-11-17T06:30:31.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f967fc700 1 -- 172.21.15.100:0/2535559236 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90012430 con 0x7f2f980cde70 2023-11-17T06:30:31.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 -- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 msgr2=0x7f2f980707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980707b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009d90 tx=0x7f2f9000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:31.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 -- 172.21.15.100:0/2535559236 shutdown_connections 2023-11-17T06:30:31.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980707b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 --2- 172.21.15.100:0/2535559236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f980c9a10 0x7f2f9806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 -- 172.21.15.100:0/2535559236 >> 172.21.15.100:0/2535559236 conn(0x7f2f980cb730 msgr2=0x7f2f980cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 -- 172.21.15.100:0/2535559236 shutdown_connections 2023-11-17T06:30:31.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.707+0000 7f2f9c825700 1 -- 172.21.15.100:0/2535559236 wait complete. 2023-11-17T06:30:31.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.711+0000 7f2f9c825700 1 Processor -- start 2023-11-17T06:30:31.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.711+0000 7f2f9c825700 1 -- start start 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.711+0000 7f2f9c825700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.711+0000 7f2f9c825700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f98144ac0 0x7f2f980c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c4090 con 0x7f2f980c9a10 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c9650 con 0x7f2f980cde70 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c9370 con 0x7f2f98144ac0 2023-11-17T06:30:31.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57342/0 (socket says 172.21.15.100:57342) 2023-11-17T06:30:31.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 -- 172.21.15.100:0/1898156034 learned_addr learned my addr 172.21.15.100:0/1898156034 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f97fff700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f98144ac0 0x7f2f980c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f96ffd700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 -- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f98144ac0 msgr2=0x7f2f980c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f98144ac0 0x7f2f980c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 -- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 msgr2=0x7f2f980c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 -- 172.21.15.100:0/1898156034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009a70 con 0x7f2f980c9a10 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f977fe700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c4d0 tx=0x7f2f8800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88005d90 con 0x7f2f980c9a10 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9815c0e0 con 0x7f2f980c9a10 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800ce80 con 0x7f2f980c9a10 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880072d0 con 0x7f2f980c9a10 2023-11-17T06:30:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.715+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9815c6a0 con 0x7f2f980c9a10 2023-11-17T06:30:31.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.719+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f98065e90 con 0x7f2f980c9a10 2023-11-17T06:30:31.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.719+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f88007430 con 0x7f2f980c9a10 2023-11-17T06:30:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.719+0000 7f2f7ffff700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 0x7f2f840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.719+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f88083120 con 0x7f2f980c9a10 2023-11-17T06:30:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.719+0000 7f2f96ffd700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 0x7f2f840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.723+0000 7f2f96ffd700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 0x7f2f840689d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f9813f5a0 tx=0x7f2f8c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.727+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f880505c0 con 0x7f2f980c9a10 2023-11-17T06:30:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.899+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9806e340 con 0x7f2f980c9a10 2023-11-17T06:30:31.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f7ffff700 1 -- 172.21.15.100:0/1898156034 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f2f88053be0 con 0x7f2f980c9a10 2023-11-17T06:30:31.907 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:31.907 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:29:41.026835+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 msgr2=0x7f2f840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 0x7f2f840689d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f9813f5a0 tx=0x7f2f8c009240 comp rx=0 tx=0).stop 2023-11-17T06:30:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 msgr2=0x7f2f9813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c4d0 tx=0x7f2f8800c7e0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 shutdown_connections 2023-11-17T06:30:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f98144ac0 0x7f2f980c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f980cde70 0x7f2f980c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f84066510 0x7f2f840689d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 --2- 172.21.15.100:0/1898156034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f980c9a10 0x7f2f9813f060 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 >> 172.21.15.100:0/1898156034 conn(0x7f2f980cb730 msgr2=0x7f2f98143a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 shutdown_connections 2023-11-17T06:30:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:31.903+0000 7f2f9c825700 1 -- 172.21.15.100:0/1898156034 wait complete. 2023-11-17T06:30:31.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:31.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:32.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.115+0000 7fb9555bd700 1 Processor -- start 2023-11-17T06:30:32.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.115+0000 7fb9555bd700 1 -- start start 2023-11-17T06:30:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9500d2c70 0x7fb9500cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb95015d6f0 0x7fb9500d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9500d27e0 con 0x7fb95015d310 2023-11-17T06:30:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9500ce8e0 con 0x7fb95015d6f0 2023-11-17T06:30:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500d1eb0 con 0x7fb9500d2c70 2023-11-17T06:30:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb95015d6f0 0x7fb9500d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94e7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9500d2c70 0x7fb9500cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb95015d6f0 0x7fb9500d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51144/0 (socket says 172.21.15.100:51144) 2023-11-17T06:30:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 -- 172.21.15.100:0/2662360744 learned_addr learned my addr 172.21.15.100:0/2662360744 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 -- 172.21.15.100:0/2662360744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9500d2c70 msgr2=0x7fb9500cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 --2- 172.21.15.100:0/2662360744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9500d2c70 0x7fb9500cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 -- 172.21.15.100:0/2662360744 >> v1:172.21.15.119:6789/0 conn(0x7fb95015d310 legacy=0x7fb9500ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 -- 172.21.15.100:0/2662360744 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9500d2190 con 0x7fb95015d6f0 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94f7fe700 1 --2- 172.21.15.100:0/2662360744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb95015d6f0 0x7fb9500d0170 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb948009e50 tx=0x7fb94800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5582b9429c99bea server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94dffb700 1 -- 172.21.15.100:0/2662360744 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800e070 con 0x7fb95015d6f0 2023-11-17T06:30:32.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94dffb700 1 -- 172.21.15.100:0/2662360744 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800b910 con 0x7fb95015d6f0 2023-11-17T06:30:32.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb94dffb700 1 -- 172.21.15.100:0/2662360744 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800bcc0 con 0x7fb95015d6f0 2023-11-17T06:30:32.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- 172.21.15.100:0/2662360744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb95015d6f0 msgr2=0x7fb9500d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 --2- 172.21.15.100:0/2662360744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb95015d6f0 0x7fb9500d0170 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb948009e50 tx=0x7fb94800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- 172.21.15.100:0/2662360744 shutdown_connections 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 --2- 172.21.15.100:0/2662360744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb95015d6f0 0x7fb9500d0170 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 --2- 172.21.15.100:0/2662360744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9500d2c70 0x7fb9500cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- 172.21.15.100:0/2662360744 >> 172.21.15.100:0/2662360744 conn(0x7fb95006b4e0 msgr2=0x7fb95006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.119+0000 7fb9555bd700 1 -- 172.21.15.100:0/2662360744 shutdown_connections 2023-11-17T06:30:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.123+0000 7fb9555bd700 1 -- 172.21.15.100:0/2662360744 wait complete. 2023-11-17T06:30:32.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.123+0000 7fb9555bd700 1 Processor -- start 2023-11-17T06:30:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 -- start start 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95015d310 0x7fb95015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb95015d6f0 0x7fb95015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500cc0f0 con 0x7fb9500d2c70 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500cb470 con 0x7fb95015d6f0 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb9555bd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500cb750 con 0x7fb95015d310 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51152/0 (socket says 172.21.15.100:51152) 2023-11-17T06:30:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 -- 172.21.15.100:0/1604400253 learned_addr learned my addr 172.21.15.100:0/1604400253 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94e7fc700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95015d310 0x7fb95015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94f7fe700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb95015d6f0 0x7fb95015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 -- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95015d310 msgr2=0x7fb95015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95015d310 0x7fb95015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 -- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb95015d6f0 msgr2=0x7fb95015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb95015d6f0 0x7fb95015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 -- 172.21.15.100:0/1604400253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948009b30 con 0x7fb9500d2c70 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.127+0000 7fb94effd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c500 tx=0x7fb94000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400052d0 con 0x7fb9500d2c70 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb940005430 con 0x7fb9500d2c70 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9500cba30 con 0x7fb9500d2c70 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400055a0 con 0x7fb9500d2c70 2023-11-17T06:30:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9500c9340 con 0x7fb9500d2c70 2023-11-17T06:30:32.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95004eea0 con 0x7fb9500d2c70 2023-11-17T06:30:32.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.131+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9400038e0 con 0x7fb9500d2c70 2023-11-17T06:30:32.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.135+0000 7fb9377fe700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.135+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb940083200 con 0x7fb9500d2c70 2023-11-17T06:30:32.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.135+0000 7fb94e7fc700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.135+0000 7fb94e7fc700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb9501605c0 tx=0x7fb944009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.139+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb940050710 con 0x7fb9500d2c70 2023-11-17T06:30:32.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.311+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9501606f0 con 0x7fb9500d2c70 2023-11-17T06:30:32.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.311+0000 7fb9377fe700 1 -- 172.21.15.100:0/1604400253 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb940053d30 con 0x7fb9500d2c70 2023-11-17T06:30:32.318 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:32.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 msgr2=0x7fb93c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb9501605c0 tx=0x7fb944009240 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 msgr2=0x7fb9500c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c500 tx=0x7fb94000c810 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 shutdown_connections 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb95015d6f0 0x7fb95015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95015d310 0x7fb95015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 --2- 172.21.15.100:0/1604400253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9500d2c70 0x7fb9500c8e00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 >> 172.21.15.100:0/1604400253 conn(0x7fb95006b4e0 msgr2=0x7fb9500cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 shutdown_connections 2023-11-17T06:30:32.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.315+0000 7fb9555bd700 1 -- 172.21.15.100:0/1604400253 wait complete. 2023-11-17T06:30:32.341 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.511+0000 7fbc6094b700 1 Processor -- start 2023-11-17T06:30:32.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.511+0000 7fbc6094b700 1 -- start start 2023-11-17T06:30:32.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc6094b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc5c15d310 0x7fbc5c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc6094b700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c0d27e0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc6094b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c0ce630 con 0x7fbc5c0d2c70 2023-11-17T06:30:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc6094b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c0ce8e0 con 0x7fbc5c15d310 2023-11-17T06:30:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5ad9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbc5c0d0340 0x7fbc5c0b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:32790/0 (socket says 172.21.15.100:32790) 2023-11-17T06:30:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5ad9d700 1 -- 172.21.15.100:0/3675579024 learned_addr learned my addr 172.21.15.100:0/3675579024 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3675579024 >> v2:172.21.15.119:3300/0 conn(0x7fbc5c15d310 0x7fbc5c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544672196 0 0) 0x7fbc5c0d27e0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc440035d0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861182129 0 0) 0x7fbc5c0ce630 con 0x7fbc5c0d2c70 2023-11-17T06:30:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5c0d27e0 con 0x7fbc5c0d2c70 2023-11-17T06:30:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551196280 0 0) 0x7fbc440035d0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 >> v2:172.21.15.119:3300/0 conn(0x7fbc5c15d310 msgr2=0x7fbc5c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 --2- 172.21.15.100:0/3675579024 >> v2:172.21.15.119:3300/0 conn(0x7fbc5c15d310 0x7fbc5c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 >> v1:172.21.15.119:6789/0 conn(0x7fbc5c0d2c70 legacy=0x7fbc5c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.515+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0d1eb0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7fbc540019f0 con 0x7fbc5c0d0340 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 >> v1:172.21.15.100:6789/0 conn(0x7fbc5c0d0340 legacy=0x7fbc5c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 0x7fbc44003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc44004870 0x7fbc44004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44005230 0x7fbc4400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0ce8e0 con 0x7fbc44003bb0 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4400c0b0 con 0x7fbc44005230 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4400c270 con 0x7fbc44004870 2023-11-17T06:30:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 0x7fbc44003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44005230 0x7fbc4400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 -- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc44004870 msgr2=0x7fbc44004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc44004870 0x7fbc44004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 -- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44005230 msgr2=0x7fbc4400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44005230 0x7fbc4400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 -- 172.21.15.100:0/3675579024 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440035d0 con 0x7fbc44003bb0 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44005230 0x7fbc4400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:32.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5ad9d700 1 -- 172.21.15.100:0/3675579024 reap_dead start 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 0x7fbc44003fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009b70 tx=0x7fbc440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1039e9d553662a83 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00e6c0 con 0x7fbc44003bb0 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00e820 con 0x7fbc44003bb0 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc5959a700 1 -- 172.21.15.100:0/3675579024 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00eb90 con 0x7fbc44003bb0 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 -- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 msgr2=0x7fbc44003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 0x7fbc44003fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009b70 tx=0x7fbc440058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 -- 172.21.15.100:0/3675579024 shutdown_connections 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3675579024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc44003bb0 0x7fbc44003fb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 -- 172.21.15.100:0/3675579024 >> 172.21.15.100:0/3675579024 conn(0x7fbc5c06b4e0 msgr2=0x7fbc5c06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 -- 172.21.15.100:0/3675579024 shutdown_connections 2023-11-17T06:30:32.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.519+0000 7fbc6094b700 1 -- 172.21.15.100:0/3675579024 wait complete. 2023-11-17T06:30:32.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.523+0000 7fbc6094b700 1 Processor -- start 2023-11-17T06:30:32.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.523+0000 7fbc6094b700 1 -- start start 2023-11-17T06:30:32.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.523+0000 7fbc6094b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.523+0000 7fbc6094b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc5c0b39d0 0x7fbc5c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 0x7fbc5c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0b5440 con 0x7fbc5c158e90 2023-11-17T06:30:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0b4590 con 0x7fbc44003bb0 2023-11-17T06:30:32.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c159850 con 0x7fbc5c0b39d0 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33202/0 (socket says 172.21.15.100:33202) 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5a59c700 1 -- 172.21.15.100:0/3040857893 learned_addr learned my addr 172.21.15.100:0/3040857893 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 0x7fbc5c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc59d9b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc5c0b39d0 0x7fbc5c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 -- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc5c0b39d0 msgr2=0x7fbc5c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc5c0b39d0 0x7fbc5c152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 -- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 msgr2=0x7fbc5c0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 -- 172.21.15.100:0/3040857893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0b47c0 con 0x7fbc5c158e90 2023-11-17T06:30:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:32.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc5ad9d700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 0x7fbc5c159310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b5db0 tx=0x7fbc5400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540074e0 con 0x7fbc5c158e90 2023-11-17T06:30:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54007660 con 0x7fbc5c158e90 2023-11-17T06:30:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54007a10 con 0x7fbc5c158e90 2023-11-17T06:30:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c0b4aa0 con 0x7fbc5c158e90 2023-11-17T06:30:32.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.527+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c0b5060 con 0x7fbc5c158e90 2023-11-17T06:30:32.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.531+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c04eea0 con 0x7fbc5c158e90 2023-11-17T06:30:32.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.531+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc540123d0 con 0x7fbc5c158e90 2023-11-17T06:30:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.531+0000 7fbc4affd700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 0x7fbc3c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.531+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc54083740 con 0x7fbc5c158e90 2023-11-17T06:30:32.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.531+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 0x7fbc3c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.535+0000 7fbc5a59c700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 0x7fbc3c0689d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c01e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.539+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc54050bb0 con 0x7fbc5c158e90 2023-11-17T06:30:32.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.711+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc5c0c64d0 con 0x7fbc5c158e90 2023-11-17T06:30:32.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.711+0000 7fbc4affd700 1 -- 172.21.15.100:0/3040857893 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc540190a0 con 0x7fbc5c158e90 2023-11-17T06:30:32.717 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 msgr2=0x7fbc3c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 0x7fbc3c0689d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c01e040 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 msgr2=0x7fbc5c159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 0x7fbc5c159310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b5db0 tx=0x7fbc5400db50 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 shutdown_connections 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbc3c066510 0x7fbc3c0689d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c158e90 0x7fbc5c159310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc5c0b39d0 0x7fbc5c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 --2- 172.21.15.100:0/3040857893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc44003bb0 0x7fbc5c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 >> 172.21.15.100:0/3040857893 conn(0x7fbc5c06b4e0 msgr2=0x7fbc5c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 shutdown_connections 2023-11-17T06:30:32.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.715+0000 7fbc6094b700 1 -- 172.21.15.100:0/3040857893 wait complete. 2023-11-17T06:30:32.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 Processor -- start 2023-11-17T06:30:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 -- start start 2023-11-17T06:30:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff27c15b250 0x7ff27c071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0cb3b0 con 0x7ff27c0cad70 2023-11-17T06:30:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0cc690 con 0x7ff27c15b250 2023-11-17T06:30:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.915+0000 7ff284790700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0cf8a0 con 0x7ff27c0b1410 2023-11-17T06:30:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:34166/0 (socket says 172.21.15.100:34166) 2023-11-17T06:30:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 -- 172.21.15.100:0/2800519999 learned_addr learned my addr 172.21.15.100:0/2800519999 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff28252c700 1 --2- 172.21.15.100:0/2800519999 >> v2:172.21.15.119:3300/0 conn(0x7ff27c15b250 0x7ff27c071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 -- 172.21.15.100:0/2800519999 >> v2:172.21.15.119:3300/0 conn(0x7ff27c15b250 msgr2=0x7ff27c071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 --2- 172.21.15.100:0/2800519999 >> v2:172.21.15.119:3300/0 conn(0x7ff27c15b250 0x7ff27c071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 -- 172.21.15.100:0/2800519999 >> v1:172.21.15.119:6789/0 conn(0x7ff27c0cad70 legacy=0x7ff27c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 -- 172.21.15.100:0/2800519999 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0cfb80 con 0x7ff27c0b1410 2023-11-17T06:30:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff282d2d700 1 --2- 172.21.15.100:0/2800519999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff274009910 tx=0x7ff274009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536e60d599769a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff28152a700 1 -- 172.21.15.100:0/2800519999 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274011830 con 0x7ff27c0b1410 2023-11-17T06:30:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff28152a700 1 -- 172.21.15.100:0/2800519999 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274011990 con 0x7ff27c0b1410 2023-11-17T06:30:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff28152a700 1 -- 172.21.15.100:0/2800519999 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274011d40 con 0x7ff27c0b1410 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 -- 172.21.15.100:0/2800519999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 msgr2=0x7ff27c15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 --2- 172.21.15.100:0/2800519999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff274009910 tx=0x7ff274009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 -- 172.21.15.100:0/2800519999 shutdown_connections 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 --2- 172.21.15.100:0/2800519999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c15ee00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 --2- 172.21.15.100:0/2800519999 >> v2:172.21.15.119:3300/0 conn(0x7ff27c15b250 0x7ff27c071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 -- 172.21.15.100:0/2800519999 >> 172.21.15.100:0/2800519999 conn(0x7ff27c06a450 msgr2=0x7ff27c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 -- 172.21.15.100:0/2800519999 shutdown_connections 2023-11-17T06:30:32.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.919+0000 7ff284790700 1 -- 172.21.15.100:0/2800519999 wait complete. 2023-11-17T06:30:32.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 Processor -- start 2023-11-17T06:30:32.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 -- start start 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 0x7ff27c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c8b30 con 0x7ff27c0cad70 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c14fa30 con 0x7ff27c15b250 2023-11-17T06:30:32.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff284790700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c9830 con 0x7ff27c0b1410 2023-11-17T06:30:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51188/0 (socket says 172.21.15.100:51188) 2023-11-17T06:30:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 -- 172.21.15.100:0/1865716352 learned_addr learned my addr 172.21.15.100:0/1865716352 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff28252c700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff282d2d700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 0x7ff27c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 -- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 msgr2=0x7ff27c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 -- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 msgr2=0x7ff27c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 0x7ff27c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff281d2b700 1 -- 172.21.15.100:0/1865716352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009570 con 0x7ff27c0cad70 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff28252c700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.923+0000 7ff282d2d700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 0x7ff27c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff281d2b700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c500 tx=0x7ff26c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0052d0 con 0x7ff27c0cad70 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c005430 con 0x7ff27c0cad70 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c14fc30 con 0x7ff27c0cad70 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0055a0 con 0x7ff27c0cad70 2023-11-17T06:30:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0b0590 con 0x7ff27c0cad70 2023-11-17T06:30:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.927+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c150150 con 0x7ff27c0cad70 2023-11-17T06:30:32.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.931+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff26c0038e0 con 0x7ff27c0cad70 2023-11-17T06:30:32.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.931+0000 7ff272ffd700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 0x7ff2600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.931+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff26c083390 con 0x7ff27c0cad70 2023-11-17T06:30:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.931+0000 7ff28252c700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 0x7ff2600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.931+0000 7ff28252c700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 0x7ff2600689d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ccec0 tx=0x7ff27800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:32.939+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff27c150150 con 0x7ff27c0cad70 2023-11-17T06:30:33.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.111+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff27c150150 con 0x7ff27c0cad70 2023-11-17T06:30:33.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.111+0000 7ff272ffd700 1 -- 172.21.15.100:0/1865716352 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff27c150150 con 0x7ff27c0cad70 2023-11-17T06:30:33.117 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 msgr2=0x7ff2600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 0x7ff2600689d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ccec0 tx=0x7ff27800b040 comp rx=0 tx=0).stop 2023-11-17T06:30:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 msgr2=0x7ff27c0c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c500 tx=0x7ff26c00c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 shutdown_connections 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c15b250 0x7ff27c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff260066510 0x7ff2600689d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c0cad70 0x7ff27c0c2a50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 --2- 172.21.15.100:0/1865716352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0b1410 0x7ff27c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 >> 172.21.15.100:0/1865716352 conn(0x7ff27c06a450 msgr2=0x7ff27c071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 shutdown_connections 2023-11-17T06:30:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.115+0000 7ff284790700 1 -- 172.21.15.100:0/1865716352 wait complete. 2023-11-17T06:30:33.144 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 Processor -- start 2023-11-17T06:30:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 -- start start 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a8144ac0 0x7f25a806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25a80c9a10 0x7f25a80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a806d160 con 0x7f25a80cde70 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a806da00 con 0x7f25a80c9a10 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.307+0000 7f25ae862700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a806cf70 con 0x7f25a8144ac0 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ad05f700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f25a80cde70 0x7f25a80c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:32804/0 (socket says 172.21.15.100:32804) 2023-11-17T06:30:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ad05f700 1 -- 172.21.15.100:0/2835487627 learned_addr learned my addr 172.21.15.100:0/2835487627 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 --2- 172.21.15.100:0/2835487627 >> v2:172.21.15.100:3300/0 conn(0x7f25a80c9a10 0x7f25a80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ad860700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a8144ac0 0x7f25a806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ac85e700 1 -- 172.21.15.100:0/2835487627 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753346762 0 0) 0x7f25a806d160 con 0x7f25a80cde70 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ac85e700 1 -- 172.21.15.100:0/2835487627 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25940035d0 con 0x7f25a80cde70 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 -- 172.21.15.100:0/2835487627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a8144ac0 msgr2=0x7f25a806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a8144ac0 0x7f25a806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 -- 172.21.15.100:0/2835487627 >> v1:172.21.15.100:6789/0 conn(0x7f25a80cde70 legacy=0x7f25a80c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 -- 172.21.15.100:0/2835487627 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a806d440 con 0x7f25a80c9a10 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae061700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a80c9a10 0x7f25a80707b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009850 tx=0x7f25a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af00fc2c97566b10 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ac85e700 1 -- 172.21.15.100:0/2835487627 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011830 con 0x7f25a80c9a10 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ac85e700 1 -- 172.21.15.100:0/2835487627 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0011990 con 0x7f25a80c9a10 2023-11-17T06:30:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ac85e700 1 -- 172.21.15.100:0/2835487627 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011d40 con 0x7f25a80c9a10 2023-11-17T06:30:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 -- 172.21.15.100:0/2835487627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a80c9a10 msgr2=0x7f25a80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a80c9a10 0x7f25a80707b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009850 tx=0x7f25a0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 -- 172.21.15.100:0/2835487627 shutdown_connections 2023-11-17T06:30:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a80c9a10 0x7f25a80707b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 --2- 172.21.15.100:0/2835487627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a8144ac0 0x7f25a806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.311+0000 7f25ae862700 1 -- 172.21.15.100:0/2835487627 >> 172.21.15.100:0/2835487627 conn(0x7f25a80cb730 msgr2=0x7f25a80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.315+0000 7f25ae862700 1 -- 172.21.15.100:0/2835487627 shutdown_connections 2023-11-17T06:30:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.315+0000 7f25ae862700 1 -- 172.21.15.100:0/2835487627 wait complete. 2023-11-17T06:30:33.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.315+0000 7f25ae862700 1 Processor -- start 2023-11-17T06:30:33.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.315+0000 7f25ae862700 1 -- start start 2023-11-17T06:30:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a80c9a10 0x7f25a8132100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a80cde70 0x7f25a815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80adb60 con 0x7f25a8144ac0 2023-11-17T06:30:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a812f490 con 0x7f25a80c9a10 2023-11-17T06:30:33.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a812f770 con 0x7f25a80cde70 2023-11-17T06:30:33.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51214/0 (socket says 172.21.15.100:51214) 2023-11-17T06:30:33.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 -- 172.21.15.100:0/909055545 learned_addr learned my addr 172.21.15.100:0/909055545 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:33.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ad860700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a80c9a10 0x7f25a8132100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ad05f700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a80cde70 0x7f25a815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 -- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a80cde70 msgr2=0x7f25a815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a80cde70 0x7f25a815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 -- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a80c9a10 msgr2=0x7f25a8132100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a80c9a10 0x7f25a8132100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 -- 172.21.15.100:0/909055545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00094b0 con 0x7f25a8144ac0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae061700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f25a0013000 tx=0x7f25a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004400 con 0x7f25a8144ac0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a001f070 con 0x7f25a8144ac0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00036c0 con 0x7f25a8144ac0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a812fa50 con 0x7f25a8144ac0 2023-11-17T06:30:33.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8130010 con 0x7f25a8144ac0 2023-11-17T06:30:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.319+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8065e90 con 0x7f25a8144ac0 2023-11-17T06:30:33.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.323+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25a0021030 con 0x7f25a8144ac0 2023-11-17T06:30:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.323+0000 7f259e7fc700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 0x7f258c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.323+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a0085230 con 0x7f25a8144ac0 2023-11-17T06:30:33.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.323+0000 7f25ad860700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 0x7f258c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.327+0000 7f25ad860700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 0x7f258c0689d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25a80c5d00 tx=0x7f25a400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.331+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25a00527c0 con 0x7f25a8144ac0 2023-11-17T06:30:33.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.515+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25a806f8f0 con 0x7f25a8144ac0 2023-11-17T06:30:33.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.515+0000 7f259e7fc700 1 -- 172.21.15.100:0/909055545 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25a0055de0 con 0x7f25a8144ac0 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 msgr2=0x7f258c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 0x7f258c0689d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25a80c5d00 tx=0x7f25a400b040 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 msgr2=0x7f25a80ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f25a0013000 tx=0x7f25a0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 shutdown_connections 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f258c066510 0x7f258c0689d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8144ac0 0x7f25a80ad620 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25a80cde70 0x7f25a815ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 --2- 172.21.15.100:0/909055545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25a80c9a10 0x7f25a8132100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 >> 172.21.15.100:0/909055545 conn(0x7f25a80cb730 msgr2=0x7f25a8070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 shutdown_connections 2023-11-17T06:30:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:33.519+0000 7f25ae862700 1 -- 172.21.15.100:0/909055545 wait complete. 2023-11-17T06:30:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:33.545 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-11-17T06:30:33.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:33.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:33.579 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:33.579 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:30:33.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:33.580 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-17T06:30:33.643 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:33.643 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:33.661 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:33.661 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:33.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:42.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:42.171 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:42.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.331+0000 7f12a02dd700 1 Processor -- start 2023-11-17T06:30:42.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.331+0000 7f12a02dd700 1 -- start start 2023-11-17T06:30:42.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12980cf990 0x7f1298165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1298161d40 0x7f12981621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12980b0a40 0x7f12980b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12980b1410 con 0x7f1298161d40 2023-11-17T06:30:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1298165380 con 0x7f12980cf990 2023-11-17T06:30:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f12a02dd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12980cfd70 con 0x7f12980b0a40 2023-11-17T06:30:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1298161d40 0x7f12981621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1298161d40 0x7f12981621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44480/0 (socket says 172.21.15.100:44480) 2023-11-17T06:30:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 -- 172.21.15.100:0/3421158469 learned_addr learned my addr 172.21.15.100:0/3421158469 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129e079700 1 --2- 172.21.15.100:0/3421158469 >> v2:172.21.15.119:3300/0 conn(0x7f12980cf990 0x7f1298165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129e87a700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12980b0a40 0x7f12980b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 -- 172.21.15.100:0/3421158469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12980b0a40 msgr2=0x7f12980b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12980b0a40 0x7f12980b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 -- 172.21.15.100:0/3421158469 >> v2:172.21.15.119:3300/0 conn(0x7f12980cf990 msgr2=0x7f1298165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 --2- 172.21.15.100:0/3421158469 >> v2:172.21.15.119:3300/0 conn(0x7f12980cf990 0x7f1298165d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 -- 172.21.15.100:0/3421158469 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298158ce0 con 0x7f1298161d40 2023-11-17T06:30:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d878700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1298161d40 0x7f12981621c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f12980b50b0 tx=0x7f1288009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c41cc7276a6b03 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d077700 1 -- 172.21.15.100:0/3421158469 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288011830 con 0x7f1298161d40 2023-11-17T06:30:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d077700 1 -- 172.21.15.100:0/3421158469 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288011990 con 0x7f1298161d40 2023-11-17T06:30:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.335+0000 7f129d077700 1 -- 172.21.15.100:0/3421158469 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288011d20 con 0x7f1298161d40 2023-11-17T06:30:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 -- 172.21.15.100:0/3421158469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1298161d40 msgr2=0x7f12981621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1298161d40 0x7f12981621c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f12980b50b0 tx=0x7f1288009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 -- 172.21.15.100:0/3421158469 shutdown_connections 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12980b0a40 0x7f12980b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 --2- 172.21.15.100:0/3421158469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1298161d40 0x7f12981621c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 --2- 172.21.15.100:0/3421158469 >> v2:172.21.15.119:3300/0 conn(0x7f12980cf990 0x7f1298165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 -- 172.21.15.100:0/3421158469 >> 172.21.15.100:0/3421158469 conn(0x7f129806a270 msgr2=0x7f129806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 -- 172.21.15.100:0/3421158469 shutdown_connections 2023-11-17T06:30:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.339+0000 7f12a02dd700 1 -- 172.21.15.100:0/3421158469 wait complete. 2023-11-17T06:30:42.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 Processor -- start 2023-11-17T06:30:42.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 -- start start 2023-11-17T06:30:42.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12980cf990 0x7f12980b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1298161d40 0x7f12981f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12980b48d0 con 0x7f12980b0a40 2023-11-17T06:30:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12980b4cf0 con 0x7f12980cf990 2023-11-17T06:30:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f12a02dd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129815bd80 con 0x7f1298161d40 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44484/0 (socket says 172.21.15.100:44484) 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 -- 172.21.15.100:0/4208583349 learned_addr learned my addr 172.21.15.100:0/4208583349 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e87a700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1298161d40 0x7f12981f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129d878700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12980cf990 0x7f12980b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 -- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1298161d40 msgr2=0x7f12981f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1298161d40 0x7f12981f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 -- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12980cf990 msgr2=0x7f12980b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12980cf990 0x7f12980b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 -- 172.21.15.100:0/4208583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009570 con 0x7f12980b0a40 2023-11-17T06:30:42.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f129e079700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9d0 tx=0x7f129400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.343+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294009720 con 0x7f12980b0a40 2023-11-17T06:30:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400ee70 con 0x7f12980b0a40 2023-11-17T06:30:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400ca50 con 0x7f12980b0a40 2023-11-17T06:30:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12980b3c50 con 0x7f12980b0a40 2023-11-17T06:30:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12980b4210 con 0x7f12980b0a40 2023-11-17T06:30:42.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129804eea0 con 0x7f12980b0a40 2023-11-17T06:30:42.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.347+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f129400cbb0 con 0x7f12980b0a40 2023-11-17T06:30:42.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.351+0000 7f128effd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 0x7f127c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.351+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1294083fb0 con 0x7f12980b0a40 2023-11-17T06:30:42.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.351+0000 7f129d878700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 0x7f127c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.351+0000 7f129d878700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 0x7f127c0689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.355+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1294051310 con 0x7f12980b0a40 2023-11-17T06:30:42.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.531+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12980cc360 con 0x7f12980b0a40 2023-11-17T06:30:42.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.531+0000 7f128effd700 1 -- 172.21.15.100:0/4208583349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f1294059e60 con 0x7f12980b0a40 2023-11-17T06:30:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:42.538 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:37.002511+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 msgr2=0x7f127c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 0x7f127c0689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288008030 comp rx=0 tx=0).stop 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 msgr2=0x7f129815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9d0 tx=0x7f129400ece0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 shutdown_connections 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1298161d40 0x7f12981f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12980cf990 0x7f12980b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f127c066510 0x7f127c0689d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 --2- 172.21.15.100:0/4208583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12980b0a40 0x7f129815b840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 >> 172.21.15.100:0/4208583349 conn(0x7f129806a270 msgr2=0x7f12980cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 shutdown_connections 2023-11-17T06:30:42.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.535+0000 7f12a02dd700 1 -- 172.21.15.100:0/4208583349 wait complete. 2023-11-17T06:30:42.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:42.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:42.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.735+0000 7f304b59e700 1 Processor -- start 2023-11-17T06:30:42.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.735+0000 7f304b59e700 1 -- start start 2023-11-17T06:30:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 0x7f304c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304b59e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c15b230 0x7f304c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304b59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0cc580 con 0x7f304c15ae50 2023-11-17T06:30:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304b59e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0cba00 con 0x7f304c15b230 2023-11-17T06:30:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0cbce0 con 0x7f304c070560 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c15b230 0x7f304c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f3049d9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 0x7f304c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c15b230 0x7f304c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44492/0 (socket says 172.21.15.100:44492) 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f3049d9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 0x7f304c0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46816/0 (socket says 172.21.15.100:46816) 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 -- 172.21.15.100:0/332308245 learned_addr learned my addr 172.21.15.100:0/332308245 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304a59c700 1 --1- 172.21.15.100:0/332308245 >> v1:172.21.15.119:6789/0 conn(0x7f304c15ae50 0x7f304c071ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:39818/0 (socket says 172.21.15.100:39818) 2023-11-17T06:30:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 -- 172.21.15.100:0/332308245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 msgr2=0x7f304c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 --2- 172.21.15.100:0/332308245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 0x7f304c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 -- 172.21.15.100:0/332308245 >> v1:172.21.15.119:6789/0 conn(0x7f304c15ae50 legacy=0x7f304c071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.739+0000 7f304ad9d700 1 -- 172.21.15.100:0/332308245 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0cbfc0 con 0x7f304c15b230 2023-11-17T06:30:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304ad9d700 1 --2- 172.21.15.100:0/332308245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c15b230 0x7f304c0cf610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3044009e50 tx=0x7f304400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be5406b003d16d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304959a700 1 -- 172.21.15.100:0/332308245 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e070 con 0x7f304c15b230 2023-11-17T06:30:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304959a700 1 -- 172.21.15.100:0/332308245 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400b910 con 0x7f304c15b230 2023-11-17T06:30:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304959a700 1 -- 172.21.15.100:0/332308245 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400bcc0 con 0x7f304c15b230 2023-11-17T06:30:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 -- 172.21.15.100:0/332308245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c15b230 msgr2=0x7f304c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 --2- 172.21.15.100:0/332308245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c15b230 0x7f304c0cf610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3044009e50 tx=0x7f304400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 -- 172.21.15.100:0/332308245 shutdown_connections 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 --2- 172.21.15.100:0/332308245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c15b230 0x7f304c0cf610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 --2- 172.21.15.100:0/332308245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c070560 0x7f304c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 -- 172.21.15.100:0/332308245 >> 172.21.15.100:0/332308245 conn(0x7f304c06a690 msgr2=0x7f304c06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 -- 172.21.15.100:0/332308245 shutdown_connections 2023-11-17T06:30:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.743+0000 7f304b59e700 1 -- 172.21.15.100:0/332308245 wait complete. 2023-11-17T06:30:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 Processor -- start 2023-11-17T06:30:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 -- start start 2023-11-17T06:30:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c070560 0x7f304c0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 0x7f304c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c14d3f0 con 0x7f304c070560 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c14c4c0 con 0x7f304c15ae50 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.747+0000 7f304b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c14c770 con 0x7f304c15b230 2023-11-17T06:30:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c070560 0x7f304c0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f3049d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 0x7f304c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f3049d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:38618/0 (socket says 172.21.15.100:38618) 2023-11-17T06:30:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f3049d9b700 1 -- 172.21.15.100:0/4289940275 learned_addr learned my addr 172.21.15.100:0/4289940275 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 -- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 msgr2=0x7f304c14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 -- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c070560 msgr2=0x7f304c0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c070560 0x7f304c0c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 -- 172.21.15.100:0/4289940275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044009b30 con 0x7f304c15b230 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f3049d9b700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304ad9d700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 0x7f304c14bf80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3044015000 tx=0x7f3044004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044004800 con 0x7f304c15b230 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30440099b0 con 0x7f304c15b230 2023-11-17T06:30:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304401b670 con 0x7f304c15b230 2023-11-17T06:30:42.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c14ca50 con 0x7f304c15b230 2023-11-17T06:30:42.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.751+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c14d010 con 0x7f304c15b230 2023-11-17T06:30:42.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.755+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c067e10 con 0x7f304c15b230 2023-11-17T06:30:42.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.755+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f304401b7d0 con 0x7f304c15b230 2023-11-17T06:30:42.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.755+0000 7f303affd700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 0x7f302c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.755+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3044085390 con 0x7f304c15b230 2023-11-17T06:30:42.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.755+0000 7f304a59c700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 0x7f302c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.759+0000 7f304a59c700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 0x7f302c068a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f303c000f60 tx=0x7f303c007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.763+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3044052780 con 0x7f304c15b230 2023-11-17T06:30:42.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.935+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f304c14d530 con 0x7f304c15b230 2023-11-17T06:30:42.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f303affd700 1 -- 172.21.15.100:0/4289940275 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f304c14d530 con 0x7f304c15b230 2023-11-17T06:30:42.942 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:42.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 msgr2=0x7f302c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 0x7f302c068a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f303c000f60 tx=0x7f303c007ef0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 msgr2=0x7f304c14bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 0x7f304c14bf80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3044015000 tx=0x7f3044004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 shutdown_connections 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f304c15b230 0x7f304c14bf80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f304c15ae50 0x7f304c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f302c066540 0x7f302c068a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 --2- 172.21.15.100:0/4289940275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c070560 0x7f304c0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 >> 172.21.15.100:0/4289940275 conn(0x7f304c06a690 msgr2=0x7f304c15dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 shutdown_connections 2023-11-17T06:30:42.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:42.939+0000 7f304b59e700 1 -- 172.21.15.100:0/4289940275 wait complete. 2023-11-17T06:30:42.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:43.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.139+0000 7f532f123700 1 Processor -- start 2023-11-17T06:30:43.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.139+0000 7f532f123700 1 -- start start 2023-11-17T06:30:43.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532f123700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f532815d310 0x7f53280ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532f123700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53280d2c70 0x7f53280cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532f123700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53280d27e0 con 0x7f532815d6f0 2023-11-17T06:30:43.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532f123700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53280ce8e0 con 0x7f532815d310 2023-11-17T06:30:43.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532f123700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53280ce630 con 0x7f53280d2c70 2023-11-17T06:30:43.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f532815d310 0x7f53280ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f532815d310 0x7f53280ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44502/0 (socket says 172.21.15.100:44502) 2023-11-17T06:30:43.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 -- 172.21.15.100:0/3401025227 learned_addr learned my addr 172.21.15.100:0/3401025227 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f5327fff700 1 --2- 172.21.15.100:0/3401025227 >> v2:172.21.15.119:3300/0 conn(0x7f53280d2c70 0x7f53280cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 -- 172.21.15.100:0/3401025227 >> v2:172.21.15.119:3300/0 conn(0x7f53280d2c70 msgr2=0x7f53280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 --2- 172.21.15.100:0/3401025227 >> v2:172.21.15.119:3300/0 conn(0x7f53280d2c70 0x7f53280cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 -- 172.21.15.100:0/3401025227 >> v1:172.21.15.100:6789/0 conn(0x7f532815d6f0 legacy=0x7f53280b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f532cebf700 1 -- 172.21.15.100:0/3401025227 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280d1eb0 con 0x7f532815d310 2023-11-17T06:30:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.143+0000 7f53277fe700 1 -- 172.21.15.100:0/3401025227 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780171428 0 0) 0x7f53280d27e0 con 0x7f532815d6f0 2023-11-17T06:30:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532cebf700 1 --2- 172.21.15.100:0/3401025227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53280ce0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f53280d09f0 tx=0x7f531c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b2115f725f4412 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f53277fe700 1 -- 172.21.15.100:0/3401025227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c011830 con 0x7f532815d310 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f53277fe700 1 -- 172.21.15.100:0/3401025227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c011990 con 0x7f532815d310 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f53277fe700 1 -- 172.21.15.100:0/3401025227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c011d20 con 0x7f532815d310 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- 172.21.15.100:0/3401025227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 msgr2=0x7f53280ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 --2- 172.21.15.100:0/3401025227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53280ce0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f53280d09f0 tx=0x7f531c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- 172.21.15.100:0/3401025227 shutdown_connections 2023-11-17T06:30:43.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 --2- 172.21.15.100:0/3401025227 >> v2:172.21.15.119:3300/0 conn(0x7f53280d2c70 0x7f53280cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 --2- 172.21.15.100:0/3401025227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53280ce0f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- 172.21.15.100:0/3401025227 >> 172.21.15.100:0/3401025227 conn(0x7f532806b4e0 msgr2=0x7f532806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- 172.21.15.100:0/3401025227 shutdown_connections 2023-11-17T06:30:43.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- 172.21.15.100:0/3401025227 wait complete. 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 Processor -- start 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.147+0000 7f532f123700 1 -- start start 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53280d2c70 0x7f5328150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532815d6f0 0x7f53280b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5328150b90 con 0x7f532815d310 2023-11-17T06:30:43.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53281f6ae0 con 0x7f532815d6f0 2023-11-17T06:30:43.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53281f6dc0 con 0x7f53280d2c70 2023-11-17T06:30:43.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44510/0 (socket says 172.21.15.100:44510) 2023-11-17T06:30:43.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 -- 172.21.15.100:0/850249865 learned_addr learned my addr 172.21.15.100:0/850249865 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532cebf700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53280d2c70 0x7f5328150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532d6c0700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532815d6f0 0x7f53280b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 -- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53280d2c70 msgr2=0x7f5328150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53280d2c70 0x7f5328150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 -- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532815d6f0 msgr2=0x7f53280b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532815d6f0 0x7f53280b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 -- 172.21.15.100:0/850249865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009570 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f5327fff700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f531400e9d0 tx=0x7f531400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314009720 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400c850 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400cbc0 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53281f70a0 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.151+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53280cbad0 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.155+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532804eea0 con 0x7f532815d310 2023-11-17T06:30:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.155+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f531400cd20 con 0x7f532815d310 2023-11-17T06:30:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.155+0000 7f53257fa700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 0x7f530c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.155+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5314083ff0 con 0x7f532815d310 2023-11-17T06:30:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.155+0000 7f532cebf700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 0x7f530c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.159+0000 7f532cebf700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 0x7f530c0689d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f531c000c00 tx=0x7f531c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.163+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5314051350 con 0x7f532815d310 2023-11-17T06:30:43.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.339+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53280d2440 con 0x7f532815d310 2023-11-17T06:30:43.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.339+0000 7f53257fa700 1 -- 172.21.15.100:0/850249865 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5314054970 con 0x7f532815d310 2023-11-17T06:30:43.344 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:43.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 msgr2=0x7f530c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 0x7f530c0689d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f531c000c00 tx=0x7f531c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:43.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 msgr2=0x7f53281f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f531400e9d0 tx=0x7f531400ece0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 shutdown_connections 2023-11-17T06:30:43.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532815d6f0 0x7f53280b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f530c066510 0x7f530c0689d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f532815d310 0x7f53281f6200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 --2- 172.21.15.100:0/850249865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53280d2c70 0x7f5328150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 >> 172.21.15.100:0/850249865 conn(0x7f532806b4e0 msgr2=0x7f532815ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 shutdown_connections 2023-11-17T06:30:43.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.343+0000 7f532f123700 1 -- 172.21.15.100:0/850249865 wait complete. 2023-11-17T06:30:43.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:43.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 Processor -- start 2023-11-17T06:30:43.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 -- start start 2023-11-17T06:30:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc51c15ced0 0x7fc51c0d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc51c15d2b0 0x7fc51c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c160ce0 con 0x7fc51c0cd8b0 2023-11-17T06:30:43.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0cdd40 con 0x7fc51c15ced0 2023-11-17T06:30:43.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51b59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0ce020 con 0x7fc51c15d2b0 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc51c15ced0 0x7fc51c0d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc51c15ced0 0x7fc51c0d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44518/0 (socket says 172.21.15.100:44518) 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 -- 172.21.15.100:0/2985898423 learned_addr learned my addr 172.21.15.100:0/2985898423 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc519d9b700 1 --1- 172.21.15.100:0/2985898423 >> v1:172.21.15.100:6789/0 conn(0x7fc51c0cd8b0 0x7fc51c161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45450/0 (socket says 172.21.15.100:45450) 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51ad9d700 1 --2- 172.21.15.100:0/2985898423 >> v2:172.21.15.119:3300/0 conn(0x7fc51c15d2b0 0x7fc51c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 -- 172.21.15.100:0/2985898423 >> v2:172.21.15.119:3300/0 conn(0x7fc51c15d2b0 msgr2=0x7fc51c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 --2- 172.21.15.100:0/2985898423 >> v2:172.21.15.119:3300/0 conn(0x7fc51c15d2b0 0x7fc51c0d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 -- 172.21.15.100:0/2985898423 >> v1:172.21.15.100:6789/0 conn(0x7fc51c0cd8b0 legacy=0x7fc51c161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.547+0000 7fc51a59c700 1 -- 172.21.15.100:0/2985898423 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0ce300 con 0x7fc51c15ced0 2023-11-17T06:30:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51a59c700 1 --2- 172.21.15.100:0/2985898423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0d0fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc51c074190 tx=0x7fc50c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d035bf63b249f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51959a700 1 -- 172.21.15.100:0/2985898423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00b8a0 con 0x7fc51c15ced0 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51959a700 1 -- 172.21.15.100:0/2985898423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c00ba00 con 0x7fc51c15ced0 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51959a700 1 -- 172.21.15.100:0/2985898423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00bd90 con 0x7fc51c15ced0 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 -- 172.21.15.100:0/2985898423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 msgr2=0x7fc51c0d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 --2- 172.21.15.100:0/2985898423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0d0fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc51c074190 tx=0x7fc50c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 -- 172.21.15.100:0/2985898423 shutdown_connections 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 --2- 172.21.15.100:0/2985898423 >> v2:172.21.15.119:3300/0 conn(0x7fc51c15d2b0 0x7fc51c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 --2- 172.21.15.100:0/2985898423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0d0fe0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 -- 172.21.15.100:0/2985898423 >> 172.21.15.100:0/2985898423 conn(0x7fc51c06b370 msgr2=0x7fc51c06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 -- 172.21.15.100:0/2985898423 shutdown_connections 2023-11-17T06:30:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.551+0000 7fc51b59e700 1 -- 172.21.15.100:0/2985898423 wait complete. 2023-11-17T06:30:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 Processor -- start 2023-11-17T06:30:43.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 -- start start 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 0x7fc51c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc51c0cbf90 0x7fc51c0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0b3c40 con 0x7fc51c15ced0 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1528f0 con 0x7fc51c15d2b0 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0cd210 con 0x7fc51c0cbf90 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44532/0 (socket says 172.21.15.100:44532) 2023-11-17T06:30:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51a59c700 1 -- 172.21.15.100:0/3095266908 learned_addr learned my addr 172.21.15.100:0/3095266908 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc51ad9d700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc51c0cbf90 0x7fc51c0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.555+0000 7fc519d9b700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 0x7fc51c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 -- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc51c0cbf90 msgr2=0x7fc51c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc51c0cbf90 0x7fc51c0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 -- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 msgr2=0x7fc51c1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 0x7fc51c1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 -- 172.21.15.100:0/3095266908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c009570 con 0x7fc51c15ced0 2023-11-17T06:30:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc519d9b700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 0x7fc51c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51a59c700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b0e0 tx=0x7fc50c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c003ad0 con 0x7fc51c15ced0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c01e070 con 0x7fc51c15ced0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c0ccf30 con 0x7fc51c15ced0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c003e90 con 0x7fc51c15ced0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c0b38d0 con 0x7fc51c15ced0 2023-11-17T06:30:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.559+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c065e90 con 0x7fc51c15ced0 2023-11-17T06:30:43.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.563+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc50c01a420 con 0x7fc51c15ced0 2023-11-17T06:30:43.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.563+0000 7fc50affd700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 0x7fc4fc068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.563+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc50c020070 con 0x7fc51c15ced0 2023-11-17T06:30:43.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.563+0000 7fc519d9b700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 0x7fc4fc068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.563+0000 7fc519d9b700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 0x7fc4fc068a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b4610 tx=0x7fc510009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.567+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc50c0529e0 con 0x7fc51c15ced0 2023-11-17T06:30:43.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.747+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc51c1602f0 con 0x7fc51c15ced0 2023-11-17T06:30:43.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.747+0000 7fc50affd700 1 -- 172.21.15.100:0/3095266908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc50c056000 con 0x7fc51c15ced0 2023-11-17T06:30:43.752 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:43.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 msgr2=0x7fc4fc068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 0x7fc4fc068a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b4610 tx=0x7fc510009040 comp rx=0 tx=0).stop 2023-11-17T06:30:43.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 msgr2=0x7fc51c0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b0e0 tx=0x7fc50c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 shutdown_connections 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc51c0cbf90 0x7fc51c0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc51c15d2b0 0x7fc51c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc4fc066590 0x7fc4fc068a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 --2- 172.21.15.100:0/3095266908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc51c15ced0 0x7fc51c0b40d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 >> 172.21.15.100:0/3095266908 conn(0x7fc51c06b370 msgr2=0x7fc51c0b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 shutdown_connections 2023-11-17T06:30:43.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.751+0000 7fc51b59e700 1 -- 172.21.15.100:0/3095266908 wait complete. 2023-11-17T06:30:43.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:43.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.947+0000 7fa931505700 1 Processor -- start 2023-11-17T06:30:43.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.947+0000 7fa931505700 1 -- start start 2023-11-17T06:30:43.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa931505700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c144ac0 0x7fa92c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa931505700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c9a10 0x7fa92c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa931505700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c06d160 con 0x7fa92c0cde70 2023-11-17T06:30:43.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa931505700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06da00 con 0x7fa92c144ac0 2023-11-17T06:30:43.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa931505700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c06cf70 con 0x7fa92c0c9a10 2023-11-17T06:30:43.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c144ac0 0x7fa92c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c144ac0 0x7fa92c06ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44538/0 (socket says 172.21.15.100:44538) 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 -- 172.21.15.100:0/4175177356 learned_addr learned my addr 172.21.15.100:0/4175177356 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa930d04700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c9a10 0x7fa92c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 -- 172.21.15.100:0/4175177356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c9a10 msgr2=0x7fa92c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c9a10 0x7fa92c0707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 -- 172.21.15.100:0/4175177356 >> v1:172.21.15.119:6789/0 conn(0x7fa92c0cde70 legacy=0x7fa92c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 -- 172.21.15.100:0/4175177356 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c06d440 con 0x7fa92c144ac0 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92bfff700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c144ac0 0x7fa92c06ca30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009910 tx=0x7fa91c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebca9700d400acd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92b7fe700 1 -- 172.21.15.100:0/4175177356 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c011830 con 0x7fa92c144ac0 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92b7fe700 1 -- 172.21.15.100:0/4175177356 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c011990 con 0x7fa92c144ac0 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.951+0000 7fa92b7fe700 1 -- 172.21.15.100:0/4175177356 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c011d40 con 0x7fa92c144ac0 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- 172.21.15.100:0/4175177356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c144ac0 msgr2=0x7fa92c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c144ac0 0x7fa92c06ca30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009910 tx=0x7fa91c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:43.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- 172.21.15.100:0/4175177356 shutdown_connections 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c9a10 0x7fa92c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 --2- 172.21.15.100:0/4175177356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c144ac0 0x7fa92c06ca30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- 172.21.15.100:0/4175177356 >> 172.21.15.100:0/4175177356 conn(0x7fa92c0cb730 msgr2=0x7fa92c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- 172.21.15.100:0/4175177356 shutdown_connections 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- 172.21.15.100:0/4175177356 wait complete. 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 Processor -- start 2023-11-17T06:30:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.955+0000 7fa931505700 1 -- start start 2023-11-17T06:30:43.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 0x7fa92c142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c144ac0 0x7fa92c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c7fb0 con 0x7fa92c0c9a10 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1f36a0 con 0x7fa92c144ac0 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c9020 con 0x7fa92c0cde70 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44548/0 (socket says 172.21.15.100:44548) 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 -- 172.21.15.100:0/858622107 learned_addr learned my addr 172.21.15.100:0/858622107 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa930d04700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c144ac0 0x7fa92c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa9237fe700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 0x7fa92c142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 -- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 msgr2=0x7fa92c142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 0x7fa92c142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 -- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c144ac0 msgr2=0x7fa92c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c144ac0 0x7fa92c0c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 -- 172.21.15.100:0/858622107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009570 con 0x7fa92c0c9a10 2023-11-17T06:30:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa9237fe700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 0x7fa92c142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa92bfff700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06f4c0 tx=0x7fa91c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c004510 con 0x7fa92c0c9a10 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c01e070 con 0x7fa92c0c9a10 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0c7330 con 0x7fa92c0c9a10 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c003900 con 0x7fa92c0c9a10 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.959+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c0c78f0 con 0x7fa92c0c9a10 2023-11-17T06:30:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.963+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c0c80f0 con 0x7fa92c0c9a10 2023-11-17T06:30:43.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.963+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa91c003a60 con 0x7fa92c0c9a10 2023-11-17T06:30:43.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.967+0000 7fa9297fa700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 0x7fa90c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.967+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa91c084ca0 con 0x7fa92c0c9a10 2023-11-17T06:30:43.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.967+0000 7fa9237fe700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 0x7fa90c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.967+0000 7fa9237fe700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 0x7fa90c0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa92c15e650 tx=0x7fa914009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:43.971+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa92c0c80f0 con 0x7fa92c0c9a10 2023-11-17T06:30:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.167+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa92c0c80f0 con 0x7fa92c0c9a10 2023-11-17T06:30:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.167+0000 7fa9297fa700 1 -- 172.21.15.100:0/858622107 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa92c0c80f0 con 0x7fa92c0c9a10 2023-11-17T06:30:44.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 msgr2=0x7fa90c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 0x7fa90c0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa92c15e650 tx=0x7fa914009040 comp rx=0 tx=0).stop 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 msgr2=0x7fa92c1f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06f4c0 tx=0x7fa91c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 shutdown_connections 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c144ac0 0x7fa92c0c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cde70 0x7fa92c142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa90c066510 0x7fa90c0689d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 --2- 172.21.15.100:0/858622107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c9a10 0x7fa92c1f3160 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 >> 172.21.15.100:0/858622107 conn(0x7fa92c0cb730 msgr2=0x7fa92c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 shutdown_connections 2023-11-17T06:30:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.171+0000 7fa931505700 1 -- 172.21.15.100:0/858622107 wait complete. 2023-11-17T06:30:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:44.199 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:30:44.199 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:44.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:44.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.391+0000 7f19a61f4700 1 Processor -- start 2023-11-17T06:30:44.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.391+0000 7f19a61f4700 1 -- start start 2023-11-17T06:30:44.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a61f4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19a00c5070 0x7f19a00c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a61f4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00cd570 con 0x7f19a00cc880 2023-11-17T06:30:44.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a61f4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a006d110 con 0x7f19a00c9bb0 2023-11-17T06:30:44.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a61f4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a006cf30 con 0x7f19a00c5070 2023-11-17T06:30:44.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a51f2700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f19a00cc880 0x7f19a00ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45466/0 (socket says 172.21.15.100:45466) 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a51f2700 1 -- 172.21.15.100:0/2344250901 learned_addr learned my addr 172.21.15.100:0/2344250901 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a49f1700 1 --2- 172.21.15.100:0/2344250901 >> v2:172.21.15.119:3300/0 conn(0x7f19a00c5070 0x7f19a00c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f1997fff700 1 -- 172.21.15.100:0/2344250901 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706650324 0 0) 0x7f19a00cd570 con 0x7f19a00cc880 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f1997fff700 1 -- 172.21.15.100:0/2344250901 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198c0035d0 con 0x7f19a00cc880 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a49f1700 1 -- 172.21.15.100:0/2344250901 >> v1:172.21.15.119:6789/0 conn(0x7f19a00c9bb0 legacy=0x7f19a00ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a49f1700 1 -- 172.21.15.100:0/2344250901 >> v1:172.21.15.100:6789/0 conn(0x7f19a00cc880 legacy=0x7f19a00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a49f1700 1 -- 172.21.15.100:0/2344250901 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a006d3f0 con 0x7f19a00c5070 2023-11-17T06:30:44.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f19a49f1700 1 --2- 172.21.15.100:0/2344250901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c5070 0x7f19a00c9670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1990009880 tx=0x7f1990009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6faa1a8352beaf4c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f1997fff700 1 -- 172.21.15.100:0/2344250901 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990011830 con 0x7f19a00c5070 2023-11-17T06:30:44.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f1997fff700 1 -- 172.21.15.100:0/2344250901 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990011990 con 0x7f19a00c5070 2023-11-17T06:30:44.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.395+0000 7f1997fff700 1 -- 172.21.15.100:0/2344250901 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990011d00 con 0x7f19a00c5070 2023-11-17T06:30:44.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 -- 172.21.15.100:0/2344250901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c5070 msgr2=0x7f19a00c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 --2- 172.21.15.100:0/2344250901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c5070 0x7f19a00c9670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1990009880 tx=0x7f1990009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:44.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 -- 172.21.15.100:0/2344250901 shutdown_connections 2023-11-17T06:30:44.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 --2- 172.21.15.100:0/2344250901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c5070 0x7f19a00c9670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 -- 172.21.15.100:0/2344250901 >> 172.21.15.100:0/2344250901 conn(0x7f19a00cb730 msgr2=0x7f19a00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:44.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 -- 172.21.15.100:0/2344250901 shutdown_connections 2023-11-17T06:30:44.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 -- 172.21.15.100:0/2344250901 wait complete. 2023-11-17T06:30:44.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.399+0000 7f19a61f4700 1 Processor -- start 2023-11-17T06:30:44.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 -- start start 2023-11-17T06:30:44.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 0x7f19a00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 0x7f19a0161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 0x7f19a00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006c3f0 con 0x7f19a00cc880 2023-11-17T06:30:44.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00b4550 con 0x7f19a00c9bb0 2023-11-17T06:30:44.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a61f4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00b4830 con 0x7f19a00c5070 2023-11-17T06:30:44.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a59f3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 0x7f19a00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a51f2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 0x7f19a00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 0x7f19a0161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a51f2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 0x7f19a00b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46882/0 (socket says 172.21.15.100:46882) 2023-11-17T06:30:44.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a51f2700 1 -- 172.21.15.100:0/1718091546 learned_addr learned my addr 172.21.15.100:0/1718091546 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 -- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 msgr2=0x7f19a00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 0x7f19a00b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 -- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 msgr2=0x7f19a00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 0x7f19a00afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a49f1700 1 -- 172.21.15.100:0/1718091546 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900094b0 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.403+0000 7f19a59f3700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 0x7f19a00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f19a49f1700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 0x7f19a0161ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1990016000 tx=0x7f1990004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199001a9d0 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199001f070 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199001ad90 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a0164270 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0164830 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.407+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0164a20 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.411+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f199002e450 con 0x7f19a00c9bb0 2023-11-17T06:30:44.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.411+0000 7f1995ffb700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 0x7f19840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.411+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1990084e90 con 0x7f19a00c9bb0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.411+0000 7f19a51f2700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 0x7f19840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.415+0000 7f19a51f2700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 0x7f19840689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f199c0011e0 tx=0x7f199c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.419+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1990052280 con 0x7f19a00c9bb0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.595+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a0065e90 con 0x7f19a00c9bb0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.599+0000 7f1995ffb700 1 -- 172.21.15.100:0/1718091546 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f1990015090 con 0x7f19a00c9bb0 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:44.767 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:37.002511+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 msgr2=0x7f19840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 0x7f19840689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f199c0011e0 tx=0x7f199c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 msgr2=0x7f19a0161ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 0x7f19a0161ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1990016000 tx=0x7f1990004770 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 shutdown_connections 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1984066510 0x7f19840689d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19a00cc880 0x7f19a00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a00c9bb0 0x7f19a0161ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 --2- 172.21.15.100:0/1718091546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a00c5070 0x7f19a00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 >> 172.21.15.100:0/1718091546 conn(0x7f19a00cb730 msgr2=0x7f19a0072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 shutdown_connections 2023-11-17T06:30:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.603+0000 7f19a61f4700 1 -- 172.21.15.100:0/1718091546 wait complete. 2023-11-17T06:30:44.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:44.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.955+0000 7f069154a700 1 Processor -- start 2023-11-17T06:30:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.955+0000 7f069154a700 1 -- start start 2023-11-17T06:30:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f069154a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f068c0cd8b0 0x7f068c161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f069154a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15d2b0 0x7f068c1616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f069154a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c160ce0 con 0x7f068c15ced0 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f069154a700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c0cdd40 con 0x7f068c0cd8b0 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f069154a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0ce020 con 0x7f068c15d2b0 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068b7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f068c0cd8b0 0x7f068c161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068bfff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f068c15ced0 0x7f068c0d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:39854/0 (socket says 172.21.15.100:39854) 2023-11-17T06:30:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068bfff700 1 -- 172.21.15.100:0/3201785451 learned_addr learned my addr 172.21.15.100:0/3201785451 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f0690d49700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15d2b0 0x7f068c1616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068b7fe700 1 -- 172.21.15.100:0/3201785451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15d2b0 msgr2=0x7f068c1616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068b7fe700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15d2b0 0x7f068c1616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068b7fe700 1 -- 172.21.15.100:0/3201785451 >> v1:172.21.15.119:6789/0 conn(0x7f068c15ced0 legacy=0x7f068c0d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068affd700 1 -- 172.21.15.100:0/3201785451 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630948227 0 0) 0x7f068c160ce0 con 0x7f068c15ced0 2023-11-17T06:30:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.959+0000 7f068b7fe700 1 -- 172.21.15.100:0/3201785451 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0ce300 con 0x7f068c0cd8b0 2023-11-17T06:30:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f068b7fe700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c0cd8b0 0x7f068c161170 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0680009850 tx=0x7f0680009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4678c50b2bbee510 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f068affd700 1 -- 172.21.15.100:0/3201785451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011830 con 0x7f068c0cd8b0 2023-11-17T06:30:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f068affd700 1 -- 172.21.15.100:0/3201785451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680011990 con 0x7f068c0cd8b0 2023-11-17T06:30:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f068affd700 1 -- 172.21.15.100:0/3201785451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011d40 con 0x7f068c0cd8b0 2023-11-17T06:30:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 -- 172.21.15.100:0/3201785451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c0cd8b0 msgr2=0x7f068c161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c0cd8b0 0x7f068c161170 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0680009850 tx=0x7f0680009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 -- 172.21.15.100:0/3201785451 shutdown_connections 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15d2b0 0x7f068c1616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 --2- 172.21.15.100:0/3201785451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c0cd8b0 0x7f068c161170 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 -- 172.21.15.100:0/3201785451 >> 172.21.15.100:0/3201785451 conn(0x7f068c06b370 msgr2=0x7f068c06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 -- 172.21.15.100:0/3201785451 shutdown_connections 2023-11-17T06:30:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 -- 172.21.15.100:0/3201785451 wait complete. 2023-11-17T06:30:44.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.963+0000 7f069154a700 1 Processor -- start 2023-11-17T06:30:44.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- start start 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 0x7f068c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15f610 0x7f068c1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0b34f0 con 0x7f068c15ced0 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c15fac0 con 0x7f068c15d2b0 2023-11-17T06:30:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1f3520 con 0x7f068c15f610 2023-11-17T06:30:44.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44566/0 (socket says 172.21.15.100:44566) 2023-11-17T06:30:44.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 -- 172.21.15.100:0/4226559077 learned_addr learned my addr 172.21.15.100:0/4226559077 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068b7fe700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 0x7f068c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f0690d49700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15f610 0x7f068c1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 -- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15f610 msgr2=0x7f068c1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15f610 0x7f068c1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 -- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 msgr2=0x7f068c15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 0x7f068c15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 -- 172.21.15.100:0/4226559077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800094b0 con 0x7f068c15ced0 2023-11-17T06:30:44.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068b7fe700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 0x7f068c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f068bfff700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c580 tx=0x7f067c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c004ca0 con 0x7f068c15ced0 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c004e20 con 0x7f068c15ced0 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c0b2b50 con 0x7f068c15ced0 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c007310 con 0x7f068c15ced0 2023-11-17T06:30:44.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.967+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c0b3110 con 0x7f068c15ced0 2023-11-17T06:30:44.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.971+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c0b9060 con 0x7f068c15ced0 2023-11-17T06:30:44.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.971+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f067c007470 con 0x7f068c15ced0 2023-11-17T06:30:44.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.975+0000 7f0688ff9700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 0x7f06780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.975+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f067c083d10 con 0x7f068c15ced0 2023-11-17T06:30:44.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.975+0000 7f068b7fe700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 0x7f06780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.975+0000 7f068b7fe700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 0x7f06780689d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0680008000 tx=0x7f0680008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:44.983+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f067c089020 con 0x7f068c15ced0 2023-11-17T06:30:45.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.163+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f068c065e90 con 0x7f068c15ced0 2023-11-17T06:30:45.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.163+0000 7f0688ff9700 1 -- 172.21.15.100:0/4226559077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f067c051070 con 0x7f068c15ced0 2023-11-17T06:30:45.169 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:45.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 msgr2=0x7f06780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 0x7f06780689d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0680008000 tx=0x7f0680008030 comp rx=0 tx=0).stop 2023-11-17T06:30:45.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 msgr2=0x7f068c1586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c580 tx=0x7f067c00c940 comp rx=0 tx=0).stop 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 shutdown_connections 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f068c15f610 0x7f068c1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f068c15d2b0 0x7f068c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0678066510 0x7f06780689d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 --2- 172.21.15.100:0/4226559077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f068c15ced0 0x7f068c1586d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 >> 172.21.15.100:0/4226559077 conn(0x7f068c06b370 msgr2=0x7f068c15c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 shutdown_connections 2023-11-17T06:30:45.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.171+0000 7f069154a700 1 -- 172.21.15.100:0/4226559077 wait complete. 2023-11-17T06:30:45.196 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:45.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.359+0000 7fd054e51700 1 Processor -- start 2023-11-17T06:30:45.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.359+0000 7fd054e51700 1 -- start start 2023-11-17T06:30:45.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd054e51700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0500cd8b0 0x7fd050161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd054e51700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd050160ce0 con 0x7fd05015d2b0 2023-11-17T06:30:45.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd054e51700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0500cdd40 con 0x7fd05015ced0 2023-11-17T06:30:45.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd054e51700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0500ce020 con 0x7fd0500cd8b0 2023-11-17T06:30:45.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0500cd8b0 0x7fd050161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0500cd8b0 0x7fd050161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44570/0 (socket says 172.21.15.100:44570) 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 -- 172.21.15.100:0/4294641600 learned_addr learned my addr 172.21.15.100:0/4294641600 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04ffff700 1 --1- 172.21.15.100:0/4294641600 >> v1:172.21.15.100:6789/0 conn(0x7fd05015d2b0 0x7fd0500d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45476/0 (socket says 172.21.15.100:45476) 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 -- 172.21.15.100:0/4294641600 >> v1:172.21.15.119:6789/0 conn(0x7fd05015ced0 legacy=0x7fd0500d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 -- 172.21.15.100:0/4294641600 >> v1:172.21.15.100:6789/0 conn(0x7fd05015d2b0 legacy=0x7fd0500d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 -- 172.21.15.100:0/4294641600 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500ce300 con 0x7fd0500cd8b0 2023-11-17T06:30:45.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04effd700 1 --2- 172.21.15.100:0/4294641600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0500cd8b0 0x7fd050161170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044009910 tx=0x7fd044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e9392b5bae39ac server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04e7fc700 1 -- 172.21.15.100:0/4294641600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400ba60 con 0x7fd0500cd8b0 2023-11-17T06:30:45.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04e7fc700 1 -- 172.21.15.100:0/4294641600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400bbc0 con 0x7fd0500cd8b0 2023-11-17T06:30:45.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.363+0000 7fd04e7fc700 1 -- 172.21.15.100:0/4294641600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044009e60 con 0x7fd0500cd8b0 2023-11-17T06:30:45.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- 172.21.15.100:0/4294641600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0500cd8b0 msgr2=0x7fd050161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 --2- 172.21.15.100:0/4294641600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0500cd8b0 0x7fd050161170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044009910 tx=0x7fd044009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- 172.21.15.100:0/4294641600 shutdown_connections 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 --2- 172.21.15.100:0/4294641600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0500cd8b0 0x7fd050161170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- 172.21.15.100:0/4294641600 >> 172.21.15.100:0/4294641600 conn(0x7fd05006b370 msgr2=0x7fd05006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- 172.21.15.100:0/4294641600 shutdown_connections 2023-11-17T06:30:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- 172.21.15.100:0/4294641600 wait complete. 2023-11-17T06:30:45.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 Processor -- start 2023-11-17T06:30:45.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.367+0000 7fd054e51700 1 -- start start 2023-11-17T06:30:45.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd05015d2b0 0x7fd0500b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 0x7fd0500cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b4b60 con 0x7fd05015ced0 2023-11-17T06:30:45.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500c6e00 con 0x7fd05015d2b0 2023-11-17T06:30:45.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b4040 con 0x7fd0500d3260 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44576/0 (socket says 172.21.15.100:44576) 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 -- 172.21.15.100:0/3893235694 learned_addr learned my addr 172.21.15.100:0/3893235694 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04effd700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd05015d2b0 0x7fd0500b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04ffff700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 0x7fd0500cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 -- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 msgr2=0x7fd0500cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 0x7fd0500cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 -- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd05015d2b0 msgr2=0x7fd0500b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd05015d2b0 0x7fd0500b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 -- 172.21.15.100:0/3893235694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009570 con 0x7fd05015ced0 2023-11-17T06:30:45.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04ffff700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 0x7fd0500cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:45.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd04f7fe700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c500 tx=0x7fd04000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400052d0 con 0x7fd05015ced0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0500b42c0 con 0x7fd05015ced0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd040005430 con 0x7fd05015ced0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400055a0 con 0x7fd05015ced0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.371+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0500b4880 con 0x7fd05015ced0 2023-11-17T06:30:45.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.375+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0500c6f40 con 0x7fd05015ced0 2023-11-17T06:30:45.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.375+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0400038e0 con 0x7fd05015ced0 2023-11-17T06:30:45.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.375+0000 7fd037fff700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 0x7fd03c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.375+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd040083330 con 0x7fd05015ced0 2023-11-17T06:30:45.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.375+0000 7fd04effd700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 0x7fd03c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.379+0000 7fd04effd700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 0x7fd03c068a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd044009c60 tx=0x7fd044008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.383+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0500c6f40 con 0x7fd05015ced0 2023-11-17T06:30:45.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.555+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0500c6f40 con 0x7fd05015ced0 2023-11-17T06:30:45.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.555+0000 7fd037fff700 1 -- 172.21.15.100:0/3893235694 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0500c6f40 con 0x7fd05015ced0 2023-11-17T06:30:45.561 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 msgr2=0x7fd03c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 0x7fd03c068a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd044009c60 tx=0x7fd044008030 comp rx=0 tx=0).stop 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 msgr2=0x7fd0500c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c500 tx=0x7fd04000c810 comp rx=0 tx=0).stop 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 shutdown_connections 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0500d3260 0x7fd0500cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd05015d2b0 0x7fd0500b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd03c066540 0x7fd03c068a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 --2- 172.21.15.100:0/3893235694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd05015ced0 0x7fd0500c9230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 >> 172.21.15.100:0/3893235694 conn(0x7fd05006b370 msgr2=0x7fd05015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 shutdown_connections 2023-11-17T06:30:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.559+0000 7fd054e51700 1 -- 172.21.15.100:0/3893235694 wait complete. 2023-11-17T06:30:45.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:45.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.759+0000 7fbeca1a6700 1 Processor -- start 2023-11-17T06:30:45.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.759+0000 7fbeca1a6700 1 -- start start 2023-11-17T06:30:45.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbeca1a6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbec415ced0 0x7fbec40d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbeca1a6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415d2b0 0x7fbec40d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbeca1a6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec4160ce0 con 0x7fbec40cd8b0 2023-11-17T06:30:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbeca1a6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40cdd40 con 0x7fbec415ced0 2023-11-17T06:30:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbeca1a6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40ce020 con 0x7fbec415d2b0 2023-11-17T06:30:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbec415ced0 0x7fbec40d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbec415ced0 0x7fbec40d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44580/0 (socket says 172.21.15.100:44580) 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 -- 172.21.15.100:0/2273854484 learned_addr learned my addr 172.21.15.100:0/2273854484 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec99a5700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415d2b0 0x7fbec40d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 -- 172.21.15.100:0/2273854484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415d2b0 msgr2=0x7fbec40d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415d2b0 0x7fbec40d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 -- 172.21.15.100:0/2273854484 >> v1:172.21.15.119:6789/0 conn(0x7fbec40cd8b0 legacy=0x7fbec4161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 -- 172.21.15.100:0/2273854484 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40ce300 con 0x7fbec415ced0 2023-11-17T06:30:45.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.763+0000 7fbec91a4700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415ced0 0x7fbec40d0fe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009910 tx=0x7fbec0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29860730966c9369 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbebbfff700 1 -- 172.21.15.100:0/2273854484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0011830 con 0x7fbec415ced0 2023-11-17T06:30:45.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbebbfff700 1 -- 172.21.15.100:0/2273854484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0011990 con 0x7fbec415ced0 2023-11-17T06:30:45.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbebbfff700 1 -- 172.21.15.100:0/2273854484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0011d40 con 0x7fbec415ced0 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 -- 172.21.15.100:0/2273854484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415ced0 msgr2=0x7fbec40d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415ced0 0x7fbec40d0fe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009910 tx=0x7fbec0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 -- 172.21.15.100:0/2273854484 shutdown_connections 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415d2b0 0x7fbec40d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/2273854484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415ced0 0x7fbec40d0fe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 -- 172.21.15.100:0/2273854484 >> 172.21.15.100:0/2273854484 conn(0x7fbec406b370 msgr2=0x7fbec406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 -- 172.21.15.100:0/2273854484 shutdown_connections 2023-11-17T06:30:45.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.767+0000 7fbeca1a6700 1 -- 172.21.15.100:0/2273854484 wait complete. 2023-11-17T06:30:45.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 Processor -- start 2023-11-17T06:30:45.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 -- start start 2023-11-17T06:30:45.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 0x7fbec41f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 0x7fbec40cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbec40ccc70 0x7fbec40b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4153050 con 0x7fbec415d2b0 2023-11-17T06:30:45.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41f2760 con 0x7fbec40ccc70 2023-11-17T06:30:45.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbeca1a6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b3210 con 0x7fbec415ced0 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbec89a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 0x7fbec40cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbec91a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 0x7fbec41f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbec89a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 0x7fbec40cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44592/0 (socket says 172.21.15.100:44592) 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbec89a3700 1 -- 172.21.15.100:0/1494181516 learned_addr learned my addr 172.21.15.100:0/1494181516 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.771+0000 7fbec99a5700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbec40ccc70 0x7fbec40b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 -- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbec40ccc70 msgr2=0x7fbec40b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbec40ccc70 0x7fbec40b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 -- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 msgr2=0x7fbec40cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 0x7fbec40cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 -- 172.21.15.100:0/1494181516 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009570 con 0x7fbec415ced0 2023-11-17T06:30:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbec91a4700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 0x7fbec41f2220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbec0016000 tx=0x7fbec0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0004510 con 0x7fbec415ced0 2023-11-17T06:30:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec00036c0 con 0x7fbec415ced0 2023-11-17T06:30:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40ca3c0 con 0x7fbec415ced0 2023-11-17T06:30:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0003a70 con 0x7fbec415ced0 2023-11-17T06:30:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40b2b50 con 0x7fbec415ced0 2023-11-17T06:30:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.775+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40d0bf0 con 0x7fbec415ced0 2023-11-17T06:30:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.779+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbec0003bd0 con 0x7fbec415ced0 2023-11-17T06:30:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.779+0000 7fbeb9ffb700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 0x7fbea8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.779+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbec0021030 con 0x7fbec415ced0 2023-11-17T06:30:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.779+0000 7fbec89a3700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 0x7fbea8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.783+0000 7fbec89a3700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 0x7fbea8068a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbec40b5b80 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.791+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbec0052850 con 0x7fbec415ced0 2023-11-17T06:30:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.971+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbec4065e90 con 0x7fbec415ced0 2023-11-17T06:30:45.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.971+0000 7fbeb9ffb700 1 -- 172.21.15.100:0/1494181516 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbec0055e70 con 0x7fbec415ced0 2023-11-17T06:30:45.975 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 msgr2=0x7fbea8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 0x7fbea8068a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbec40b5b80 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 msgr2=0x7fbec41f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 0x7fbec41f2220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbec0016000 tx=0x7fbec0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 shutdown_connections 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbec40ccc70 0x7fbec40b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbea8066540 0x7fbea8068a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec415d2b0 0x7fbec40cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 --2- 172.21.15.100:0/1494181516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbec415ced0 0x7fbec41f2220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 >> 172.21.15.100:0/1494181516 conn(0x7fbec406b370 msgr2=0x7fbec40d38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 shutdown_connections 2023-11-17T06:30:45.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:45.975+0000 7fbeca1a6700 1 -- 172.21.15.100:0/1494181516 wait complete. 2023-11-17T06:30:46.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.171+0000 7f58d584d700 1 Processor -- start 2023-11-17T06:30:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.171+0000 7f58d584d700 1 -- start start 2023-11-17T06:30:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d584d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d015d1c0 0x7f58d0160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d584d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58d0161380 0x7f58d00cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d584d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d01619b0 con 0x7f58d00cff20 2023-11-17T06:30:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d584d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00d0390 con 0x7f58d0161380 2023-11-17T06:30:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d584d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00d1180 con 0x7f58d015d1c0 2023-11-17T06:30:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58d0161380 0x7f58d00cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58d0161380 0x7f58d00cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44604/0 (socket says 172.21.15.100:44604) 2023-11-17T06:30:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 -- 172.21.15.100:0/4256842604 learned_addr learned my addr 172.21.15.100:0/4256842604 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58d484b700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d015d1c0 0x7f58d0160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 -- 172.21.15.100:0/4256842604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d015d1c0 msgr2=0x7f58d0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d015d1c0 0x7f58d0160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 -- 172.21.15.100:0/4256842604 >> v1:172.21.15.119:6789/0 conn(0x7f58d00cff20 legacy=0x7f58d00b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 -- 172.21.15.100:0/4256842604 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00d1460 con 0x7f58d0161380 2023-11-17T06:30:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.175+0000 7f58cffff700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d0161380 0x7f58d00cf9e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009910 tx=0x7f58c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3176e51123969ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58cf7fe700 1 -- 172.21.15.100:0/4256842604 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011830 con 0x7f58d0161380 2023-11-17T06:30:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58cf7fe700 1 -- 172.21.15.100:0/4256842604 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0011990 con 0x7f58d0161380 2023-11-17T06:30:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58cf7fe700 1 -- 172.21.15.100:0/4256842604 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011d40 con 0x7f58d0161380 2023-11-17T06:30:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 -- 172.21.15.100:0/4256842604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d0161380 msgr2=0x7f58d00cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d0161380 0x7f58d00cf9e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009910 tx=0x7f58c0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 -- 172.21.15.100:0/4256842604 shutdown_connections 2023-11-17T06:30:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d0161380 0x7f58d00cf9e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 --2- 172.21.15.100:0/4256842604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d015d1c0 0x7f58d0160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 -- 172.21.15.100:0/4256842604 >> 172.21.15.100:0/4256842604 conn(0x7f58d00d2fd0 msgr2=0x7f58d00d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 -- 172.21.15.100:0/4256842604 shutdown_connections 2023-11-17T06:30:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.179+0000 7f58d584d700 1 -- 172.21.15.100:0/4256842604 wait complete. 2023-11-17T06:30:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 Processor -- start 2023-11-17T06:30:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 -- start start 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58d015d1c0 0x7f58d00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d0161380 0x7f58d0158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f6690 con 0x7f58d00cff20 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00caa30 con 0x7f58d015d1c0 2023-11-17T06:30:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d584d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f5fd0 con 0x7f58d0161380 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44618/0 (socket says 172.21.15.100:44618) 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 -- 172.21.15.100:0/561997281 learned_addr learned my addr 172.21.15.100:0/561997281 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58cffff700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58d015d1c0 0x7f58d00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d504c700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d0161380 0x7f58d0158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 -- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d0161380 msgr2=0x7f58d0158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d0161380 0x7f58d0158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 -- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58d015d1c0 msgr2=0x7f58d00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58d015d1c0 0x7f58d00c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.183+0000 7f58d484b700 1 -- 172.21.15.100:0/561997281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0009570 con 0x7f58d00cff20 2023-11-17T06:30:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58d484b700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58c400ebe0 tx=0x7f58c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4009740 con 0x7f58d00cff20 2023-11-17T06:30:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d01f62b0 con 0x7f58d00cff20 2023-11-17T06:30:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c400c850 con 0x7f58d00cff20 2023-11-17T06:30:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400cbe0 con 0x7f58d00cff20 2023-11-17T06:30:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d00c8d50 con 0x7f58d00cff20 2023-11-17T06:30:46.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.187+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d01f67d0 con 0x7f58d00cff20 2023-11-17T06:30:46.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.191+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58c400cd40 con 0x7f58d00cff20 2023-11-17T06:30:46.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.191+0000 7f58cd7fa700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 0x7f58bc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.191+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f58c4083f20 con 0x7f58d00cff20 2023-11-17T06:30:46.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.191+0000 7f58cffff700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 0x7f58bc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.191+0000 7f58cffff700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 0x7f58bc0689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.199+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58d01f67d0 con 0x7f58d00cff20 2023-11-17T06:30:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.383+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f58d01f67d0 con 0x7f58d00cff20 2023-11-17T06:30:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.383+0000 7f58cd7fa700 1 -- 172.21.15.100:0/561997281 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f58d01f67d0 con 0x7f58d00cff20 2023-11-17T06:30:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 msgr2=0x7f58bc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 0x7f58bc0689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 msgr2=0x7f58d00ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58c400ebe0 tx=0x7f58c400eef0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 shutdown_connections 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58d0161380 0x7f58d0158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58d015d1c0 0x7f58d00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58bc066510 0x7f58bc0689d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 --2- 172.21.15.100:0/561997281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58d00cff20 0x7f58d00ca130 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 >> 172.21.15.100:0/561997281 conn(0x7f58d00d2fd0 msgr2=0x7f58d015c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 shutdown_connections 2023-11-17T06:30:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.387+0000 7f58d584d700 1 -- 172.21.15.100:0/561997281 wait complete. 2023-11-17T06:30:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:30:46.414 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-11-17T06:30:46.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:46.415 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:46.457 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:46.457 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:30:46.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:46.457 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-17T06:30:46.525 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-17T06:30:46.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.703+0000 7f82d1e14700 1 Processor -- start 2023-11-17T06:30:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.703+0000 7f82d1e14700 1 -- start start 2023-11-17T06:30:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1e14700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f82cc06b990 0x7f82cc165c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1e14700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc06bda0 con 0x7f82cc165180 2023-11-17T06:30:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1e14700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0c9200 con 0x7f82cc0c21b0 2023-11-17T06:30:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1e14700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0cb450 con 0x7f82cc06b990 2023-11-17T06:30:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d0e12700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f82cc165180 0x7f82cc0ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45480/0 (socket says 172.21.15.100:45480) 2023-11-17T06:30:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d0e12700 1 -- 172.21.15.100:0/3811936188 learned_addr learned my addr 172.21.15.100:0/3811936188 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1613700 1 --2- 172.21.15.100:0/3811936188 >> v2:172.21.15.119:3300/0 conn(0x7f82cc06b990 0x7f82cc165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303410091 0 0) 0x7f82c8001110 con 0x7f82cc165180 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b40035d0 con 0x7f82cc165180 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1613700 1 -- 172.21.15.100:0/3811936188 >> v1:172.21.15.119:6789/0 conn(0x7f82cc0c21b0 legacy=0x7f82cc165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4201532816 0 0) 0x7f82b40035d0 con 0x7f82cc165180 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1613700 1 -- 172.21.15.100:0/3811936188 >> v1:172.21.15.100:6789/0 conn(0x7f82cc165180 legacy=0x7f82cc0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1613700 1 -- 172.21.15.100:0/3811936188 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0c9450 con 0x7f82cc06b990 2023-11-17T06:30:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82d1613700 1 --2- 172.21.15.100:0/3811936188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc165c70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009d90 tx=0x7f82c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1519d690d2449036 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400e070 con 0x7f82cc06b990 2023-11-17T06:30:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4003a40 con 0x7f82cc06b990 2023-11-17T06:30:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.707+0000 7f82c37fe700 1 -- 172.21.15.100:0/3811936188 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8001800 con 0x7f82cc06b990 2023-11-17T06:30:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- 172.21.15.100:0/3811936188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 msgr2=0x7f82cc165c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 --2- 172.21.15.100:0/3811936188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc165c70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009d90 tx=0x7f82c400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- 172.21.15.100:0/3811936188 shutdown_connections 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 --2- 172.21.15.100:0/3811936188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc165c70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- 172.21.15.100:0/3811936188 >> 172.21.15.100:0/3811936188 conn(0x7f82cc0cebb0 msgr2=0x7f82cc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- 172.21.15.100:0/3811936188 shutdown_connections 2023-11-17T06:30:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- 172.21.15.100:0/3811936188 wait complete. 2023-11-17T06:30:46.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 Processor -- start 2023-11-17T06:30:46.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.711+0000 7f82d1e14700 1 -- start start 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc1f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82cc165180 0x7f82cc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c5f60 con 0x7f82cc0c21b0 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c8b50 con 0x7f82cc06b990 2023-11-17T06:30:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c4420 con 0x7f82cc165180 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44630/0 (socket says 172.21.15.100:44630) 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 -- 172.21.15.100:0/1069931038 learned_addr learned my addr 172.21.15.100:0/1069931038 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d0e12700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc1f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1613700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82cc165180 0x7f82cc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 -- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82cc165180 msgr2=0x7f82cc14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82cc165180 0x7f82cc14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 -- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 msgr2=0x7f82cc1f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc1f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 -- 172.21.15.100:0/1069931038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009a70 con 0x7f82cc0c21b0 2023-11-17T06:30:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d0e12700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc1f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c3fff700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c410 tx=0x7f82bc00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0052d0 con 0x7f82cc0c21b0 2023-11-17T06:30:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc005430 con 0x7f82cc0c21b0 2023-11-17T06:30:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc0c4700 con 0x7f82cc0c21b0 2023-11-17T06:30:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.715+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0055a0 con 0x7f82cc0c21b0 2023-11-17T06:30:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.719+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0c4000 con 0x7f82cc0c21b0 2023-11-17T06:30:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.719+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc067960 con 0x7f82cc0c21b0 2023-11-17T06:30:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.719+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f82bc0036a0 con 0x7f82cc0c21b0 2023-11-17T06:30:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.723+0000 7f82c17fa700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 0x7f82b80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.723+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f82bc083150 con 0x7f82cc0c21b0 2023-11-17T06:30:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.723+0000 7f82d0e12700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 0x7f82b80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.723+0000 7f82d0e12700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 0x7f82b80689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82c8004e20 tx=0x7f82c80017f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.727+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82bc0504b0 con 0x7f82cc0c21b0 2023-11-17T06:30:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.939+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82cc0cde10 con 0x7f82cc0c21b0 2023-11-17T06:30:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.939+0000 7f82c17fa700 1 -- 172.21.15.100:0/1069931038 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f82bc053ad0 con 0x7f82cc0c21b0 2023-11-17T06:30:46.944 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:46.944 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 msgr2=0x7f82b80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 0x7f82b80689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82c8004e20 tx=0x7f82c80017f0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 msgr2=0x7f82cc14bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c410 tx=0x7f82bc00c720 comp rx=0 tx=0).stop 2023-11-17T06:30:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 shutdown_connections 2023-11-17T06:30:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82cc165180 0x7f82cc14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f82b8066510 0x7f82b80689d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82cc0c21b0 0x7f82cc14bc90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 --2- 172.21.15.100:0/1069931038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82cc06b990 0x7f82cc1f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 >> 172.21.15.100:0/1069931038 conn(0x7f82cc0cebb0 msgr2=0x7f82cc0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 shutdown_connections 2023-11-17T06:30:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:46.943+0000 7f82d1e14700 1 -- 172.21.15.100:0/1069931038 wait complete. 2023-11-17T06:30:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:30:46.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.147+0000 7f73a10f2700 1 Processor -- start 2023-11-17T06:30:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.147+0000 7f73a10f2700 1 -- start start 2023-11-17T06:30:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f739c144ac0 0x7f739c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c06d160 con 0x7f739c0cde70 2023-11-17T06:30:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c06d440 con 0x7f739c0c9a10 2023-11-17T06:30:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c06da00 con 0x7f739c144ac0 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f739c144ac0 0x7f739c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f7393fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f739c0cde70 0x7f739c0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45492/0 (socket says 172.21.15.100:45492) 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f7393fff700 1 -- 172.21.15.100:0/3015705285 learned_addr learned my addr 172.21.15.100:0/3015705285 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739bfff700 1 -- 172.21.15.100:0/3015705285 >> v1:172.21.15.119:6789/0 conn(0x7f739c0c9a10 legacy=0x7f739c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739bfff700 1 -- 172.21.15.100:0/3015705285 >> v1:172.21.15.100:6789/0 conn(0x7f739c0cde70 legacy=0x7f739c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739bfff700 1 -- 172.21.15.100:0/3015705285 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c06d720 con 0x7f739c144ac0 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739bfff700 1 --2- 172.21.15.100:0/3015705285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c144ac0 0x7f739c06ca30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f738c009850 tx=0x7f738c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2fcc704f70634a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739b7fe700 1 -- 172.21.15.100:0/3015705285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c011830 con 0x7f739c144ac0 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739b7fe700 1 -- 172.21.15.100:0/3015705285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c011990 con 0x7f739c144ac0 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f739b7fe700 1 -- 172.21.15.100:0/3015705285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c011d20 con 0x7f739c144ac0 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 -- 172.21.15.100:0/3015705285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c144ac0 msgr2=0x7f739c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.151+0000 7f73a10f2700 1 --2- 172.21.15.100:0/3015705285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c144ac0 0x7f739c06ca30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f738c009850 tx=0x7f738c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 -- 172.21.15.100:0/3015705285 shutdown_connections 2023-11-17T06:30:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 --2- 172.21.15.100:0/3015705285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c144ac0 0x7f739c06ca30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 -- 172.21.15.100:0/3015705285 >> 172.21.15.100:0/3015705285 conn(0x7f739c0cb730 msgr2=0x7f739c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 -- 172.21.15.100:0/3015705285 shutdown_connections 2023-11-17T06:30:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 -- 172.21.15.100:0/3015705285 wait complete. 2023-11-17T06:30:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 Processor -- start 2023-11-17T06:30:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.155+0000 7f73a10f2700 1 -- start start 2023-11-17T06:30:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f739c0cde70 0x7f739c1f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f739c144ac0 0x7f739c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0c41b0 con 0x7f739c0c9a10 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1f3160 con 0x7f739c144ac0 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1f5fe0 con 0x7f739c0cde70 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44652/0 (socket says 172.21.15.100:44652) 2023-11-17T06:30:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 -- 172.21.15.100:0/2589931780 learned_addr learned my addr 172.21.15.100:0/2589931780 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f7393fff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f739c0cde70 0x7f739c1f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a08f1700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f739c144ac0 0x7f739c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 -- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f739c0cde70 msgr2=0x7f739c1f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f739c0cde70 0x7f739c1f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 -- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f739c144ac0 msgr2=0x7f739c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f739c144ac0 0x7f739c15d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 -- 172.21.15.100:0/2589931780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0094b0 con 0x7f739c0c9a10 2023-11-17T06:30:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f739bfff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f738c009fd0 tx=0x7f738c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0036c0 con 0x7f739c0c9a10 2023-11-17T06:30:47.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c01e070 con 0x7f739c0c9a10 2023-11-17T06:30:47.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c15dc70 con 0x7f739c0c9a10 2023-11-17T06:30:47.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.159+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c003a80 con 0x7f739c0c9a10 2023-11-17T06:30:47.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.163+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c0c46e0 con 0x7f739c0c9a10 2023-11-17T06:30:47.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.163+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c065e90 con 0x7f739c0c9a10 2023-11-17T06:30:47.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.163+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f738c003be0 con 0x7f739c0c9a10 2023-11-17T06:30:47.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.167+0000 7f73997fa700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 0x7f737c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.167+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f738c020070 con 0x7f739c0c9a10 2023-11-17T06:30:47.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.167+0000 7f7393fff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 0x7f737c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.167+0000 7f7393fff700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 0x7f737c0689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f739c0c6260 tx=0x7f7384009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.171+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f738c0528a0 con 0x7f739c0c9a10 2023-11-17T06:30:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.347+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f739c0c9530 con 0x7f739c0c9a10 2023-11-17T06:30:47.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.351+0000 7f73997fa700 1 -- 172.21.15.100:0/2589931780 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f738c055ec0 con 0x7f739c0c9a10 2023-11-17T06:30:47.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:47.357 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:37.002511+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 msgr2=0x7f737c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 0x7f737c0689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f739c0c6260 tx=0x7f7384009040 comp rx=0 tx=0).stop 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 msgr2=0x7f739c1f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f738c009fd0 tx=0x7f738c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 shutdown_connections 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f739c144ac0 0x7f739c15d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f739c0cde70 0x7f739c1f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f737c066510 0x7f737c0689d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 --2- 172.21.15.100:0/2589931780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c0c9a10 0x7f739c1f2c20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 >> 172.21.15.100:0/2589931780 conn(0x7f739c0cb730 msgr2=0x7f739c0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 shutdown_connections 2023-11-17T06:30:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.355+0000 7f73a10f2700 1 -- 172.21.15.100:0/2589931780 wait complete. 2023-11-17T06:30:47.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:37.771367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:38.450536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:47.383 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:47.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 Processor -- start 2023-11-17T06:30:47.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 -- start start 2023-11-17T06:30:47.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67e4161590 0x7f67e40ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67e40cf7e0 0x7f67e40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40c9810 con 0x7f67e40c2390 2023-11-17T06:30:47.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40cd980 con 0x7f67e4161590 2023-11-17T06:30:47.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.563+0000 7f67eabad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40cd3c0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e93aa700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f67e40c2390 0x7f67e40cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45504/0 (socket says 172.21.15.100:45504) 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e93aa700 1 -- 172.21.15.100:0/1576916868 learned_addr learned my addr 172.21.15.100:0/1576916868 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67e4161590 0x7f67e40ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67ea3ac700 1 --2- 172.21.15.100:0/1576916868 >> v2:172.21.15.119:3300/0 conn(0x7f67e40cf7e0 0x7f67e40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e8ba9700 1 -- 172.21.15.100:0/1576916868 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242050429 0 0) 0x7f67e40c9810 con 0x7f67e40c2390 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e8ba9700 1 -- 172.21.15.100:0/1576916868 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d00035d0 con 0x7f67e40c2390 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 -- 172.21.15.100:0/1576916868 >> v2:172.21.15.119:3300/0 conn(0x7f67e40cf7e0 msgr2=0x7f67e40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 --2- 172.21.15.100:0/1576916868 >> v2:172.21.15.119:3300/0 conn(0x7f67e40cf7e0 0x7f67e40cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 -- 172.21.15.100:0/1576916868 >> v1:172.21.15.100:6789/0 conn(0x7f67e40c2390 legacy=0x7f67e40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 -- 172.21.15.100:0/1576916868 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40cd6a0 con 0x7f67e4161590 2023-11-17T06:30:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e9bab700 1 --2- 172.21.15.100:0/1576916868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e4161590 0x7f67e40ce4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f67e40c1ad0 tx=0x7f67e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6185cd1fa8d0244 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e8ba9700 1 -- 172.21.15.100:0/1576916868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011830 con 0x7f67e4161590 2023-11-17T06:30:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e8ba9700 1 -- 172.21.15.100:0/1576916868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0011990 con 0x7f67e4161590 2023-11-17T06:30:47.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67e8ba9700 1 -- 172.21.15.100:0/1576916868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011d20 con 0x7f67e4161590 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 -- 172.21.15.100:0/1576916868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e4161590 msgr2=0x7f67e40ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 --2- 172.21.15.100:0/1576916868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e4161590 0x7f67e40ce4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f67e40c1ad0 tx=0x7f67e0009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 -- 172.21.15.100:0/1576916868 shutdown_connections 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 --2- 172.21.15.100:0/1576916868 >> v2:172.21.15.119:3300/0 conn(0x7f67e40cf7e0 0x7f67e40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 --2- 172.21.15.100:0/1576916868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e4161590 0x7f67e40ce4b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 -- 172.21.15.100:0/1576916868 >> 172.21.15.100:0/1576916868 conn(0x7f67e406a690 msgr2=0x7f67e406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 -- 172.21.15.100:0/1576916868 shutdown_connections 2023-11-17T06:30:47.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.567+0000 7f67eabad700 1 -- 172.21.15.100:0/1576916868 wait complete. 2023-11-17T06:30:47.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.571+0000 7f67eabad700 1 Processor -- start 2023-11-17T06:30:47.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.571+0000 7f67eabad700 1 -- start start 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.571+0000 7f67eabad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67e40c2390 0x7f67e415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e4161590 0x7f67e40c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e415a9d0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e40c37d0 con 0x7f67e4161590 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e40c2770 con 0x7f67e40c2390 2023-11-17T06:30:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44676/0 (socket says 172.21.15.100:44676) 2023-11-17T06:30:47.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 -- 172.21.15.100:0/2833550521 learned_addr learned my addr 172.21.15.100:0/2833550521 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e9bab700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67e40c2390 0x7f67e415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67ea3ac700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e4161590 0x7f67e40c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 -- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67e40c2390 msgr2=0x7f67e415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67e40c2390 0x7f67e415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 -- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e4161590 msgr2=0x7f67e40c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e4161590 0x7f67e40c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 -- 172.21.15.100:0/2833550521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00094b0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67e93aa700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c700 tx=0x7f67d400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4005d90 con 0x7f67e40cf7e0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40070d0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4007480 con 0x7f67e40cf7e0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e40c2a10 con 0x7f67e40cf7e0 2023-11-17T06:30:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.575+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e40c2fd0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e4067e10 con 0x7f67e40cf7e0 2023-11-17T06:30:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f67d40075e0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67da7fc700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 0x7f67c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f67d4083510 con 0x7f67e40cf7e0 2023-11-17T06:30:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67e9bab700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 0x7f67c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.579+0000 7f67e9bab700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 0x7f67c80689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.587+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f67d4050880 con 0x7f67e40cf7e0 2023-11-17T06:30:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.755+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67e4065e90 con 0x7f67e40cf7e0 2023-11-17T06:30:47.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.759+0000 7f67da7fc700 1 -- 172.21.15.100:0/2833550521 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67d4053ea0 con 0x7f67e40cf7e0 2023-11-17T06:30:47.763 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 msgr2=0x7f67c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 0x7f67c80689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 msgr2=0x7f67e41605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c700 tx=0x7f67d400cac0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 shutdown_connections 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e4161590 0x7f67e40c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f67c8066510 0x7f67c80689d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67e40cf7e0 0x7f67e41605d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 --2- 172.21.15.100:0/2833550521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67e40c2390 0x7f67e415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 >> 172.21.15.100:0/2833550521 conn(0x7f67e406a690 msgr2=0x7f67e40b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 shutdown_connections 2023-11-17T06:30:47.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.763+0000 7f67eabad700 1 -- 172.21.15.100:0/2833550521 wait complete. 2023-11-17T06:30:47.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:47.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.967+0000 7ff3148b2700 1 Processor -- start 2023-11-17T06:30:47.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.967+0000 7ff3148b2700 1 -- start start 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff3148b2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff3100cd8b0 0x7ff310161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff3148b2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff310160ce0 con 0x7ff31015ced0 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff3148b2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100cdd40 con 0x7ff31015d2b0 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff3148b2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100ce020 con 0x7ff3100cd8b0 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30ed9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff31015ced0 0x7ff3100d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45516/0 (socket says 172.21.15.100:45516) 2023-11-17T06:30:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30e59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff3100cd8b0 0x7ff310161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30ed9d700 1 -- 172.21.15.100:0/4219047284 learned_addr learned my addr 172.21.15.100:0/4219047284 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748585723 0 0) 0x7ff310160ce0 con 0x7ff31015ced0 2023-11-17T06:30:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f80035d0 con 0x7ff31015ced0 2023-11-17T06:30:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383846874 0 0) 0x7ff3100cdd40 con 0x7ff31015d2b0 2023-11-17T06:30:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff310160ce0 con 0x7ff31015d2b0 2023-11-17T06:30:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30e59c700 1 -- 172.21.15.100:0/4219047284 >> v1:172.21.15.119:6789/0 conn(0x7ff31015d2b0 legacy=0x7ff3100d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30e59c700 1 -- 172.21.15.100:0/4219047284 >> v1:172.21.15.100:6789/0 conn(0x7ff31015ced0 legacy=0x7ff3100d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30e59c700 1 -- 172.21.15.100:0/4219047284 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100ce300 con 0x7ff3100cd8b0 2023-11-17T06:30:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30e59c700 1 --2- 172.21.15.100:0/4219047284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3100cd8b0 0x7ff310161170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff304009850 tx=0x7ff304009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f1b0449111b010 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.971+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011830 con 0x7ff3100cd8b0 2023-11-17T06:30:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011990 con 0x7ff3100cd8b0 2023-11-17T06:30:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff30dd9b700 1 -- 172.21.15.100:0/4219047284 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011d00 con 0x7ff3100cd8b0 2023-11-17T06:30:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 -- 172.21.15.100:0/4219047284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3100cd8b0 msgr2=0x7ff310161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 --2- 172.21.15.100:0/4219047284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3100cd8b0 0x7ff310161170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff304009850 tx=0x7ff304009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 -- 172.21.15.100:0/4219047284 shutdown_connections 2023-11-17T06:30:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 --2- 172.21.15.100:0/4219047284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3100cd8b0 0x7ff310161170 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 -- 172.21.15.100:0/4219047284 >> 172.21.15.100:0/4219047284 conn(0x7ff31006b370 msgr2=0x7ff31006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 -- 172.21.15.100:0/4219047284 shutdown_connections 2023-11-17T06:30:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.975+0000 7ff3148b2700 1 -- 172.21.15.100:0/4219047284 wait complete. 2023-11-17T06:30:47.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 Processor -- start 2023-11-17T06:30:47.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 -- start start 2023-11-17T06:30:47.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 0x7ff3101f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff31015d2b0 0x7ff3101f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310159d00 con 0x7ff310159310 2023-11-17T06:30:47.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101f6c40 con 0x7ff31015ced0 2023-11-17T06:30:47.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff3148b2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff310154a60 con 0x7ff31015d2b0 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff30f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff30f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44696/0 (socket says 172.21.15.100:44696) 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff30ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 0x7ff3101f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff30f59e700 1 -- 172.21.15.100:0/2252323858 learned_addr learned my addr 172.21.15.100:0/2252323858 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.979+0000 7ff30e59c700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff31015d2b0 0x7ff3101f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 -- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff31015d2b0 msgr2=0x7ff3101f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff31015d2b0 0x7ff3101f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 -- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 msgr2=0x7ff3101f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 0x7ff3101f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 -- 172.21.15.100:0/2252323858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040094b0 con 0x7ff310159310 2023-11-17T06:30:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30ed9d700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 0x7ff3101f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff30f59e700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff30800cc20 tx=0x7ff30800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308003c20 con 0x7ff310159310 2023-11-17T06:30:47.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308003d80 con 0x7ff310159310 2023-11-17T06:30:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff310155880 con 0x7ff310159310 2023-11-17T06:30:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800aae0 con 0x7ff310159310 2023-11-17T06:30:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff310155e40 con 0x7ff310159310 2023-11-17T06:30:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.983+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3100b3dd0 con 0x7ff310159310 2023-11-17T06:30:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.987+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff30800ac40 con 0x7ff310159310 2023-11-17T06:30:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.987+0000 7ff2f77fe700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 0x7ff2fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.987+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff308083ee0 con 0x7ff310159310 2023-11-17T06:30:47.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.987+0000 7ff30ed9d700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 0x7ff2fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.987+0000 7ff30ed9d700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 0x7ff2fc0689d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f60 tx=0x7ff300007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:47.995+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3100b3dd0 con 0x7ff310159310 2023-11-17T06:30:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.167+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3100b3dd0 con 0x7ff310159310 2023-11-17T06:30:48.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.167+0000 7ff2f77fe700 1 -- 172.21.15.100:0/2252323858 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3100b3dd0 con 0x7ff310159310 2023-11-17T06:30:48.173 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:30:48.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.171+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 msgr2=0x7ff2fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.171+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 0x7ff2fc0689d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f60 tx=0x7ff300007e20 comp rx=0 tx=0).stop 2023-11-17T06:30:48.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.171+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 msgr2=0x7ff3101597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.171+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff30800cc20 tx=0x7ff30800cf30 comp rx=0 tx=0).stop 2023-11-17T06:30:48.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 shutdown_connections 2023-11-17T06:30:48.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff2fc066510 0x7ff2fc0689d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff310159310 0x7ff3101597c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff31015d2b0 0x7ff3101f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 --2- 172.21.15.100:0/2252323858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff31015ced0 0x7ff3101f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 >> 172.21.15.100:0/2252323858 conn(0x7ff31006b370 msgr2=0x7ff3100b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 shutdown_connections 2023-11-17T06:30:48.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.175+0000 7ff3148b2700 1 -- 172.21.15.100:0/2252323858 wait complete. 2023-11-17T06:30:48.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.383+0000 7fc2330cb700 1 Processor -- start 2023-11-17T06:30:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.383+0000 7fc2330cb700 1 -- start start 2023-11-17T06:30:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc2330cb700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 0x7fc22c071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc2330cb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc22c0b1410 0x7fc22c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc2330cb700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0cb3b0 con 0x7fc22c0cad70 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc2330cb700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c0cc690 con 0x7fc22c0b1410 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc2330cb700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c0cf8a0 con 0x7fc22c15b250 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc22c0b1410 0x7fc22c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc22c0cad70 0x7fc22c0b0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45532/0 (socket says 172.21.15.100:45532) 2023-11-17T06:30:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22bfff700 1 -- 172.21.15.100:0/4154229488 learned_addr learned my addr 172.21.15.100:0/4154229488 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc230e67700 1 --2- 172.21.15.100:0/4154229488 >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 0x7fc22c071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 -- 172.21.15.100:0/4154229488 >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 msgr2=0x7fc22c071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 --2- 172.21.15.100:0/4154229488 >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 0x7fc22c071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 -- 172.21.15.100:0/4154229488 >> v1:172.21.15.100:6789/0 conn(0x7fc22c0cad70 legacy=0x7fc22c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22b7fe700 1 -- 172.21.15.100:0/4154229488 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186397479 0 0) 0x7fc22c0cb3b0 con 0x7fc22c0cad70 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 -- 172.21.15.100:0/4154229488 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0cfb80 con 0x7fc22c0b1410 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc230e67700 1 --2- 172.21.15.100:0/4154229488 >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 0x7fc22c071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc231668700 1 --2- 172.21.15.100:0/4154229488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c15ee00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0cbf00 tx=0x7fc22400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61884032ea6fd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22b7fe700 1 -- 172.21.15.100:0/4154229488 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400e070 con 0x7fc22c0b1410 2023-11-17T06:30:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22b7fe700 1 -- 172.21.15.100:0/4154229488 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22400bbd0 con 0x7fc22c0b1410 2023-11-17T06:30:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.387+0000 7fc22b7fe700 1 -- 172.21.15.100:0/4154229488 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224012430 con 0x7fc22c0b1410 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 -- 172.21.15.100:0/4154229488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 msgr2=0x7fc22c15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 --2- 172.21.15.100:0/4154229488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c15ee00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0cbf00 tx=0x7fc22400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 -- 172.21.15.100:0/4154229488 shutdown_connections 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 --2- 172.21.15.100:0/4154229488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c15ee00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 --2- 172.21.15.100:0/4154229488 >> v2:172.21.15.119:3300/0 conn(0x7fc22c15b250 0x7fc22c071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 -- 172.21.15.100:0/4154229488 >> 172.21.15.100:0/4154229488 conn(0x7fc22c06a450 msgr2=0x7fc22c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 -- 172.21.15.100:0/4154229488 shutdown_connections 2023-11-17T06:30:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.391+0000 7fc2330cb700 1 -- 172.21.15.100:0/4154229488 wait complete. 2023-11-17T06:30:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 Processor -- start 2023-11-17T06:30:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 -- start start 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 0x7fc22c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc22c15b250 0x7fc22c0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0c6a00 con 0x7fc22c0b1410 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0c7820 con 0x7fc22c0cad70 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0c6c10 con 0x7fc22c15b250 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44722/0 (socket says 172.21.15.100:44722) 2023-11-17T06:30:48.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 -- 172.21.15.100:0/1471206815 learned_addr learned my addr 172.21.15.100:0/1471206815 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc231668700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc22c15b250 0x7fc22c0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc22bfff700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 0x7fc22c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 -- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc22c15b250 msgr2=0x7fc22c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc22c15b250 0x7fc22c0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 -- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 msgr2=0x7fc22c0c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 0x7fc22c0c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 -- 172.21.15.100:0/1471206815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224009a70 con 0x7fc22c0b1410 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc22bfff700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 0x7fc22c0c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc230e67700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e810 tx=0x7fc22000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220004230 con 0x7fc22c0b1410 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220004390 con 0x7fc22c0b1410 2023-11-17T06:30:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200036c0 con 0x7fc22c0b1410 2023-11-17T06:30:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.395+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c0c6ef0 con 0x7fc22c0b1410 2023-11-17T06:30:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.399+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c0c74b0 con 0x7fc22c0b1410 2023-11-17T06:30:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.399+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c04eea0 con 0x7fc22c0b1410 2023-11-17T06:30:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.399+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc220003840 con 0x7fc22c0b1410 2023-11-17T06:30:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.403+0000 7fc2297fa700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 0x7fc2180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.403+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc220083960 con 0x7fc22c0b1410 2023-11-17T06:30:48.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.403+0000 7fc22bfff700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 0x7fc2180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.403+0000 7fc22bfff700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 0x7fc2180689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0b2130 tx=0x7fc21c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.407+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc220050ce0 con 0x7fc22c0b1410 2023-11-17T06:30:48.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.579+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc22c0b0ee0 con 0x7fc22c0b1410 2023-11-17T06:30:48.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.579+0000 7fc2297fa700 1 -- 172.21.15.100:0/1471206815 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc220054300 con 0x7fc22c0b1410 2023-11-17T06:30:48.583 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 msgr2=0x7fc2180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 0x7fc2180689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0b2130 tx=0x7fc21c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 msgr2=0x7fc22c150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e810 tx=0x7fc22000ebd0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 shutdown_connections 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc22c15b250 0x7fc22c0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc22c0cad70 0x7fc22c0c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc218066510 0x7fc2180689d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 --2- 172.21.15.100:0/1471206815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc22c0b1410 0x7fc22c150af0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 >> 172.21.15.100:0/1471206815 conn(0x7fc22c06a450 msgr2=0x7fc22c0b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 shutdown_connections 2023-11-17T06:30:48.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.583+0000 7fc2330cb700 1 -- 172.21.15.100:0/1471206815 wait complete. 2023-11-17T06:30:48.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:48.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.775+0000 7f71e80e5700 1 Processor -- start 2023-11-17T06:30:48.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.775+0000 7f71e80e5700 1 -- start start 2023-11-17T06:30:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e80e5700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71e00cf990 0x7f71e0165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e80e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e01621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e80e5700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00cfd70 con 0x7f71e0161d40 2023-11-17T06:30:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e80e5700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e0165380 con 0x7f71e00cf990 2023-11-17T06:30:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e80e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0158ce0 con 0x7f71e00b1150 2023-11-17T06:30:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71e00cf990 0x7f71e0165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e6682700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e01621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71e00cf990 0x7f71e0165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:38778/0 (socket says 172.21.15.100:38778) 2023-11-17T06:30:48.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 -- 172.21.15.100:0/2318082986 learned_addr learned my addr 172.21.15.100:0/2318082986 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 -- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 msgr2=0x7f71e01621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 --2- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e01621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 -- 172.21.15.100:0/2318082986 >> v1:172.21.15.119:6789/0 conn(0x7f71e0161d40 legacy=0x7f71e00b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 -- 172.21.15.100:0/2318082986 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e01662d0 con 0x7f71e00cf990 2023-11-17T06:30:48.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.779+0000 7f71e5e81700 1 --2- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e0165d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009e50 tx=0x7f71dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5df50f718ff3844 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e4e7f700 1 -- 172.21.15.100:0/2318082986 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00e070 con 0x7f71e00cf990 2023-11-17T06:30:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e4e7f700 1 -- 172.21.15.100:0/2318082986 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00b910 con 0x7f71e00cf990 2023-11-17T06:30:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e4e7f700 1 -- 172.21.15.100:0/2318082986 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00bcc0 con 0x7f71e00cf990 2023-11-17T06:30:48.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 -- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 msgr2=0x7f71e0165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e0165d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009e50 tx=0x7f71dc00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:48.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 -- 172.21.15.100:0/2318082986 shutdown_connections 2023-11-17T06:30:48.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e01621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2318082986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e0165d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 -- 172.21.15.100:0/2318082986 >> 172.21.15.100:0/2318082986 conn(0x7f71e006a270 msgr2=0x7f71e006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 -- 172.21.15.100:0/2318082986 shutdown_connections 2023-11-17T06:30:48.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.783+0000 7f71e80e5700 1 -- 172.21.15.100:0/2318082986 wait complete. 2023-11-17T06:30:48.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 Processor -- start 2023-11-17T06:30:48.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 -- start start 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e0145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e0161d40 0x7f71e01f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e01469d0 con 0x7f71e0161d40 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e015b880 con 0x7f71e00cf990 2023-11-17T06:30:48.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e80e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0145dc0 con 0x7f71e00b1150 2023-11-17T06:30:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e5e81700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e0145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e6682700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e0161d40 0x7f71e01f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.787+0000 7f71e5680700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5e81700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e0145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:46996/0 (socket says 172.21.15.100:46996) 2023-11-17T06:30:48.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5e81700 1 -- 172.21.15.100:0/2672626576 learned_addr learned my addr 172.21.15.100:0/2672626576 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 -- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 msgr2=0x7f71e0145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e0145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 -- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e0161d40 msgr2=0x7f71e01f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e0161d40 0x7f71e01f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 -- 172.21.15.100:0/2672626576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc009b30 con 0x7f71e00cf990 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e5680700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e015b340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c410 tx=0x7f71d0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00052d0 con 0x7f71e00cf990 2023-11-17T06:30:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e01460a0 con 0x7f71e00cf990 2023-11-17T06:30:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0005430 con 0x7f71e00cf990 2023-11-17T06:30:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00055a0 con 0x7f71e00cf990 2023-11-17T06:30:48.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e0146660 con 0x7f71e00cf990 2023-11-17T06:30:48.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.791+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0146b40 con 0x7f71e00cf990 2023-11-17T06:30:48.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.795+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71d00038e0 con 0x7f71e00cf990 2023-11-17T06:30:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.795+0000 7f71d67fc700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.795+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f71d0082f80 con 0x7f71e00cf990 2023-11-17T06:30:48.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.795+0000 7f71e5e81700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.799+0000 7f71e5e81700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 0x7f71c40689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009440 tx=0x7f71dc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:48.807+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71d0050370 con 0x7f71e00cf990 2023-11-17T06:30:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.019+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71e00cfd70 con 0x7f71e00cf990 2023-11-17T06:30:49.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.019+0000 7f71d67fc700 1 -- 172.21.15.100:0/2672626576 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f71e00cfd70 con 0x7f71e00cf990 2023-11-17T06:30:49.024 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:49.024 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 msgr2=0x7f71c40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 0x7f71c40689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009440 tx=0x7f71dc009000 comp rx=0 tx=0).stop 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 msgr2=0x7f71e015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e015b340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c410 tx=0x7f71d0001e70 comp rx=0 tx=0).stop 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 shutdown_connections 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e0161d40 0x7f71e01f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71e00cf990 0x7f71e015b340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 --2- 172.21.15.100:0/2672626576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71e00b1150 0x7f71e0145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 >> 172.21.15.100:0/2672626576 conn(0x7f71e006a270 msgr2=0x7f71e006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 shutdown_connections 2023-11-17T06:30:49.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.023+0000 7f71e80e5700 1 -- 172.21.15.100:0/2672626576 wait complete. 2023-11-17T06:30:49.031 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:30:49.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.219+0000 7f94d72e2700 1 Processor -- start 2023-11-17T06:30:49.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.219+0000 7f94d72e2700 1 -- start start 2023-11-17T06:30:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d72e2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d72e2700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94d00cb140 0x7f94d00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d72e2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00ce260 con 0x7f94d00cde00 2023-11-17T06:30:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d72e2700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00c5b70 con 0x7f94d00cb140 2023-11-17T06:30:49.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d72e2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c3b50 con 0x7f94d01439b0 2023-11-17T06:30:49.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d6ae1700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f94d00cde00 0x7f94d00cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45544/0 (socket says 172.21.15.100:45544) 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d6ae1700 1 -- 172.21.15.100:0/3972092955 learned_addr learned my addr 172.21.15.100:0/3972092955 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d5adf700 1 --2- 172.21.15.100:0/3972092955 >> v2:172.21.15.119:3300/0 conn(0x7f94d00cb140 0x7f94d00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d62e0700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d52de700 1 -- 172.21.15.100:0/3972092955 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215613918 0 0) 0x7f94d00ce260 con 0x7f94d00cde00 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d52de700 1 -- 172.21.15.100:0/3972092955 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94bc0035d0 con 0x7f94d00cde00 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d5adf700 1 -- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 msgr2=0x7f94d00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:49.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d5adf700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d00cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d5adf700 1 -- 172.21.15.100:0/3972092955 >> v1:172.21.15.100:6789/0 conn(0x7f94d00cde00 legacy=0x7f94d00cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.223+0000 7f94d5adf700 1 -- 172.21.15.100:0/3972092955 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00c3da0 con 0x7f94d00cb140 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d5adf700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d00cd8c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009850 tx=0x7f94c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d7b6f9dcfddfe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d52de700 1 -- 172.21.15.100:0/3972092955 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0011830 con 0x7f94d00cb140 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d52de700 1 -- 172.21.15.100:0/3972092955 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0011990 con 0x7f94d00cb140 2023-11-17T06:30:49.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d52de700 1 -- 172.21.15.100:0/3972092955 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0011d40 con 0x7f94d00cb140 2023-11-17T06:30:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 -- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 msgr2=0x7f94d00cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d00cd8c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009850 tx=0x7f94c0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 -- 172.21.15.100:0/3972092955 shutdown_connections 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d00cd8c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 --2- 172.21.15.100:0/3972092955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d00cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 -- 172.21.15.100:0/3972092955 >> 172.21.15.100:0/3972092955 conn(0x7f94d00cb730 msgr2=0x7f94d00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 -- 172.21.15.100:0/3972092955 shutdown_connections 2023-11-17T06:30:49.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.227+0000 7f94d72e2700 1 -- 172.21.15.100:0/3972092955 wait complete. 2023-11-17T06:30:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 Processor -- start 2023-11-17T06:30:49.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 -- start start 2023-11-17T06:30:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d0153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d0142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c8cf0 con 0x7f94d00cde00 2023-11-17T06:30:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0138560 con 0x7f94d00cb140 2023-11-17T06:30:49.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.231+0000 7f94d72e2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c60b0 con 0x7f94d01439b0 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44740/0 (socket says 172.21.15.100:44740) 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 -- 172.21.15.100:0/2981096500 learned_addr learned my addr 172.21.15.100:0/2981096500 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d62e0700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d0153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d6ae1700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d0142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 -- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 msgr2=0x7f94d0142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d0142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 -- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 msgr2=0x7f94d0153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d0153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 -- 172.21.15.100:0/2981096500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00094b0 con 0x7f94d00cde00 2023-11-17T06:30:49.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d5adf700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f94c00090b0 tx=0x7f94c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0004450 con 0x7f94d00cde00 2023-11-17T06:30:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c001f070 con 0x7f94d00cde00 2023-11-17T06:30:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d00c6390 con 0x7f94d00cde00 2023-11-17T06:30:49.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0003900 con 0x7f94d00cde00 2023-11-17T06:30:49.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d00c6950 con 0x7f94d00cde00 2023-11-17T06:30:49.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.235+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d0065e90 con 0x7f94d00cde00 2023-11-17T06:30:49.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.239+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94c0003a60 con 0x7f94d00cde00 2023-11-17T06:30:49.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.239+0000 7f94c6ffd700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 0x7f94b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.239+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f94c0021070 con 0x7f94d00cde00 2023-11-17T06:30:49.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.239+0000 7f94d62e0700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 0x7f94b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.243+0000 7f94d62e0700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 0x7f94b40689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009b50 tx=0x7f94cc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.247+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94c0052960 con 0x7f94d00cde00 2023-11-17T06:30:49.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.423+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94d013e7f0 con 0x7f94d00cde00 2023-11-17T06:30:49.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.427+0000 7f94c6ffd700 1 -- 172.21.15.100:0/2981096500 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f94c0055f80 con 0x7f94d00cde00 2023-11-17T06:30:49.431 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:49.431 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:37.002511+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 msgr2=0x7f94b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 0x7f94b40689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009b50 tx=0x7f94cc009240 comp rx=0 tx=0).stop 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 msgr2=0x7f94d00c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f94c00090b0 tx=0x7f94c0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 shutdown_connections 2023-11-17T06:30:49.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94d01439b0 0x7f94d0142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f94b4066510 0x7f94b40689d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d00cde00 0x7f94d00c87b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 --2- 172.21.15.100:0/2981096500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d00cb140 0x7f94d0153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 >> 172.21.15.100:0/2981096500 conn(0x7f94d00cb730 msgr2=0x7f94d006c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 shutdown_connections 2023-11-17T06:30:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.431+0000 7f94d72e2700 1 -- 172.21.15.100:0/2981096500 wait complete. 2023-11-17T06:30:49.461 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:30:49.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 Processor -- start 2023-11-17T06:30:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 -- start start 2023-11-17T06:30:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f93c80cfb60 0x7f93c80cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c80d15e0 con 0x7f93c815d4a0 2023-11-17T06:30:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c80d0510 con 0x7f93c80cfb60 2023-11-17T06:30:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93cd1f7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80d18c0 con 0x7f93c80b2730 2023-11-17T06:30:49.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93bffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93bffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:47030/0 (socket says 172.21.15.100:47030) 2023-11-17T06:30:49.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93c6d9d700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f93c815d4a0 0x7f93c80b89d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:39924/0 (socket says 172.21.15.100:39924) 2023-11-17T06:30:49.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93c759e700 1 --2- 172.21.15.100:0/360260970 >> v2:172.21.15.119:3300/0 conn(0x7f93c80cfb60 0x7f93c80cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.639+0000 7f93bffff700 1 -- 172.21.15.100:0/360260970 learned_addr learned my addr 172.21.15.100:0/360260970 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c759e700 1 -- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 msgr2=0x7f93c80b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c759e700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c759e700 1 -- 172.21.15.100:0/360260970 >> v1:172.21.15.119:6789/0 conn(0x7f93c815d4a0 legacy=0x7f93c80b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c759e700 1 -- 172.21.15.100:0/360260970 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80d1ba0 con 0x7f93c80cfb60 2023-11-17T06:30:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93bffff700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:49.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c759e700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80cfb60 0x7f93c80cffd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009d90 tx=0x7f93c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e696c663cf1e01ec server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c659c700 1 -- 172.21.15.100:0/360260970 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000e070 con 0x7f93c80cfb60 2023-11-17T06:30:49.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c659c700 1 -- 172.21.15.100:0/360260970 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000bb20 con 0x7f93c80cfb60 2023-11-17T06:30:49.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93c659c700 1 -- 172.21.15.100:0/360260970 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0012430 con 0x7f93c80cfb60 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 -- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80cfb60 msgr2=0x7f93c80cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80cfb60 0x7f93c80cffd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009d90 tx=0x7f93c000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 -- 172.21.15.100:0/360260970 shutdown_connections 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80cfb60 0x7f93c80cffd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/360260970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c80b2730 0x7f93c80b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 -- 172.21.15.100:0/360260970 >> 172.21.15.100:0/360260970 conn(0x7f93c806b430 msgr2=0x7f93c806b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 -- 172.21.15.100:0/360260970 shutdown_connections 2023-11-17T06:30:49.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.643+0000 7f93cd1f7700 1 -- 172.21.15.100:0/360260970 wait complete. 2023-11-17T06:30:49.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.647+0000 7f93cd1f7700 1 Processor -- start 2023-11-17T06:30:49.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.647+0000 7f93cd1f7700 1 -- start start 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80b2730 0x7f93c80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 0x7f93c81f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80ccb40 con 0x7f93c80cfb60 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80cce20 con 0x7f93c80b2730 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81f3ab0 con 0x7f93c815d4a0 2023-11-17T06:30:49.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44748/0 (socket says 172.21.15.100:44748) 2023-11-17T06:30:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 -- 172.21.15.100:0/4245715555 learned_addr learned my addr 172.21.15.100:0/4245715555 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93c6d9d700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80b2730 0x7f93c80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93c759e700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 0x7f93c81f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 -- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 msgr2=0x7f93c81f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 0x7f93c81f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 -- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80b2730 msgr2=0x7f93c80cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80b2730 0x7f93c80cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 -- 172.21.15.100:0/4245715555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009570 con 0x7f93c80cfb60 2023-11-17T06:30:49.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93c759e700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 0x7f93c81f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bffff700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f93b000ebe0 tx=0x7f93b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000c850 con 0x7f93c80cfb60 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000c9b0 con 0x7f93c80cfb60 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0009a70 con 0x7f93c80cfb60 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000cd20 con 0x7f93c80cfb60 2023-11-17T06:30:49.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.651+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c81f4070 con 0x7f93c80cfb60 2023-11-17T06:30:49.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.655+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c80cf370 con 0x7f93c80cfb60 2023-11-17T06:30:49.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.655+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93b0013470 con 0x7f93c80cfb60 2023-11-17T06:30:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.659+0000 7f93bf7fe700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 0x7f93a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.659+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f93b0083ff0 con 0x7f93c80cfb60 2023-11-17T06:30:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.659+0000 7f93c6d9d700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 0x7f93a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.659+0000 7f93c6d9d700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 0x7f93a80689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000f60 tx=0x7f93b8007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.663+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93b0051350 con 0x7f93c80cfb60 2023-11-17T06:30:49.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93c80d1e50 con 0x7f93c80cfb60 2023-11-17T06:30:49.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93bf7fe700 1 -- 172.21.15.100:0/4245715555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f93b0054970 con 0x7f93c80cfb60 2023-11-17T06:30:49.875 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:49.875 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 msgr2=0x7f93a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 0x7f93a80689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000f60 tx=0x7f93b8007ef0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 msgr2=0x7f93c80cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f93b000ebe0 tx=0x7f93b000eef0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 shutdown_connections 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93c815d4a0 0x7f93c81f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f93a8066510 0x7f93a80689d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93c80cfb60 0x7f93c80cc300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 --2- 172.21.15.100:0/4245715555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c80b2730 0x7f93c80cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 >> 172.21.15.100:0/4245715555 conn(0x7f93c806b430 msgr2=0x7f93c80b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 shutdown_connections 2023-11-17T06:30:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:49.871+0000 7f93cd1f7700 1 -- 172.21.15.100:0/4245715555 wait complete. 2023-11-17T06:30:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:30:49.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 Processor -- start 2023-11-17T06:30:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 -- start start 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f418415d590 0x7f41840cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 0x7f41840d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840d41b0 con 0x7f418415d590 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840d21a0 con 0x7f41840d0fd0 2023-11-17T06:30:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.067+0000 7f4189fa6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840ce940 con 0x7f41840d17d0 2023-11-17T06:30:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f418415d590 0x7f41840cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f418415d590 0x7f41840cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44752/0 (socket says 172.21.15.100:44752) 2023-11-17T06:30:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 -- 172.21.15.100:0/1466075837 learned_addr learned my addr 172.21.15.100:0/1466075837 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f417bfff700 1 --2- 172.21.15.100:0/1466075837 >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 0x7f41840d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4183fff700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 -- 172.21.15.100:0/1466075837 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 msgr2=0x7f41840d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 -- 172.21.15.100:0/1466075837 >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 msgr2=0x7f41840d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 --2- 172.21.15.100:0/1466075837 >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 0x7f41840d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 -- 172.21.15.100:0/1466075837 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840cdd70 con 0x7f418415d590 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f417bfff700 1 --2- 172.21.15.100:0/1466075837 >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 0x7f41840d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f41837fe700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418415d590 0x7f41840cedd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41840b5da0 tx=0x7f4174009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303ab1f17a06b914 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4182ffd700 1 -- 172.21.15.100:0/1466075837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011830 con 0x7f418415d590 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4182ffd700 1 -- 172.21.15.100:0/1466075837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011990 con 0x7f418415d590 2023-11-17T06:30:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4182ffd700 1 -- 172.21.15.100:0/1466075837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011d20 con 0x7f418415d590 2023-11-17T06:30:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 -- 172.21.15.100:0/1466075837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418415d590 msgr2=0x7f41840cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418415d590 0x7f41840cedd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41840b5da0 tx=0x7f4174009be0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 -- 172.21.15.100:0/1466075837 shutdown_connections 2023-11-17T06:30:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1466075837 >> v2:172.21.15.119:3300/0 conn(0x7f41840d0fd0 0x7f41840d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1466075837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418415d590 0x7f41840cedd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 -- 172.21.15.100:0/1466075837 >> 172.21.15.100:0/1466075837 conn(0x7f418409c560 msgr2=0x7f41840d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 -- 172.21.15.100:0/1466075837 shutdown_connections 2023-11-17T06:30:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.071+0000 7f4189fa6700 1 -- 172.21.15.100:0/1466075837 wait complete. 2023-11-17T06:30:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 Processor -- start 2023-11-17T06:30:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 -- start start 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418415d590 0x7f41841f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418415c460 con 0x7f41840d0fd0 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418415ebb0 con 0x7f418415d590 2023-11-17T06:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4189fa6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840c9f20 con 0x7f41840d17d0 2023-11-17T06:30:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44766/0 (socket says 172.21.15.100:44766) 2023-11-17T06:30:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 -- 172.21.15.100:0/1813889636 learned_addr learned my addr 172.21.15.100:0/1813889636 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f417bfff700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 -- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 msgr2=0x7f41840c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 -- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418415d590 msgr2=0x7f41841f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418415d590 0x7f41841f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 -- 172.21.15.100:0/1813889636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094b0 con 0x7f41840d0fd0 2023-11-17T06:30:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f41837fe700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4174014040 tx=0x7f4174004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174004510 con 0x7f41840d0fd0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.075+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417401e070 con 0x7f41840d0fd0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.079+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4174009510 con 0x7f41840d0fd0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.079+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174003900 con 0x7f41840d0fd0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.079+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840c9c40 con 0x7f41840d0fd0 2023-11-17T06:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.079+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418404eea0 con 0x7f41840d0fd0 2023-11-17T06:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.079+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4174003a60 con 0x7f41840d0fd0 2023-11-17T06:30:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.083+0000 7f4180ff9700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 0x7f41640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.083+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4174084970 con 0x7f41840d0fd0 2023-11-17T06:30:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.083+0000 7f417bfff700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 0x7f41640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.083+0000 7f417bfff700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 0x7f41640689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41840b5570 tx=0x7f416c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.087+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4174051e80 con 0x7f41840d0fd0 2023-11-17T06:30:50.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.299+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41840d15b0 con 0x7f41840d0fd0 2023-11-17T06:30:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.299+0000 7f4180ff9700 1 -- 172.21.15.100:0/1813889636 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f4174020020 con 0x7f41840d0fd0 2023-11-17T06:30:50.305 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:50.305 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2786235318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":2786235318},{"type":"v1","addr":"172.21.15.119:6835","nonce":2786235318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2509872214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2509872214},{"type":"v1","addr":"172.21.15.100:6835","nonce":2509872214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2100278057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2100278057},{"type":"v1","addr":"172.21.15.100:6837","nonce":2100278057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:39.441152+0000","modified":"2023-11-17T06:29:42.485705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6834/3870554299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3870554299},{"type":"v1","addr":"172.21.15.119:6834","nonce":3870554299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 msgr2=0x7f41640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 0x7f41640689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41840b5570 tx=0x7f416c008040 comp rx=0 tx=0).stop 2023-11-17T06:30:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 msgr2=0x7f41841f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4174014040 tx=0x7f4174004770 comp rx=0 tx=0).stop 2023-11-17T06:30:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 shutdown_connections 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f418415d590 0x7f41841f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41840d17d0 0x7f41840c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4164066510 0x7f41640689d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 --2- 172.21.15.100:0/1813889636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41840d0fd0 0x7f41841f2580 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 >> 172.21.15.100:0/1813889636 conn(0x7f418409c560 msgr2=0x7f41840b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 shutdown_connections 2023-11-17T06:30:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.303+0000 7f4189fa6700 1 -- 172.21.15.100:0/1813889636 wait complete. 2023-11-17T06:30:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2023-11-17T06:30:50.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.495+0000 7f1b28ac4700 1 Processor -- start 2023-11-17T06:30:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 -- start start 2023-11-17T06:30:50.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1b240b1150 0x7f1b240cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 0x7f1b2415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b24070ad0 con 0x7f1b2415b0a0 2023-11-17T06:30:50.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b24071f20 con 0x7f1b240b1150 2023-11-17T06:30:50.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b28ac4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240721a0 con 0x7f1b240cf8a0 2023-11-17T06:30:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b22d9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 0x7f1b2415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b19d9b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1b240b1150 0x7f1b240cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b22d9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 0x7f1b2415ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:47054/0 (socket says 172.21.15.100:47054) 2023-11-17T06:30:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b22d9d700 1 -- 172.21.15.100:0/2429541518 learned_addr learned my addr 172.21.15.100:0/2429541518 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b19d9b700 1 -- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 msgr2=0x7f1b2415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b19d9b700 1 --2- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 0x7f1b2415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b19d9b700 1 -- 172.21.15.100:0/2429541518 >> v1:172.21.15.119:6789/0 conn(0x7f1b2415b0a0 legacy=0x7f1b240b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.499+0000 7f1b19d9b700 1 -- 172.21.15.100:0/2429541518 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24072480 con 0x7f1b240b1150 2023-11-17T06:30:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b19d9b700 1 --2- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240b1150 0x7f1b240cb3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009850 tx=0x7f1b0c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e643549583c2b20b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b21d9b700 1 -- 172.21.15.100:0/2429541518 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011830 con 0x7f1b240b1150 2023-11-17T06:30:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b21d9b700 1 -- 172.21.15.100:0/2429541518 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c011990 con 0x7f1b240b1150 2023-11-17T06:30:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b21d9b700 1 -- 172.21.15.100:0/2429541518 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011d40 con 0x7f1b240b1150 2023-11-17T06:30:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 -- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240b1150 msgr2=0x7f1b240cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240b1150 0x7f1b240cb3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009850 tx=0x7f1b0c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 -- 172.21.15.100:0/2429541518 shutdown_connections 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b240cf8a0 0x7f1b2415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/2429541518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240b1150 0x7f1b240cb3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 -- 172.21.15.100:0/2429541518 >> 172.21.15.100:0/2429541518 conn(0x7f1b2406a270 msgr2=0x7f1b2406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 -- 172.21.15.100:0/2429541518 shutdown_connections 2023-11-17T06:30:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.503+0000 7f1b28ac4700 1 -- 172.21.15.100:0/2429541518 wait complete. 2023-11-17T06:30:50.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 Processor -- start 2023-11-17T06:30:50.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 -- start start 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240cf8a0 0x7f1b24154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 0x7f1b241552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b24154b50 con 0x7f1b240b1150 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b24155910 con 0x7f1b240cf8a0 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b28ac4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b24155bf0 con 0x7f1b2415b0a0 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b2259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b2259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44770/0 (socket says 172.21.15.100:44770) 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b2259c700 1 -- 172.21.15.100:0/322844511 learned_addr learned my addr 172.21.15.100:0/322844511 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b22d9d700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 0x7f1b241552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.507+0000 7f1b19d9b700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240cf8a0 0x7f1b24154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 -- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 msgr2=0x7f1b241552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 0x7f1b241552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 -- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240cf8a0 msgr2=0x7f1b24154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240cf8a0 0x7f1b24154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 -- 172.21.15.100:0/322844511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0094b0 con 0x7f1b240b1150 2023-11-17T06:30:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b22d9d700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 0x7f1b241552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b2259c700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400c500 tx=0x7f1b1400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140052d0 con 0x7f1b240b1150 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14005430 con 0x7f1b240b1150 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b24155ed0 con 0x7f1b240b1150 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140055a0 con 0x7f1b240b1150 2023-11-17T06:30:50.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b241f08d0 con 0x7f1b240b1150 2023-11-17T06:30:50.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.511+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b241563f0 con 0x7f1b240b1150 2023-11-17T06:30:50.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.515+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b140038e0 con 0x7f1b240b1150 2023-11-17T06:30:50.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.515+0000 7f1b1b7fe700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 0x7f1b040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.515+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1b14083260 con 0x7f1b240b1150 2023-11-17T06:30:50.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.515+0000 7f1b19d9b700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 0x7f1b040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.519+0000 7f1b19d9b700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 0x7f1b040689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0090b0 tx=0x7f1b0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.519+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b14050660 con 0x7f1b240b1150 2023-11-17T06:30:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.699+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b2404eea0 con 0x7f1b240b1150 2023-11-17T06:30:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.703+0000 7f1b1b7fe700 1 -- 172.21.15.100:0/322844511 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f1b14053c80 con 0x7f1b240b1150 2023-11-17T06:30:50.707 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:50.707 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:37.002511+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:37.771367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:38.450536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 msgr2=0x7f1b040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 0x7f1b040689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0090b0 tx=0x7f1b0c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 msgr2=0x7f1b24154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400c500 tx=0x7f1b1400c810 comp rx=0 tx=0).stop 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 shutdown_connections 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b2415b0a0 0x7f1b241552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b240cf8a0 0x7f1b24154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1b04066510 0x7f1b040689d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 --2- 172.21.15.100:0/322844511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b240b1150 0x7f1b24154610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 >> 172.21.15.100:0/322844511 conn(0x7f1b2406a270 msgr2=0x7f1b24158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 shutdown_connections 2023-11-17T06:30:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.707+0000 7f1b28ac4700 1 -- 172.21.15.100:0/322844511 wait complete. 2023-11-17T06:30:50.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:30:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.903+0000 7f09ef59e700 1 Processor -- start 2023-11-17T06:30:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.903+0000 7f09ef59e700 1 -- start start 2023-11-17T06:30:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f015d1c0 0x7f09f0160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ef59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f09f0161380 0x7f09f00cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ef59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f01619b0 con 0x7f09f00cff20 2023-11-17T06:30:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ef59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00d0390 con 0x7f09f0161380 2023-11-17T06:30:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ef59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00d1180 con 0x7f09f015d1c0 2023-11-17T06:30:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09eed9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f09f00cff20 0x7f09f00b4a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45560/0 (socket says 172.21.15.100:45560) 2023-11-17T06:30:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09eed9d700 1 -- 172.21.15.100:0/4141920085 learned_addr learned my addr 172.21.15.100:0/4141920085 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09edd9b700 1 --2- 172.21.15.100:0/4141920085 >> v2:172.21.15.119:3300/0 conn(0x7f09f0161380 0x7f09f00cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ee59c700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f015d1c0 0x7f09f0160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09edd9b700 1 -- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f015d1c0 msgr2=0x7f09f0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09ed59a700 1 -- 172.21.15.100:0/4141920085 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237645443 0 0) 0x7f09f01619b0 con 0x7f09f00cff20 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09edd9b700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f015d1c0 0x7f09f0160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09edd9b700 1 -- 172.21.15.100:0/4141920085 >> v1:172.21.15.100:6789/0 conn(0x7f09f00cff20 legacy=0x7f09f00b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.907+0000 7f09edd9b700 1 -- 172.21.15.100:0/4141920085 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00d1460 con 0x7f09f0161380 2023-11-17T06:30:50.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09edd9b700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0161380 0x7f09f00cf9e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009850 tx=0x7f09e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=214abebcdf363d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ed59a700 1 -- 172.21.15.100:0/4141920085 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011830 con 0x7f09f0161380 2023-11-17T06:30:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ed59a700 1 -- 172.21.15.100:0/4141920085 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4011990 con 0x7f09f0161380 2023-11-17T06:30:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ed59a700 1 -- 172.21.15.100:0/4141920085 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011d40 con 0x7f09f0161380 2023-11-17T06:30:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 -- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0161380 msgr2=0x7f09f00cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0161380 0x7f09f00cf9e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009850 tx=0x7f09e4009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 -- 172.21.15.100:0/4141920085 shutdown_connections 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0161380 0x7f09f00cf9e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 --2- 172.21.15.100:0/4141920085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f015d1c0 0x7f09f0160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 -- 172.21.15.100:0/4141920085 >> 172.21.15.100:0/4141920085 conn(0x7f09f00d2fd0 msgr2=0x7f09f00d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 -- 172.21.15.100:0/4141920085 shutdown_connections 2023-11-17T06:30:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.911+0000 7f09ef59e700 1 -- 172.21.15.100:0/4141920085 wait complete. 2023-11-17T06:30:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 Processor -- start 2023-11-17T06:30:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 -- start start 2023-11-17T06:30:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f00cff20 0x7f09f00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f0161380 0x7f09f00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015d5a0 con 0x7f09f015d1c0 2023-11-17T06:30:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00cb4c0 con 0x7f09f00cff20 2023-11-17T06:30:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ef59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015d7b0 con 0x7f09f0161380 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09edd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09edd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44776/0 (socket says 172.21.15.100:44776) 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09edd9b700 1 -- 172.21.15.100:0/873999017 learned_addr learned my addr 172.21.15.100:0/873999017 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09eed9d700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f0161380 0x7f09f00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.915+0000 7f09ee59c700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f00cff20 0x7f09f00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 -- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f0161380 msgr2=0x7f09f00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f0161380 0x7f09f00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 -- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f00cff20 msgr2=0x7f09f00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f00cff20 0x7f09f00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 -- 172.21.15.100:0/873999017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094b0 con 0x7f09f015d1c0 2023-11-17T06:30:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09edd9b700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f09e4014040 tx=0x7f09e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4019980 con 0x7f09f015d1c0 2023-11-17T06:30:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e401e070 con 0x7f09f015d1c0 2023-11-17T06:30:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f015da90 con 0x7f09f015d1c0 2023-11-17T06:30:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4019d20 con 0x7f09f015d1c0 2023-11-17T06:30:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f015e050 con 0x7f09f015d1c0 2023-11-17T06:30:50.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.919+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f015e240 con 0x7f09f015d1c0 2023-11-17T06:30:50.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.923+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f09e402d450 con 0x7f09f015d1c0 2023-11-17T06:30:50.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.923+0000 7f09deffd700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 0x7f09d00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.923+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f09e4084e60 con 0x7f09f015d1c0 2023-11-17T06:30:50.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.923+0000 7f09ee59c700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 0x7f09d00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.923+0000 7f09ee59c700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 0x7f09d00689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009bf0 tx=0x7f09e0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:50.931+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09e4052250 con 0x7f09f015d1c0 2023-11-17T06:30:51.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.139+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09f0065e90 con 0x7f09f015d1c0 2023-11-17T06:30:51.146 INFO:tasks.ceph.mon.a.smithi100.stderr:2023-11-17T06:30:51.143+0000 7f0e7e1f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:30:51.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09deffd700 1 -- 172.21.15.100:0/873999017 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09e4015090 con 0x7f09f015d1c0 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 msgr2=0x7f09d00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 0x7f09d00689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009bf0 tx=0x7f09e0009240 comp rx=0 tx=0).stop 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 msgr2=0x7f09f01f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f09e4014040 tx=0x7f09e4004770 comp rx=0 tx=0).stop 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.147+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 shutdown_connections 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f0161380 0x7f09f00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09d0066510 0x7f09d00689d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f015d1c0 0x7f09f01f23b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 --2- 172.21.15.100:0/873999017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f00cff20 0x7f09f00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 >> 172.21.15.100:0/873999017 conn(0x7f09f00d2fd0 msgr2=0x7f09f00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 shutdown_connections 2023-11-17T06:30:51.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.151+0000 7f09ef59e700 1 -- 172.21.15.100:0/873999017 wait complete. 2023-11-17T06:30:51.156 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:30:51.167 INFO:tasks.ceph.mds.b.smithi119.stderr: -3821> 2023-11-17T06:29:45.976+0000 7fe434e85700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:30:51.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-17T06:30:51.225 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-11-17T06:30:51.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 Processor -- start 2023-11-17T06:30:51.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 -- start start 2023-11-17T06:30:51.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 0x7f92d40c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f92d40cc5a0 0x7f92d40b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40b1620 con 0x7f92d40cee70 2023-11-17T06:30:51.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d41660e0 con 0x7f92d40cc5a0 2023-11-17T06:30:51.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.351+0000 7f92da2db700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d4165460 con 0x7f92d40b0d00 2023-11-17T06:30:51.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f92d40cc5a0 0x7f92d40b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f92d40cc5a0 0x7f92d40b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44778/0 (socket says 172.21.15.100:44778) 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 -- 172.21.15.100:0/3368632322 learned_addr learned my addr 172.21.15.100:0/3368632322 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d3fff700 1 --2- 172.21.15.100:0/3368632322 >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 0x7f92d40c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 -- 172.21.15.100:0/3368632322 >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 msgr2=0x7f92d40c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 --2- 172.21.15.100:0/3368632322 >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 0x7f92d40c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 -- 172.21.15.100:0/3368632322 >> v1:172.21.15.119:6789/0 conn(0x7f92d40cee70 legacy=0x7f92d40cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 -- 172.21.15.100:0/3368632322 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4165740 con 0x7f92d40cc5a0 2023-11-17T06:30:51.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d3fff700 1 --2- 172.21.15.100:0/3368632322 >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 0x7f92d40c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:51.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d37fe700 1 --2- 172.21.15.100:0/3368632322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cc5a0 0x7f92d40b10e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92d40cc350 tx=0x7f92c8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b9a0df9afb8813 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d2ffd700 1 -- 172.21.15.100:0/3368632322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800b8a0 con 0x7f92d40cc5a0 2023-11-17T06:30:51.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d2ffd700 1 -- 172.21.15.100:0/3368632322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800ba00 con 0x7f92d40cc5a0 2023-11-17T06:30:51.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92d2ffd700 1 -- 172.21.15.100:0/3368632322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800bd90 con 0x7f92d40cc5a0 2023-11-17T06:30:51.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 -- 172.21.15.100:0/3368632322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cc5a0 msgr2=0x7f92d40b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 --2- 172.21.15.100:0/3368632322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cc5a0 0x7f92d40b10e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92d40cc350 tx=0x7f92c8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 -- 172.21.15.100:0/3368632322 shutdown_connections 2023-11-17T06:30:51.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 --2- 172.21.15.100:0/3368632322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cc5a0 0x7f92d40b10e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 --2- 172.21.15.100:0/3368632322 >> v2:172.21.15.119:3300/0 conn(0x7f92d40b0d00 0x7f92d40c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 -- 172.21.15.100:0/3368632322 >> 172.21.15.100:0/3368632322 conn(0x7f92d406a450 msgr2=0x7f92d406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 -- 172.21.15.100:0/3368632322 shutdown_connections 2023-11-17T06:30:51.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.355+0000 7f92da2db700 1 -- 172.21.15.100:0/3368632322 wait complete. 2023-11-17T06:30:51.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.359+0000 7f92da2db700 1 Processor -- start 2023-11-17T06:30:51.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- start start 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d40b0d00 0x7f92d41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 0x7f92d40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4159a70 con 0x7f92d40cee70 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b49f0 con 0x7f92d40b0d00 2023-11-17T06:30:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40b3b90 con 0x7f92d40cc5a0 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 0x7f92d40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 0x7f92d40b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:47082/0 (socket says 172.21.15.100:47082) 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44788/0 (socket says 172.21.15.100:44788) 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d37fe700 1 -- 172.21.15.100:0/3274923474 learned_addr learned my addr 172.21.15.100:0/3274923474 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d3fff700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d40b0d00 0x7f92d41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 -- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 msgr2=0x7f92d40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 0x7f92d40b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 -- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d40b0d00 msgr2=0x7f92d41590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d40b0d00 0x7f92d41590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 -- 172.21.15.100:0/3274923474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009570 con 0x7f92d40cee70 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d8878700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00cbc0 tx=0x7f92cc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc003c20 con 0x7f92d40cee70 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc003d80 con 0x7f92d40cee70 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40b3de0 con 0x7f92d40cee70 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00aa40 con 0x7f92d40cee70 2023-11-17T06:30:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.363+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40b43a0 con 0x7f92d40cee70 2023-11-17T06:30:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.367+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d404eea0 con 0x7f92d40cee70 2023-11-17T06:30:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.367+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92cc00aba0 con 0x7f92d40cee70 2023-11-17T06:30:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.371+0000 7f92d0ff9700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 0x7f92c0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.371+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f92cc083e60 con 0x7f92d40cee70 2023-11-17T06:30:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.371+0000 7f92d3fff700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 0x7f92c0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.371+0000 7f92d3fff700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 0x7f92c0068a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92d415cd00 tx=0x7f92c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.375+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92cc051190 con 0x7f92d40cee70 2023-11-17T06:30:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:51.587+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f92d40cec50 con 0x7f92d40cee70 2023-11-17T06:30:52.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.155+0000 7f92d0ff9700 1 -- 172.21.15.100:0/3274923474 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92cc0547b0 con 0x7f92d40cee70 2023-11-17T06:30:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 msgr2=0x7f92c0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 0x7f92c0068a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92d415cd00 tx=0x7f92c4008040 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 msgr2=0x7f92d40cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00cbc0 tx=0x7f92cc00ced0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 shutdown_connections 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f92c0066540 0x7f92c0068a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92d40cee70 0x7f92d40cd340 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d40cc5a0 0x7f92d40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 --2- 172.21.15.100:0/3274923474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d40b0d00 0x7f92d41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.159+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 >> 172.21.15.100:0/3274923474 conn(0x7f92d406a450 msgr2=0x7f92d406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.163+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 shutdown_connections 2023-11-17T06:30:52.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.163+0000 7f92da2db700 1 -- 172.21.15.100:0/3274923474 wait complete. 2023-11-17T06:30:52.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-17T06:30:52.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.351+0000 7fd79d5eb700 1 Processor -- start 2023-11-17T06:30:52.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.351+0000 7fd79d5eb700 1 -- start start 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.351+0000 7fd79d5eb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd798157880 0x7fd79815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd79806a270 0x7fd79806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79815e6a0 con 0x7fd79806e3b0 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79806ac40 con 0x7fd79806a270 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980ca200 con 0x7fd798157880 2023-11-17T06:30:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7967fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd79806e3b0 0x7fd7980c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50770/0 (socket says 172.21.15.100:50770) 2023-11-17T06:30:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7967fc700 1 -- 172.21.15.100:0/4092481838 learned_addr learned my addr 172.21.15.100:0/4092481838 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 --2- 172.21.15.100:0/4092481838 >> v2:172.21.15.100:3300/0 conn(0x7fd79806a270 0x7fd79806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd796ffd700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd798157880 0x7fd79815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd795ffb700 1 -- 172.21.15.100:0/4092481838 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552898990 0 0) 0x7fd78c001110 con 0x7fd79806e3b0 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd795ffb700 1 -- 172.21.15.100:0/4092481838 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7800035d0 con 0x7fd79806e3b0 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 -- 172.21.15.100:0/4092481838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd798157880 msgr2=0x7fd79815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd798157880 0x7fd79815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 -- 172.21.15.100:0/4092481838 >> v1:172.21.15.100:6789/0 conn(0x7fd79806e3b0 legacy=0x7fd7980c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 -- 172.21.15.100:0/4092481838 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980c9660 con 0x7fd79806a270 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd7977fe700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806a270 0x7fd79806a700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd790009d90 tx=0x7fd79000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442fdd75342a2f5c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd795ffb700 1 -- 172.21.15.100:0/4092481838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79000e070 con 0x7fd79806a270 2023-11-17T06:30:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd795ffb700 1 -- 172.21.15.100:0/4092481838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79000bb20 con 0x7fd79806a270 2023-11-17T06:30:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd795ffb700 1 -- 172.21.15.100:0/4092481838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790012430 con 0x7fd79806a270 2023-11-17T06:30:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- 172.21.15.100:0/4092481838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806a270 msgr2=0x7fd79806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806a270 0x7fd79806a700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd790009d90 tx=0x7fd79000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- 172.21.15.100:0/4092481838 shutdown_connections 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806a270 0x7fd79806a700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/4092481838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd798157880 0x7fd79815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- 172.21.15.100:0/4092481838 >> 172.21.15.100:0/4092481838 conn(0x7fd79806b380 msgr2=0x7fd79806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- 172.21.15.100:0/4092481838 shutdown_connections 2023-11-17T06:30:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.355+0000 7fd79d5eb700 1 -- 172.21.15.100:0/4092481838 wait complete. 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 Processor -- start 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 -- start start 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd79806a270 0x7fd7981f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 0x7fd7981f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7981f6e10 con 0x7fd79806e3b0 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd798152300 con 0x7fd798157880 2023-11-17T06:30:52.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd79d5eb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7981525e0 con 0x7fd79806a270 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40620/0 (socket says 172.21.15.100:40620) 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 -- 172.21.15.100:0/1625409959 learned_addr learned my addr 172.21.15.100:0/1625409959 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd796ffd700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd79806a270 0x7fd7981f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7977fe700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 0x7fd7981f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 -- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd79806a270 msgr2=0x7fd7981f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd79806a270 0x7fd7981f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 -- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 msgr2=0x7fd7981f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 0x7fd7981f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7967fc700 1 -- 172.21.15.100:0/1625409959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790009a70 con 0x7fd79806e3b0 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.359+0000 7fd7977fe700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 0x7fd7981f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd7967fc700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd78c001270 tx=0x7fd78c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c005d90 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0070d0 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c007480 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7981528c0 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd798152e80 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd798153070 con 0x7fd79806e3b0 2023-11-17T06:30:52.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.363+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd78c0075e0 con 0x7fd79806e3b0 2023-11-17T06:30:52.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.367+0000 7fd77f7fe700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 0x7fd7840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.367+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fd78c0832e0 con 0x7fd79806e3b0 2023-11-17T06:30:52.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.367+0000 7fd796ffd700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 0x7fd7840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.367+0000 7fd796ffd700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 0x7fd7840689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd788009bf0 tx=0x7fd788009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.375+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd78c050610 con 0x7fd79806e3b0 2023-11-17T06:30:52.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:52.551+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd79815e6a0 con 0x7fd79806e3b0 2023-11-17T06:30:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.163+0000 7fd77f7fe700 1 -- 172.21.15.100:0/1625409959 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd79815e6a0 con 0x7fd79806e3b0 2023-11-17T06:30:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.167+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 msgr2=0x7fd7840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.167+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 0x7fd7840689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd788009bf0 tx=0x7fd788009240 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.167+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 msgr2=0x7fd79814ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.167+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd78c001270 tx=0x7fd78c00c9e0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 shutdown_connections 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd798157880 0x7fd7981f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd784066510 0x7fd7840689d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79806e3b0 0x7fd79814ca80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 --2- 172.21.15.100:0/1625409959 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd79806a270 0x7fd7981f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 >> 172.21.15.100:0/1625409959 conn(0x7fd79806b380 msgr2=0x7fd79815fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 shutdown_connections 2023-11-17T06:30:53.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.171+0000 7fd79d5eb700 1 -- 172.21.15.100:0/1625409959 wait complete. 2023-11-17T06:30:53.177 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2023-11-17T06:30:53.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-17T06:30:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.378+0000 7fbea4ecb700 1 Processor -- start 2023-11-17T06:30:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.378+0000 7fbea4ecb700 1 -- start start 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbea4ecb700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbea01449a0 0x7fbea00b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbea4ecb700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbea0072380 0x7fbea00cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbea4ecb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea0070240 con 0x7fbea00cbd70 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbea4ecb700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00cc220 con 0x7fbea0072380 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbea4ecb700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00b1990 con 0x7fbea01449a0 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbea0072380 0x7fbea00cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbea0072380 0x7fbea00cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40636/0 (socket says 172.21.15.100:40636) 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 -- 172.21.15.100:0/1174019772 learned_addr learned my addr 172.21.15.100:0/1174019772 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe9e59c700 1 --2- 172.21.15.100:0/1174019772 >> v2:172.21.15.119:3300/0 conn(0x7fbea01449a0 0x7fbea00b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe9dd9b700 1 -- 172.21.15.100:0/1174019772 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282146864 0 0) 0x7fbea0070240 con 0x7fbea00cbd70 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 -- 172.21.15.100:0/1174019772 >> v2:172.21.15.119:3300/0 conn(0x7fbea01449a0 msgr2=0x7fbea00b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 --2- 172.21.15.100:0/1174019772 >> v2:172.21.15.119:3300/0 conn(0x7fbea01449a0 0x7fbea00b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 -- 172.21.15.100:0/1174019772 >> v1:172.21.15.119:6789/0 conn(0x7fbea00cbd70 legacy=0x7fbea015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 -- 172.21.15.100:0/1174019772 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0144d80 con 0x7fbea0072380 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe97fff700 1 --2- 172.21.15.100:0/1174019772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0072380 0x7fbea00cb830 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbea00cb800 tx=0x7fbe88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30abe860099b00f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe9dd9b700 1 -- 172.21.15.100:0/1174019772 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88011830 con 0x7fbea0072380 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe9dd9b700 1 -- 172.21.15.100:0/1174019772 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88011990 con 0x7fbea0072380 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.382+0000 7fbe9dd9b700 1 -- 172.21.15.100:0/1174019772 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88011d20 con 0x7fbea0072380 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 -- 172.21.15.100:0/1174019772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0072380 msgr2=0x7fbea00cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/1174019772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0072380 0x7fbea00cb830 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbea00cb800 tx=0x7fbe88009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 -- 172.21.15.100:0/1174019772 shutdown_connections 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/1174019772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0072380 0x7fbea00cb830 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/1174019772 >> v2:172.21.15.119:3300/0 conn(0x7fbea01449a0 0x7fbea00b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 -- 172.21.15.100:0/1174019772 >> 172.21.15.100:0/1174019772 conn(0x7fbea006a270 msgr2=0x7fbea006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 -- 172.21.15.100:0/1174019772 shutdown_connections 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.386+0000 7fbea4ecb700 1 -- 172.21.15.100:0/1174019772 wait complete. 2023-11-17T06:30:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 Processor -- start 2023-11-17T06:30:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 -- start start 2023-11-17T06:30:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbea01449a0 0x7fbea01433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 0x7fbea00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00a9d20 con 0x7fbea0143930 2023-11-17T06:30:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00a91a0 con 0x7fbea00cbd70 2023-11-17T06:30:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbea4ecb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00a9480 con 0x7fbea01449a0 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbe9e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbe9ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 0x7fbea00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbe9e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33594/0 (socket says 172.21.15.100:33594) 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbe9e59c700 1 -- 172.21.15.100:0/3809079603 learned_addr learned my addr 172.21.15.100:0/3809079603 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.390+0000 7fbe97fff700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbea01449a0 0x7fbea01433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 -- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbea01449a0 msgr2=0x7fbea01433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbea01449a0 0x7fbea01433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 -- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 msgr2=0x7fbea00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 0x7fbea00a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 -- 172.21.15.100:0/3809079603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009570 con 0x7fbea00cbd70 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9ed9d700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 0x7fbea00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe9e59c700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e9d0 tx=0x7fbe9000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90009720 con 0x7fbea00cbd70 2023-11-17T06:30:53.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9000ee70 con 0x7fbea00cbd70 2023-11-17T06:30:53.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00a9760 con 0x7fbea00cbd70 2023-11-17T06:30:53.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000ca50 con 0x7fbea00cbd70 2023-11-17T06:30:53.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea0143dc0 con 0x7fbea00cbd70 2023-11-17T06:30:53.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.394+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea015c760 con 0x7fbea00cbd70 2023-11-17T06:30:53.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.398+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe9000cbb0 con 0x7fbea00cbd70 2023-11-17T06:30:53.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.398+0000 7fbe96ffd700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 0x7fbe800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.398+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fbe90083db0 con 0x7fbea00cbd70 2023-11-17T06:30:53.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.398+0000 7fbe97fff700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 0x7fbe800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.398+0000 7fbe97fff700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 0x7fbe800689d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbea00ced10 tx=0x7fbe88008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.406+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbea015c760 con 0x7fbea00cbd70 2023-11-17T06:30:53.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:53.590+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbea004eea0 con 0x7fbea00cbd70 2023-11-17T06:30:54.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.182+0000 7fbe96ffd700 1 -- 172.21.15.100:0/3809079603 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe90059e60 con 0x7fbea00cbd70 2023-11-17T06:30:54.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.186+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 msgr2=0x7fbe800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.186+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 0x7fbe800689d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbea00ced10 tx=0x7fbe88008030 comp rx=0 tx=0).stop 2023-11-17T06:30:54.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.186+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 msgr2=0x7fbea00c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.186+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e9d0 tx=0x7fbe9000ece0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 shutdown_connections 2023-11-17T06:30:54.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbe80066510 0x7fbe800689d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea0143930 0x7fbea00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbea01449a0 0x7fbea01433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 --2- 172.21.15.100:0/3809079603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbea00cbd70 0x7fbea00c9b30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 >> 172.21.15.100:0/3809079603 conn(0x7fbea006a270 msgr2=0x7fbea00ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 shutdown_connections 2023-11-17T06:30:54.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.190+0000 7fbea4ecb700 1 -- 172.21.15.100:0/3809079603 wait complete. 2023-11-17T06:30:54.198 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2023-11-17T06:30:54.219 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-17T06:30:54.219 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-17T06:30:54.219 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-17T06:30:54.219 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:54.219 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-17T06:30:54.219 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-17T06:30:54.220 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-17T06:30:54.220 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:54.220 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-17T06:30:54.220 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-17T06:30:54.220 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-17T06:30:54.221 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:54.221 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-17T06:30:54.221 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-17T06:30:54.221 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-17T06:30:54.221 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:54.237 INFO:tasks.ceph.mds.c:Stopped 2023-11-17T06:30:54.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-17T06:30:54.238 INFO:tasks.ceph.mds.a:Stopped 2023-11-17T06:30:54.239 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-17T06:30:54.242 INFO:tasks.ceph.mds.d:Stopped 2023-11-17T06:30:54.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-17T06:30:54.243 INFO:tasks.ceph.mds.b:Stopped 2023-11-17T06:30:54.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-17T06:30:54.288 INFO:tasks.ceph.mds.d:Started 2023-11-17T06:30:54.289 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:54.289 INFO:tasks.ceph.mds.c:Started 2023-11-17T06:30:54.290 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:54.290 INFO:tasks.ceph.mds.b:Started 2023-11-17T06:30:54.291 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:54.294 INFO:tasks.ceph.mds.a:Started 2023-11-17T06:30:54.294 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:54.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-17T06:30:54.401 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2023-11-17T06:30:54.404 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2023-11-17T06:30:54.405 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-11-17T06:30:54.407 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-11-17T06:30:54.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.466+0000 7f8d9eb3c700 1 Processor -- start 2023-11-17T06:30:54.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.466+0000 7f8d9eb3c700 1 -- start start 2023-11-17T06:30:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9eb3c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8d980cd7f0 0x7f8d980cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9eb3c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d9806fb90 0x7f8d980cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9eb3c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980cfda0 con 0x7f8d980d15a0 2023-11-17T06:30:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9eb3c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980cc4b0 con 0x7f8d9806fb90 2023-11-17T06:30:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9eb3c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9806e410 con 0x7f8d980cd7f0 2023-11-17T06:30:54.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9d339700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8d980d15a0 0x7f8d980cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50802/0 (socket says 172.21.15.100:50802) 2023-11-17T06:30:54.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8d980cd7f0 0x7f8d980cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9d339700 1 -- 172.21.15.100:0/3356939802 learned_addr learned my addr 172.21.15.100:0/3356939802 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:54.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9e33b700 1 --2- 172.21.15.100:0/3356939802 >> v2:172.21.15.100:3300/0 conn(0x7f8d9806fb90 0x7f8d980cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9cb38700 1 -- 172.21.15.100:0/3356939802 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516843380 0 0) 0x7f8d980cfda0 con 0x7f8d980d15a0 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 -- 172.21.15.100:0/3356939802 >> v2:172.21.15.100:3300/0 conn(0x7f8d9806fb90 msgr2=0x7f8d980cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 --2- 172.21.15.100:0/3356939802 >> v2:172.21.15.100:3300/0 conn(0x7f8d9806fb90 0x7f8d980cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 -- 172.21.15.100:0/3356939802 >> v1:172.21.15.100:6789/0 conn(0x7f8d980d15a0 legacy=0x7f8d980cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 -- 172.21.15.100:0/3356939802 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9806e6f0 con 0x7f8d980cd7f0 2023-11-17T06:30:54.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.470+0000 7f8d9db3a700 1 --2- 172.21.15.100:0/3356939802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cdbd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d9806b1d0 tx=0x7f8d94009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0760ba54a2bc0c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9cb38700 1 -- 172.21.15.100:0/3356939802 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94011830 con 0x7f8d980cd7f0 2023-11-17T06:30:54.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9cb38700 1 -- 172.21.15.100:0/3356939802 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94011990 con 0x7f8d980cd7f0 2023-11-17T06:30:54.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9cb38700 1 -- 172.21.15.100:0/3356939802 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94011d20 con 0x7f8d980cd7f0 2023-11-17T06:30:54.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/3356939802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 msgr2=0x7f8d980cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/3356939802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cdbd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d9806b1d0 tx=0x7f8d94009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/3356939802 shutdown_connections 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/3356939802 >> v2:172.21.15.100:3300/0 conn(0x7f8d9806fb90 0x7f8d980cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/3356939802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cdbd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/3356939802 >> 172.21.15.100:0/3356939802 conn(0x7f8d9809a180 msgr2=0x7f8d980d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/3356939802 shutdown_connections 2023-11-17T06:30:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.474+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/3356939802 wait complete. 2023-11-17T06:30:54.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 Processor -- start 2023-11-17T06:30:54.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 -- start start 2023-11-17T06:30:54.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d980d15a0 0x7f8d980c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980b4a20 con 0x7f8d9806fb90 2023-11-17T06:30:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98152860 con 0x7f8d980cd7f0 2023-11-17T06:30:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9eb3c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980c9d10 con 0x7f8d980d15a0 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40714/0 (socket says 172.21.15.100:40714) 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 -- 172.21.15.100:0/886320372 learned_addr learned my addr 172.21.15.100:0/886320372 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9e33b700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d980d15a0 0x7f8d980c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9d339700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 -- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d980d15a0 msgr2=0x7f8d980c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d980d15a0 0x7f8d980c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 -- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 msgr2=0x7f8d980cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 -- 172.21.15.100:0/886320372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940094b0 con 0x7f8d9806fb90 2023-11-17T06:30:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d9db3a700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d94014040 tx=0x7f8d94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.478+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94004610 con 0x7f8d9806fb90 2023-11-17T06:30:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9401e070 con 0x7f8d9806fb90 2023-11-17T06:30:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940038e0 con 0x7f8d9806fb90 2023-11-17T06:30:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980c9ff0 con 0x7f8d9806fb90 2023-11-17T06:30:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d980b4c70 con 0x7f8d9806fb90 2023-11-17T06:30:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980b4e60 con 0x7f8d9806fb90 2023-11-17T06:30:54.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.482+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d94003a40 con 0x7f8d9806fb90 2023-11-17T06:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.486+0000 7f8d8e7fc700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 0x7f8d7c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.486+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d94084910 con 0x7f8d9806fb90 2023-11-17T06:30:54.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.486+0000 7f8d9d339700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 0x7f8d7c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.486+0000 7f8d9d339700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 0x7f8d7c0689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d9815a950 tx=0x7f8d88007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.490+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d94052080 con 0x7f8d9806fb90 2023-11-17T06:30:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:54.690+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8d98065e90 con 0x7f8d9806fb90 2023-11-17T06:30:55.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.198+0000 7f8d8e7fc700 1 -- 172.21.15.100:0/886320372 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d94020080 con 0x7f8d9806fb90 2023-11-17T06:30:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 msgr2=0x7f8d7c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 0x7f8d7c0689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d9815a950 tx=0x7f8d88007e00 comp rx=0 tx=0).stop 2023-11-17T06:30:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 msgr2=0x7f8d98152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d94014040 tx=0x7f8d94004770 comp rx=0 tx=0).stop 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 shutdown_connections 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d980d15a0 0x7f8d980c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d980cd7f0 0x7f8d980cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d7c066510 0x7f8d7c0689d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 --2- 172.21.15.100:0/886320372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9806fb90 0x7f8d98152320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 >> 172.21.15.100:0/886320372 conn(0x7f8d9809a180 msgr2=0x7f8d980ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 shutdown_connections 2023-11-17T06:30:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.202+0000 7f8d9eb3c700 1 -- 172.21.15.100:0/886320372 wait complete. 2023-11-17T06:30:55.209 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2023-11-17T06:30:55.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-17T06:30:55.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 Processor -- start 2023-11-17T06:30:55.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 -- start start 2023-11-17T06:30:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 0x7f2e780cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780ce3b0 con 0x7f2e780c9a10 2023-11-17T06:30:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7806cea0 con 0x7f2e78144ac0 2023-11-17T06:30:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.398+0000 7f2e7da58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7806da00 con 0x7f2e7806ca30 2023-11-17T06:30:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e77fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2e780c9a10 0x7f2e780707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50816/0 (socket says 172.21.15.100:50816) 2023-11-17T06:30:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e77fff700 1 -- 172.21.15.100:0/1633876449 learned_addr learned my addr 172.21.15.100:0/1633876449 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7d257700 1 --2- 172.21.15.100:0/1633876449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 0x7f2e780cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7d257700 1 -- 172.21.15.100:0/1633876449 >> v1:172.21.15.119:6789/0 conn(0x7f2e78144ac0 legacy=0x7f2e780c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7d257700 1 -- 172.21.15.100:0/1633876449 >> v1:172.21.15.100:6789/0 conn(0x7f2e780c9a10 legacy=0x7f2e780707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7d257700 1 -- 172.21.15.100:0/1633876449 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7806d160 con 0x7f2e7806ca30 2023-11-17T06:30:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7d257700 1 --2- 172.21.15.100:0/1633876449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 0x7f2e780cde70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806d090 tx=0x7f2e7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ee7a3c5f7c617c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e777fe700 1 -- 172.21.15.100:0/1633876449 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70016070 con 0x7f2e7806ca30 2023-11-17T06:30:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e777fe700 1 -- 172.21.15.100:0/1633876449 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000bbd0 con 0x7f2e7806ca30 2023-11-17T06:30:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e777fe700 1 -- 172.21.15.100:0/1633876449 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000e070 con 0x7f2e7806ca30 2023-11-17T06:30:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 -- 172.21.15.100:0/1633876449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 msgr2=0x7f2e780cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 --2- 172.21.15.100:0/1633876449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 0x7f2e780cde70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806d090 tx=0x7f2e7000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 -- 172.21.15.100:0/1633876449 shutdown_connections 2023-11-17T06:30:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 --2- 172.21.15.100:0/1633876449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e7806ca30 0x7f2e780cde70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 -- 172.21.15.100:0/1633876449 >> 172.21.15.100:0/1633876449 conn(0x7f2e780cb730 msgr2=0x7f2e780cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 -- 172.21.15.100:0/1633876449 shutdown_connections 2023-11-17T06:30:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.402+0000 7f2e7da58700 1 -- 172.21.15.100:0/1633876449 wait complete. 2023-11-17T06:30:55.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.406+0000 7f2e7da58700 1 Processor -- start 2023-11-17T06:30:55.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.406+0000 7f2e7da58700 1 -- start start 2023-11-17T06:30:55.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.406+0000 7f2e7da58700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e7806ca30 0x7f2e781f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e78144ac0 0x7f2e780ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780b19d0 con 0x7f2e780c9a10 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781f6b90 con 0x7f2e7806ca30 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780b45e0 con 0x7f2e78144ac0 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40716/0 (socket says 172.21.15.100:40716) 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 -- 172.21.15.100:0/3974246173 learned_addr learned my addr 172.21.15.100:0/3974246173 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7ca56700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e7806ca30 0x7f2e781f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7d257700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e78144ac0 0x7f2e780ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 -- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e78144ac0 msgr2=0x7f2e780ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e78144ac0 0x7f2e780ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 -- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e7806ca30 msgr2=0x7f2e781f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e7806ca30 0x7f2e781f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 -- 172.21.15.100:0/3974246173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70009a70 con 0x7f2e780c9a10 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e77fff700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c730 tx=0x7f2e6400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64005d90 con 0x7f2e780c9a10 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640070d0 con 0x7f2e780c9a10 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e780b48c0 con 0x7f2e780c9a10 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64007440 con 0x7f2e780c9a10 2023-11-17T06:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.410+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e780b1f00 con 0x7f2e780c9a10 2023-11-17T06:30:55.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.414+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e78065e90 con 0x7f2e780c9a10 2023-11-17T06:30:55.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.414+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e640075a0 con 0x7f2e780c9a10 2023-11-17T06:30:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.418+0000 7f2e757fa700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 0x7f2e5c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.418+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e64082da0 con 0x7f2e780c9a10 2023-11-17T06:30:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.418+0000 7f2e7ca56700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 0x7f2e5c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.418+0000 7f2e7ca56700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 0x7f2e5c068a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c001800 tx=0x7f2e6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.422+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e64050610 con 0x7f2e780c9a10 2023-11-17T06:30:55.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.654+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2e780c3ec0 con 0x7f2e780c9a10 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e757fa700 1 -- 172.21.15.100:0/3974246173 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2e64017090 con 0x7f2e780c9a10 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDhB1dlmkyCJRAAkDXrP2IoDGm3XvQ/6eb8Ow==", 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDhB1dlxYAlORAA8E9V+z8T+ObpgqcjvvnToA==", 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDhB1dlufygMBAAc4pOyxWkpXtOojf9j+KkwA==", 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDiB1dlWqAqCBAAmD09Me6nGTNur/++tuhdjA==", 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDlB1dl2KnTKxAAVFD1/U/P8B5gvIcDK7cqHg==", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDpB1dlc/ojDhAA75vWQQx0bXMJ0JTwKF9RYQ==", 2023-11-17T06:30:55.668 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDsB1dljHvgHBAApnbET3kZSZQNJW43EbHXLA==", 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDvB1dlDrEuKRAAWVgQx1nJ8sOn03fWeqnrXA==", 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD2B1dllif6ABAAaOcdEWOmRjrT0YQj3PUPVA==", 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.671 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD5B1dl+ya/HhAAD9JFmda3Fhrk8TLfL13Kpg==", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQD8B1dlomoILxAAFB2PT/PZaJhFR7ZIfxS1Yw==", 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQACCFdl+4C1HRAAeS6GoQJUQtnYfgJSciU65w==", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2023-11-17T06:30:55.673 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDiB1dlK4OcDhAAo54plW+azztfHzX/6tuPbQ==", 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDiB1dlCMC6GhAAV8vmuY1ejBzwue95h4697g==", 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDiB1dl6s/CFBAA0zzKDjsKFZW5Lw4e08ZHAg==", 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDiB1dlKkZYIBAAAynOc6K5cU08xg0UleSa8A==", 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDgB1dlCJKvNhAApXv/Tg/ufvdvBJkmD8i3tw==", 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdljPaqOBAAzS+kF/FaUuRMpCRvt9/HMA==", 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2023-11-17T06:30:55.679 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdlJAKrOBAA8HJFnPR2E+6hEfzhpvhKlA==", 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdluAyrOBAAlXH0856clqAHfW4+AHDKFw==", 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdlzxerOBAASSr7K1mcHSA8Ug2JFrNlag==", 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdljCGrOBAA3X+LK3NhSPAhgIbktCkP6w==", 2023-11-17T06:30:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAMCFdlYi2rOBAAohJDP6MTVE76KmsGF5vZiQ==", 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.682 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDhB1dlkVvnHRAAH/hkgwLSzd5JWfMX8d/KWg==", 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDhB1dlcRSEFxAAAtRLlxpM4Emc9DlCloQsvQ==", 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2023-11-17T06:30:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.685 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:55.685 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2023-11-17T06:30:55.685 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:30:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 msgr2=0x7f2e5c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 0x7f2e5c068a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c001800 tx=0x7f2e6c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 msgr2=0x7f2e780c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c730 tx=0x7f2e6400ca40 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 shutdown_connections 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e78144ac0 0x7f2e780ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2e5c066540 0x7f2e5c068a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e780c9a10 0x7f2e780c6ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 --2- 172.21.15.100:0/3974246173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e7806ca30 0x7f2e781f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 >> 172.21.15.100:0/3974246173 conn(0x7f2e780cb730 msgr2=0x7f2e78071880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 shutdown_connections 2023-11-17T06:30:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.658+0000 7f2e7da58700 1 -- 172.21.15.100:0/3974246173 wait complete. 2023-11-17T06:30:55.688 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-17T06:30:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 Processor -- start 2023-11-17T06:30:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 -- start start 2023-11-17T06:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d00cfc10 0x7fd6d00cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 0x7fd6d00b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d00d0530 con 0x7fd6d00cda90 2023-11-17T06:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d00ce5c0 con 0x7fd6d00cfc10 2023-11-17T06:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6d5087700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d00d1480 con 0x7fd6d00b6230 2023-11-17T06:30:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6ced9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d00cfc10 0x7fd6d00cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6ced9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d00cfc10 0x7fd6d00cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40730/0 (socket says 172.21.15.100:40730) 2023-11-17T06:30:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6ced9d700 1 -- 172.21.15.100:0/2246887217 learned_addr learned my addr 172.21.15.100:0/2246887217 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6ced9d700 1 -- 172.21.15.100:0/2246887217 >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 msgr2=0x7fd6d00b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.862+0000 7fd6cf59e700 1 --2- 172.21.15.100:0/2246887217 >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 0x7fd6d00b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ced9d700 1 --2- 172.21.15.100:0/2246887217 >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 0x7fd6d00b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ced9d700 1 -- 172.21.15.100:0/2246887217 >> v1:172.21.15.119:6789/0 conn(0x7fd6d00cda90 legacy=0x7fd6d00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ced9d700 1 -- 172.21.15.100:0/2246887217 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00d1760 con 0x7fd6d00cfc10 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6cf59e700 1 --2- 172.21.15.100:0/2246887217 >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 0x7fd6d00b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ced9d700 1 --2- 172.21.15.100:0/2246887217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d00cfff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd6d008c570 tx=0x7fd6c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6910507737e5db69 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ce59c700 1 -- 172.21.15.100:0/2246887217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000e070 con 0x7fd6d00cfc10 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ce59c700 1 -- 172.21.15.100:0/2246887217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0003a40 con 0x7fd6d00cfc10 2023-11-17T06:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6ce59c700 1 -- 172.21.15.100:0/2246887217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0003df0 con 0x7fd6d00cfc10 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 -- 172.21.15.100:0/2246887217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 msgr2=0x7fd6d00cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 --2- 172.21.15.100:0/2246887217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d00cfff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd6d008c570 tx=0x7fd6c000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 -- 172.21.15.100:0/2246887217 shutdown_connections 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 --2- 172.21.15.100:0/2246887217 >> v2:172.21.15.119:3300/0 conn(0x7fd6d00b6230 0x7fd6d00b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 --2- 172.21.15.100:0/2246887217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d00cfff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 -- 172.21.15.100:0/2246887217 >> 172.21.15.100:0/2246887217 conn(0x7fd6d006b500 msgr2=0x7fd6d006b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 -- 172.21.15.100:0/2246887217 shutdown_connections 2023-11-17T06:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.866+0000 7fd6d5087700 1 -- 172.21.15.100:0/2246887217 wait complete. 2023-11-17T06:30:55.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 Processor -- start 2023-11-17T06:30:55.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 -- start start 2023-11-17T06:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b6230 0x7fd6d01fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d00cda90 0x7fd6d01fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01f7ac0 con 0x7fd6d00cfc10 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01fad30 con 0x7fd6d00cda90 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6d5087700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01fb010 con 0x7fd6d00b6230 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6cf59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6cf59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40734/0 (socket says 172.21.15.100:40734) 2023-11-17T06:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6cf59e700 1 -- 172.21.15.100:0/3258522050 learned_addr learned my addr 172.21.15.100:0/3258522050 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6ced9d700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b6230 0x7fd6d01fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.870+0000 7fd6c7fff700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d00cda90 0x7fd6d01fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 -- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b6230 msgr2=0x7fd6d01fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b6230 0x7fd6d01fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 -- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d00cda90 msgr2=0x7fd6d01fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d00cda90 0x7fd6d01fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 -- 172.21.15.100:0/3258522050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009b30 con 0x7fd6d00cfc10 2023-11-17T06:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6cf59e700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c7f0 tx=0x7fd6c800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011800 con 0x7fd6d00cfc10 2023-11-17T06:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8011980 con 0x7fd6d00cfc10 2023-11-17T06:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011d30 con 0x7fd6d00cfc10 2023-11-17T06:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d00c7e50 con 0x7fd6d00cfc10 2023-11-17T06:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d00c8410 con 0x7fd6d00cfc10 2023-11-17T06:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.874+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d00c8630 con 0x7fd6d00cfc10 2023-11-17T06:30:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.878+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6c8022350 con 0x7fd6d00cfc10 2023-11-17T06:30:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.878+0000 7fd6c77fe700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 0x7fd6b00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.878+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6c8083920 con 0x7fd6d00cfc10 2023-11-17T06:30:55.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.878+0000 7fd6ced9d700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 0x7fd6b00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.878+0000 7fd6ced9d700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 0x7fd6b00689d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f80 tx=0x7fd6c0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:55.882+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6c80510f0 con 0x7fd6d00cfc10 2023-11-17T06:30:56.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.118+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd6d004eea0 con 0x7fd6d00cfc10 2023-11-17T06:30:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.122+0000 7fd6c77fe700 1 -- 172.21.15.100:0/3258522050 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd6c8054710 con 0x7fd6d00cfc10 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 msgr2=0x7fd6b00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 0x7fd6b00689d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f80 tx=0x7fd6c0009000 comp rx=0 tx=0).stop 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 msgr2=0x7fd6d014fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c7f0 tx=0x7fd6c800cb00 comp rx=0 tx=0).stop 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 shutdown_connections 2023-11-17T06:30:56.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd6b0066510 0x7fd6b00689d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d00cfc10 0x7fd6d014fdb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d00cda90 0x7fd6d01fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 --2- 172.21.15.100:0/3258522050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d00b6230 0x7fd6d01fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 >> 172.21.15.100:0/3258522050 conn(0x7fd6d006b500 msgr2=0x7fd6d015f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 shutdown_connections 2023-11-17T06:30:56.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.130+0000 7fd6d5087700 1 -- 172.21.15.100:0/3258522050 wait complete. 2023-11-17T06:30:56.154 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-17T06:30:56.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.326+0000 7fca4abbf700 1 Processor -- start 2023-11-17T06:30:56.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.326+0000 7fca4abbf700 1 -- start start 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4abbf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca440cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4abbf700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440d0530 con 0x7fca440cda90 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4abbf700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440d1480 con 0x7fca440b6230 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4abbf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ce5c0 con 0x7fca440cfc10 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fca440cda90 0x7fca440cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50818/0 (socket says 172.21.15.100:50818) 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3bfff700 1 -- 172.21.15.100:0/459362077 learned_addr learned my addr 172.21.15.100:0/459362077 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca440cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187915440 0 0) 0x7fca440d0530 con 0x7fca440cda90 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c0035d0 con 0x7fca440cda90 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4032935531 0 0) 0x7fca2c0035d0 con 0x7fca440cda90 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 msgr2=0x7fca440cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca440cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 >> v1:172.21.15.119:6789/0 conn(0x7fca440b6230 legacy=0x7fca440b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440d1760 con 0x7fca440cda90 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7fca34001670 con 0x7fca440cda90 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 >> v1:172.21.15.100:6789/0 conn(0x7fca440cda90 legacy=0x7fca440cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003a50 0x7fca2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c004870 0x7fca2c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca2c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ce5c0 con 0x7fca2c003a50 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00bb10 con 0x7fca2c004870 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00bcd0 con 0x7fca440cfc10 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003a50 0x7fca2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3bfff700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c004870 0x7fca2c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4915c700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca2c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 -- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 msgr2=0x7fca2c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca2c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 -- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c004870 msgr2=0x7fca2c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c004870 0x7fca2c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4895b700 1 -- 172.21.15.100:0/459362077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0035d0 con 0x7fca2c003a50 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca3bfff700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c004870 0x7fca2c004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.330+0000 7fca4915c700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca440cfc10 0x7fca2c005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4895b700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003a50 0x7fca2c003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca40009b40 tx=0x7fca2c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad5957ecd410724 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000e6c0 con 0x7fca2c003a50 2023-11-17T06:30:56.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000e820 con 0x7fca2c003a50 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca3b7fe700 1 -- 172.21.15.100:0/459362077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000eb90 con 0x7fca2c003a50 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 -- 172.21.15.100:0/459362077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003a50 msgr2=0x7fca2c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 --2- 172.21.15.100:0/459362077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003a50 0x7fca2c003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca40009b40 tx=0x7fca2c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4915c700 1 -- 172.21.15.100:0/459362077 reap_dead start 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 -- 172.21.15.100:0/459362077 shutdown_connections 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 -- 172.21.15.100:0/459362077 >> 172.21.15.100:0/459362077 conn(0x7fca4406b500 msgr2=0x7fca4406b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 -- 172.21.15.100:0/459362077 shutdown_connections 2023-11-17T06:30:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.334+0000 7fca4abbf700 1 -- 172.21.15.100:0/459362077 wait complete. 2023-11-17T06:30:56.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 Processor -- start 2023-11-17T06:30:56.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 -- start start 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca2c003a50 0x7fca4415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 0x7fca440cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f3190 con 0x7fca440b7660 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f25e0 con 0x7fca440cae20 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4abbf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440b8020 con 0x7fca2c003a50 2023-11-17T06:30:56.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40742/0 (socket says 172.21.15.100:40742) 2023-11-17T06:30:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 -- 172.21.15.100:0/1994902140 learned_addr learned my addr 172.21.15.100:0/1994902140 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4915c700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 0x7fca440cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4895b700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca2c003a50 0x7fca4415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 -- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca2c003a50 msgr2=0x7fca4415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca2c003a50 0x7fca4415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 -- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 msgr2=0x7fca440cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 0x7fca440cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca3bfff700 1 -- 172.21.15.100:0/1994902140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440cb7e0 con 0x7fca440b7660 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.338+0000 7fca4915c700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 0x7fca440cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca3bfff700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca3400eaf0 tx=0x7fca3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400c7b0 con 0x7fca440b7660 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400c910 con 0x7fca440b7660 2023-11-17T06:30:56.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca441f35b0 con 0x7fca440b7660 2023-11-17T06:30:56.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cc80 con 0x7fca440b7660 2023-11-17T06:30:56.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca440b18d0 con 0x7fca440b7660 2023-11-17T06:30:56.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.342+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440c7f60 con 0x7fca440b7660 2023-11-17T06:30:56.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.346+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca3401d460 con 0x7fca440b7660 2023-11-17T06:30:56.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.346+0000 7fca397fa700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 0x7fca300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.346+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca34083a80 con 0x7fca440b7660 2023-11-17T06:30:56.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.346+0000 7fca4895b700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 0x7fca300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.350+0000 7fca4895b700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 0x7fca300689d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca400090b0 tx=0x7fca40008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.354+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca34051240 con 0x7fca440b7660 2023-11-17T06:30:56.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.586+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fca4404eea0 con 0x7fca440b7660 2023-11-17T06:30:56.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.590+0000 7fca397fa700 1 -- 172.21.15.100:0/1994902140 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fca34054860 con 0x7fca440b7660 2023-11-17T06:30:56.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.594+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 msgr2=0x7fca300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.594+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 0x7fca300689d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca400090b0 tx=0x7fca40008030 comp rx=0 tx=0).stop 2023-11-17T06:30:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.594+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 msgr2=0x7fca440b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.594+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca3400eaf0 tx=0x7fca3400eeb0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 shutdown_connections 2023-11-17T06:30:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca440cae20 0x7fca440cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fca30066510 0x7fca300689d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca440b7660 0x7fca440b7ae0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 --2- 172.21.15.100:0/1994902140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca2c003a50 0x7fca4415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 >> 172.21.15.100:0/1994902140 conn(0x7fca4406b500 msgr2=0x7fca440b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 shutdown_connections 2023-11-17T06:30:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.598+0000 7fca4abbf700 1 -- 172.21.15.100:0/1994902140 wait complete. 2023-11-17T06:30:56.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-17T06:30:56.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 Processor -- start 2023-11-17T06:30:56.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 -- start start 2023-11-17T06:30:56.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3640b1150 0x7fc3640cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640ce300 con 0x7fc364161a50 2023-11-17T06:30:56.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640cb790 con 0x7fc3640b1150 2023-11-17T06:30:56.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36bd3c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640cdb30 con 0x7fc364161670 2023-11-17T06:30:56.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc36a2d9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3640b1150 0x7fc3640cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc369ad8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc369ad8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:56574/0 (socket says 172.21.15.100:56574) 2023-11-17T06:30:56.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc369ad8700 1 -- 172.21.15.100:0/2149136023 learned_addr learned my addr 172.21.15.100:0/2149136023 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:56.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.802+0000 7fc3692d7700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc364161a50 0x7fc3640b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:46604/0 (socket says 172.21.15.100:46604) 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc368ad6700 1 -- 172.21.15.100:0/2149136023 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810201572 0 0) 0x7fc3640ce300 con 0x7fc364161a50 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc368ad6700 1 -- 172.21.15.100:0/2149136023 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3500035d0 con 0x7fc364161a50 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc369ad8700 1 -- 172.21.15.100:0/2149136023 >> v2:172.21.15.100:3300/0 conn(0x7fc3640b1150 msgr2=0x7fc3640cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc369ad8700 1 --2- 172.21.15.100:0/2149136023 >> v2:172.21.15.100:3300/0 conn(0x7fc3640b1150 0x7fc3640cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc369ad8700 1 -- 172.21.15.100:0/2149136023 >> v1:172.21.15.119:6789/0 conn(0x7fc364161a50 legacy=0x7fc3640b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc369ad8700 1 -- 172.21.15.100:0/2149136023 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640ce500 con 0x7fc364161670 2023-11-17T06:30:56.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc369ad8700 1 --2- 172.21.15.100:0/2149136023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc360009910 tx=0x7fc360009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73eab50a1c7e3209 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc368ad6700 1 -- 172.21.15.100:0/2149136023 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360011830 con 0x7fc364161670 2023-11-17T06:30:56.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc368ad6700 1 -- 172.21.15.100:0/2149136023 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360011990 con 0x7fc364161670 2023-11-17T06:30:56.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc368ad6700 1 -- 172.21.15.100:0/2149136023 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360011d40 con 0x7fc364161670 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 -- 172.21.15.100:0/2149136023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 msgr2=0x7fc3640cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/2149136023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc360009910 tx=0x7fc360009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 -- 172.21.15.100:0/2149136023 shutdown_connections 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/2149136023 >> v2:172.21.15.100:3300/0 conn(0x7fc3640b1150 0x7fc3640cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/2149136023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161670 0x7fc3640cd500 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 -- 172.21.15.100:0/2149136023 >> 172.21.15.100:0/2149136023 conn(0x7fc36406a270 msgr2=0x7fc36406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 -- 172.21.15.100:0/2149136023 shutdown_connections 2023-11-17T06:30:56.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.806+0000 7fc36bd3c700 1 -- 172.21.15.100:0/2149136023 wait complete. 2023-11-17T06:30:56.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 Processor -- start 2023-11-17T06:30:56.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 -- start start 2023-11-17T06:30:56.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc364161670 0x7fc3641fa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161a50 0x7fc3641fa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c6aa0 con 0x7fc3640b1150 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c6d10 con 0x7fc364161670 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36bd3c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c6ff0 con 0x7fc364161a50 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40758/0 (socket says 172.21.15.100:40758) 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 -- 172.21.15.100:0/3888298500 learned_addr learned my addr 172.21.15.100:0/3888298500 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc3692d7700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc364161670 0x7fc3641fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc36a2d9700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161a50 0x7fc3641fa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 -- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161a50 msgr2=0x7fc3641fa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161a50 0x7fc3641fa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 -- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc364161670 msgr2=0x7fc3641fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc364161670 0x7fc3641fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.810+0000 7fc369ad8700 1 -- 172.21.15.100:0/3888298500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360009570 con 0x7fc3640b1150 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc369ad8700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc360004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360004590 con 0x7fc3640b1150 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600036c0 con 0x7fc3640b1150 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3640c72d0 con 0x7fc3640b1150 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360003a70 con 0x7fc3640b1150 2023-11-17T06:30:56.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640c4a60 con 0x7fc3640b1150 2023-11-17T06:30:56.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.814+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3640c77f0 con 0x7fc3640b1150 2023-11-17T06:30:56.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.818+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc360003bd0 con 0x7fc3640b1150 2023-11-17T06:30:56.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.818+0000 7fc35a7fc700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 0x7fc3480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.818+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc360021030 con 0x7fc3640b1150 2023-11-17T06:30:56.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.818+0000 7fc3692d7700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 0x7fc3480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.818+0000 7fc3692d7700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 0x7fc3480689d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc354007fd0 tx=0x7fc354007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:56.826+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3640c77f0 con 0x7fc3640b1150 2023-11-17T06:30:57.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.058+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc36404eea0 con 0x7fc3640b1150 2023-11-17T06:30:57.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.062+0000 7fc35a7fc700 1 -- 172.21.15.100:0/3888298500 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc36002b0a0 con 0x7fc3640b1150 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 msgr2=0x7fc3480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 0x7fc3480689d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc354007fd0 tx=0x7fc354007c20 comp rx=0 tx=0).stop 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 msgr2=0x7fc3640c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc360004770 comp rx=0 tx=0).stop 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 shutdown_connections 2023-11-17T06:30:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc364161a50 0x7fc3641fa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc364161670 0x7fc3641fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc348066510 0x7fc3480689d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 --2- 172.21.15.100:0/3888298500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3640b1150 0x7fc3640c8850 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 >> 172.21.15.100:0/3888298500 conn(0x7fc36406a270 msgr2=0x7fc364160580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 shutdown_connections 2023-11-17T06:30:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.066+0000 7fc36bd3c700 1 -- 172.21.15.100:0/3888298500 wait complete. 2023-11-17T06:30:57.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-17T06:30:57.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.262+0000 7f1de7142700 1 Processor -- start 2023-11-17T06:30:57.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.262+0000 7f1de7142700 1 -- start start 2023-11-17T06:30:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de7142700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 0x7f1de00ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de7142700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00cd570 con 0x7f1de00c5070 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de7142700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de006d110 con 0x7f1de00cc880 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de7142700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de006cf30 con 0x7f1de00c9d80 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de593f700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1de00c5070 0x7f1de00c9670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50826/0 (socket says 172.21.15.100:50826) 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.266+0000 7f1de593f700 1 -- 172.21.15.100:0/917351561 learned_addr learned my addr 172.21.15.100:0/917351561 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:57.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de6941700 1 --2- 172.21.15.100:0/917351561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 0x7f1de00ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881999553 0 0) 0x7f1de006d110 con 0x7f1de00cc880 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dcc0035d0 con 0x7f1de00cc880 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142748082 0 0) 0x7f1de00cd570 con 0x7f1de00c5070 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de006d110 con 0x7f1de00c5070 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de6941700 1 -- 172.21.15.100:0/917351561 >> v1:172.21.15.119:6789/0 conn(0x7f1de00cc880 legacy=0x7f1de00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de6941700 1 -- 172.21.15.100:0/917351561 >> v1:172.21.15.100:6789/0 conn(0x7f1de00c5070 legacy=0x7f1de00c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de6941700 1 -- 172.21.15.100:0/917351561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de006d3f0 con 0x7f1de00c9d80 2023-11-17T06:30:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de6941700 1 --2- 172.21.15.100:0/917351561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 0x7f1de00ca210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009dc0 tx=0x7f1dd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=951d5eb2a1f51b98 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e070 con 0x7f1de00c9d80 2023-11-17T06:30:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800bb20 con 0x7f1de00c9d80 2023-11-17T06:30:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de513e700 1 -- 172.21.15.100:0/917351561 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8012430 con 0x7f1de00c9d80 2023-11-17T06:30:57.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de7142700 1 -- 172.21.15.100:0/917351561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 msgr2=0x7f1de00ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.270+0000 7f1de7142700 1 --2- 172.21.15.100:0/917351561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 0x7f1de00ca210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009dc0 tx=0x7f1dd800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:57.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 -- 172.21.15.100:0/917351561 shutdown_connections 2023-11-17T06:30:57.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 --2- 172.21.15.100:0/917351561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00c9d80 0x7f1de00ca210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 -- 172.21.15.100:0/917351561 >> 172.21.15.100:0/917351561 conn(0x7f1de00cb730 msgr2=0x7f1de00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 -- 172.21.15.100:0/917351561 shutdown_connections 2023-11-17T06:30:57.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 -- 172.21.15.100:0/917351561 wait complete. 2023-11-17T06:30:57.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 Processor -- start 2023-11-17T06:30:57.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.274+0000 7f1de7142700 1 -- start start 2023-11-17T06:30:57.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1de00c5070 0x7f1de00c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00cc880 0x7f1de00b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de006c3f0 con 0x7f1de00c9d80 2023-11-17T06:30:57.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c5f20 con 0x7f1de00c5070 2023-11-17T06:30:57.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c6200 con 0x7f1de00cc880 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40772/0 (socket says 172.21.15.100:40772) 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 -- 172.21.15.100:0/80520044 learned_addr learned my addr 172.21.15.100:0/80520044 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de6140700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1de00c5070 0x7f1de00c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de6941700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00cc880 0x7f1de00b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 -- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00cc880 msgr2=0x7f1de00b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00cc880 0x7f1de00b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 -- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1de00c5070 msgr2=0x7f1de00c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1de00c5070 0x7f1de00c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 -- 172.21.15.100:0/80520044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009a70 con 0x7f1de00c9d80 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de593f700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005930 tx=0x7f1dd000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0005d90 con 0x7f1de00c9d80 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd00070d0 con 0x7f1de00c9d80 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00c64e0 con 0x7f1de00c9d80 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0007480 con 0x7f1de00c9d80 2023-11-17T06:30:57.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.278+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de00c6aa0 con 0x7f1de00c9d80 2023-11-17T06:30:57.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.282+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0065e90 con 0x7f1de00c9d80 2023-11-17T06:30:57.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.282+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1dd00075e0 con 0x7f1de00c9d80 2023-11-17T06:30:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.286+0000 7f1dd6ffd700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 0x7f1dc40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.286+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1dd0082fd0 con 0x7f1de00c9d80 2023-11-17T06:30:57.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.286+0000 7f1de6140700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 0x7f1dc40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.286+0000 7f1de6140700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 0x7f1dc40689d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc001010 tx=0x7f1ddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.290+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1dd0050700 con 0x7f1de00c9d80 2023-11-17T06:30:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.530+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1de00cd120 con 0x7f1de00c9d80 2023-11-17T06:30:57.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.534+0000 7f1dd6ffd700 1 -- 172.21.15.100:0/80520044 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1dd00170a0 con 0x7f1de00c9d80 2023-11-17T06:30:57.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 msgr2=0x7f1dc40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 0x7f1dc40689d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc001010 tx=0x7f1ddc009040 comp rx=0 tx=0).stop 2023-11-17T06:30:57.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 msgr2=0x7f1de00b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005930 tx=0x7f1dd000c9e0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 shutdown_connections 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1de00cc880 0x7f1de00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1dc4066510 0x7f1dc40689d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1de00c9d80 0x7f1de00b3e50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 --2- 172.21.15.100:0/80520044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1de00c5070 0x7f1de00c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 >> 172.21.15.100:0/80520044 conn(0x7f1de00cb730 msgr2=0x7f1de00af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 shutdown_connections 2023-11-17T06:30:57.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.538+0000 7f1de7142700 1 -- 172.21.15.100:0/80520044 wait complete. 2023-11-17T06:30:57.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-17T06:30:57.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.734+0000 7f3e06cf2700 1 Processor -- start 2023-11-17T06:30:57.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.734+0000 7f3e06cf2700 1 -- start start 2023-11-17T06:30:57.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e06cf2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3e000c5070 0x7f3e000c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e06cf2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c9bb0 0x7f3e000ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e06cf2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e000cd570 con 0x7f3e000cc880 2023-11-17T06:30:57.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e06cf2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0006cf30 con 0x7f3e000c5070 2023-11-17T06:30:57.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e06cf2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0006c3f0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3e000c5070 0x7f3e000c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e05cf0700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3e000cc880 0x7f3e000ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50840/0 (socket says 172.21.15.100:50840) 2023-11-17T06:30:57.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e05cf0700 1 -- 172.21.15.100:0/2099830525 learned_addr learned my addr 172.21.15.100:0/2099830525 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:57.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e064f1700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c9bb0 0x7f3e000ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 -- 172.21.15.100:0/2099830525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c9bb0 msgr2=0x7f3e000ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:57.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c9bb0 0x7f3e000ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 -- 172.21.15.100:0/2099830525 >> v1:172.21.15.100:6789/0 conn(0x7f3e000cc880 legacy=0x7f3e000ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 -- 172.21.15.100:0/2099830525 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0006d110 con 0x7f3e000c5070 2023-11-17T06:30:57.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.738+0000 7f3e054ef700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c5070 0x7f3e000c9670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009880 tx=0x7f3df0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18177191f5e4e491 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e04cee700 1 -- 172.21.15.100:0/2099830525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011830 con 0x7f3e000c5070 2023-11-17T06:30:57.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e04cee700 1 -- 172.21.15.100:0/2099830525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0011990 con 0x7f3e000c5070 2023-11-17T06:30:57.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e04cee700 1 -- 172.21.15.100:0/2099830525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011d20 con 0x7f3e000c5070 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 -- 172.21.15.100:0/2099830525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c5070 msgr2=0x7f3e000c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c5070 0x7f3e000c9670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009880 tx=0x7f3df0009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 -- 172.21.15.100:0/2099830525 shutdown_connections 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c9bb0 0x7f3e000ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/2099830525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c5070 0x7f3e000c9670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 -- 172.21.15.100:0/2099830525 >> 172.21.15.100:0/2099830525 conn(0x7f3e000cb730 msgr2=0x7f3e000cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 -- 172.21.15.100:0/2099830525 shutdown_connections 2023-11-17T06:30:57.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.742+0000 7f3e06cf2700 1 -- 172.21.15.100:0/2099830525 wait complete. 2023-11-17T06:30:57.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 Processor -- start 2023-11-17T06:30:57.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 -- start start 2023-11-17T06:30:57.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c5070 0x7f3e000c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e000cc880 0x7f3e000c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e000c7960 con 0x7f3e000c9bb0 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001471d0 con 0x7f3e000cc880 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e000c6ce0 con 0x7f3e000c5070 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40794/0 (socket says 172.21.15.100:40794) 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 -- 172.21.15.100:0/1759038782 learned_addr learned my addr 172.21.15.100:0/1759038782 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e05cf0700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c5070 0x7f3e000c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 -- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c5070 msgr2=0x7f3e000c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c5070 0x7f3e000c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 -- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e000cc880 msgr2=0x7f3e000c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e000cc880 0x7f3e000c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 -- 172.21.15.100:0/1759038782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00094b0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e054ef700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3df00090b0 tx=0x7f3df0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00036c0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0003840 con 0x7f3e000c9bb0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0003bf0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.746+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e000c6fc0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.750+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e000c7580 con 0x7f3e000c9bb0 2023-11-17T06:30:57.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.750+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e000cdde0 con 0x7f3e000c9bb0 2023-11-17T06:30:57.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.750+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3df0003d50 con 0x7f3e000c9bb0 2023-11-17T06:30:57.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.754+0000 7f3df67fc700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 0x7f3de40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.754+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3df0021030 con 0x7f3e000c9bb0 2023-11-17T06:30:57.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.754+0000 7f3e05cf0700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 0x7f3de40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.754+0000 7f3e05cf0700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 0x7f3de40689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005930 tx=0x7f3dfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.758+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3df00529a0 con 0x7f3e000c9bb0 2023-11-17T06:30:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:57.998+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3e000c7aa0 con 0x7f3e000c9bb0 2023-11-17T06:30:58.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.002+0000 7f3df67fc700 1 -- 172.21.15.100:0/1759038782 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e000c7aa0 con 0x7f3e000c9bb0 2023-11-17T06:30:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 msgr2=0x7f3de40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 0x7f3de40689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005930 tx=0x7f3dfc009040 comp rx=0 tx=0).stop 2023-11-17T06:30:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 msgr2=0x7f3e00161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3df00090b0 tx=0x7f3df0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 shutdown_connections 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e000cc880 0x7f3e000c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3de4066510 0x7f3de40689d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e000c9bb0 0x7f3e00161130 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 --2- 172.21.15.100:0/1759038782 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e000c5070 0x7f3e000c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 >> 172.21.15.100:0/1759038782 conn(0x7f3e000cb730 msgr2=0x7f3e000caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 shutdown_connections 2023-11-17T06:30:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.006+0000 7f3e06cf2700 1 -- 172.21.15.100:0/1759038782 wait complete. 2023-11-17T06:30:58.032 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-17T06:30:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 Processor -- start 2023-11-17T06:30:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 -- start start 2023-11-17T06:30:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3a080cfe40 0x7f3a080d2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a081619b0 con 0x7f3a080cf9e0 2023-11-17T06:30:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080d1180 con 0x7f3a0815d1c0 2023-11-17T06:30:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0e883700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080d1460 con 0x7f3a080cfe40 2023-11-17T06:30:58.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0d080700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3a080cf9e0 0x7f3a080d1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50846/0 (socket says 172.21.15.100:50846) 2023-11-17T06:30:58.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.210+0000 7f3a0d080700 1 -- 172.21.15.100:0/3390281419 learned_addr learned my addr 172.21.15.100:0/3390281419 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e082700 1 --2- 172.21.15.100:0/3390281419 >> v2:172.21.15.119:3300/0 conn(0x7f3a080cfe40 0x7f3a080d2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933596389 0 0) 0x7f3a080d1180 con 0x7f3a0815d1c0 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f40035d0 con 0x7f3a0815d1c0 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468119318 0 0) 0x7f3a081619b0 con 0x7f3a080cf9e0 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a080d1180 con 0x7f3a080cf9e0 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e082700 1 -- 172.21.15.100:0/3390281419 >> v1:172.21.15.119:6789/0 conn(0x7f3a0815d1c0 legacy=0x7f3a08160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e082700 1 -- 172.21.15.100:0/3390281419 >> v1:172.21.15.100:6789/0 conn(0x7f3a080cf9e0 legacy=0x7f3a080d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e082700 1 -- 172.21.15.100:0/3390281419 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080d1740 con 0x7f3a080cfe40 2023-11-17T06:30:58.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e082700 1 --2- 172.21.15.100:0/3390281419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a080d2370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009d90 tx=0x7f3a0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7113d8bbd7d3771 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000e070 con 0x7f3a080cfe40 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000bb20 con 0x7f3a080cfe40 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0c87f700 1 -- 172.21.15.100:0/3390281419 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00012430 con 0x7f3a080cfe40 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 -- 172.21.15.100:0/3390281419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 msgr2=0x7f3a080d2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 --2- 172.21.15.100:0/3390281419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a080d2370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009d90 tx=0x7f3a0000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 -- 172.21.15.100:0/3390281419 shutdown_connections 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 --2- 172.21.15.100:0/3390281419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a080d2370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 -- 172.21.15.100:0/3390281419 >> 172.21.15.100:0/3390281419 conn(0x7f3a080d2fd0 msgr2=0x7f3a080d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 -- 172.21.15.100:0/3390281419 shutdown_connections 2023-11-17T06:30:58.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.214+0000 7f3a0e883700 1 -- 172.21.15.100:0/3390281419 wait complete. 2023-11-17T06:30:58.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.218+0000 7f3a0e883700 1 Processor -- start 2023-11-17T06:30:58.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.218+0000 7f3a0e883700 1 -- start start 2023-11-17T06:30:58.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a080cf9e0 0x7f3a0814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a0815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081608b0 con 0x7f3a0815d1c0 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815f810 con 0x7f3a080cfe40 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815faf0 con 0x7f3a080cf9e0 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40800/0 (socket says 172.21.15.100:40800) 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 -- 172.21.15.100:0/411667530 learned_addr learned my addr 172.21.15.100:0/411667530 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0d080700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a0815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0d881700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a080cf9e0 0x7f3a0814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 -- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a080cf9e0 msgr2=0x7f3a0814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a080cf9e0 0x7f3a0814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 -- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 msgr2=0x7f3a0815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a0815d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 -- 172.21.15.100:0/411667530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009a70 con 0x7f3a0815d1c0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e082700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3a0806c670 tx=0x7f3a00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00012430 con 0x7f3a0815d1c0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00020070 con 0x7f3a0815d1c0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0001ba50 con 0x7f3a0815d1c0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0815fdd0 con 0x7f3a0815d1c0 2023-11-17T06:30:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.222+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a08160390 con 0x7f3a0815d1c0 2023-11-17T06:30:58.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.226+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08065e90 con 0x7f3a0815d1c0 2023-11-17T06:30:58.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.226+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a0001bbb0 con 0x7f3a0815d1c0 2023-11-17T06:30:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.226+0000 7f39fe7fc700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 0x7f39ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.230+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a00022070 con 0x7f3a0815d1c0 2023-11-17T06:30:58.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.230+0000 7f3a0d881700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 0x7f39ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.230+0000 7f3a0d881700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 0x7f39ec0689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007fd0 tx=0x7f3a04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.234+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a00053170 con 0x7f3a0815d1c0 2023-11-17T06:30:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.462+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f3a080d0c00 con 0x7f3a0815d1c0 2023-11-17T06:30:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.470+0000 7f39fe7fc700 1 -- 172.21.15.100:0/411667530 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3a0001be60 con 0x7f3a0815d1c0 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.470+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 msgr2=0x7f39ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.470+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 0x7f39ec0689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007fd0 tx=0x7f3a04009040 comp rx=0 tx=0).stop 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.470+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 msgr2=0x7f3a0814b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.470+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3a0806c670 tx=0x7f3a00004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 shutdown_connections 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f39ec066510 0x7f39ec0689d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a0815d1c0 0x7f3a0814b0e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a080cfe40 0x7f3a0815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 --2- 172.21.15.100:0/411667530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a080cf9e0 0x7f3a0814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 >> 172.21.15.100:0/411667530 conn(0x7f3a080d2fd0 msgr2=0x7f3a080b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 shutdown_connections 2023-11-17T06:30:58.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.474+0000 7f3a0e883700 1 -- 172.21.15.100:0/411667530 wait complete. 2023-11-17T06:30:58.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.682+0000 7f101793c700 1 Processor -- start 2023-11-17T06:30:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.682+0000 7f101793c700 1 -- start start 2023-11-17T06:30:58.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f101793c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f101015b0a0 0x7f10100cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f101793c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 0x7f101015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f101793c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1010070ad0 con 0x7f10100cf8a0 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f101793c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1010071f20 con 0x7f10100b1150 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f101793c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100cfd30 con 0x7f101015b0a0 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1014ed7700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f10100cf8a0 0x7f10100b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50848/0 (socket says 172.21.15.100:50848) 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1014ed7700 1 -- 172.21.15.100:0/2858928204 learned_addr learned my addr 172.21.15.100:0/2858928204 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1015ed9700 1 --2- 172.21.15.100:0/2858928204 >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 0x7f101015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f10156d8700 1 --2- 172.21.15.100:0/2858928204 >> v2:172.21.15.119:3300/0 conn(0x7f101015b0a0 0x7f10100cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1007fff700 1 -- 172.21.15.100:0/2858928204 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429593096 0 0) 0x7f1010070ad0 con 0x7f10100cf8a0 2023-11-17T06:30:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1007fff700 1 -- 172.21.15.100:0/2858928204 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc0035d0 con 0x7f10100cf8a0 2023-11-17T06:30:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f10156d8700 1 -- 172.21.15.100:0/2858928204 >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 msgr2=0x7f101015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f10156d8700 1 --2- 172.21.15.100:0/2858928204 >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 0x7f101015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f10156d8700 1 -- 172.21.15.100:0/2858928204 >> v1:172.21.15.100:6789/0 conn(0x7f10100cf8a0 legacy=0x7f10100b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f10156d8700 1 -- 172.21.15.100:0/2858928204 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100721a0 con 0x7f101015b0a0 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.686+0000 7f1015ed9700 1 --2- 172.21.15.100:0/2858928204 >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 0x7f101015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f10156d8700 1 --2- 172.21.15.100:0/2858928204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f101015b0a0 0x7f10100cb3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f101006db00 tx=0x7f100c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b390ef7f1288f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f1007fff700 1 -- 172.21.15.100:0/2858928204 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c011830 con 0x7f101015b0a0 2023-11-17T06:30:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f1007fff700 1 -- 172.21.15.100:0/2858928204 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c011990 con 0x7f101015b0a0 2023-11-17T06:30:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f1007fff700 1 -- 172.21.15.100:0/2858928204 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c011d20 con 0x7f101015b0a0 2023-11-17T06:30:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 -- 172.21.15.100:0/2858928204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f101015b0a0 msgr2=0x7f10100cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 --2- 172.21.15.100:0/2858928204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f101015b0a0 0x7f10100cb3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f101006db00 tx=0x7f100c009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 -- 172.21.15.100:0/2858928204 shutdown_connections 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 --2- 172.21.15.100:0/2858928204 >> v2:172.21.15.100:3300/0 conn(0x7f10100b1150 0x7f101015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 --2- 172.21.15.100:0/2858928204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f101015b0a0 0x7f10100cb3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 -- 172.21.15.100:0/2858928204 >> 172.21.15.100:0/2858928204 conn(0x7f101006a270 msgr2=0x7f101006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 -- 172.21.15.100:0/2858928204 shutdown_connections 2023-11-17T06:30:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.690+0000 7f101793c700 1 -- 172.21.15.100:0/2858928204 wait complete. 2023-11-17T06:30:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 Processor -- start 2023-11-17T06:30:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 -- start start 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10100b1150 0x7f10100ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10100cf8a0 0x7f10100a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a9690 con 0x7f101015b0a0 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a93d0 con 0x7f10100b1150 2023-11-17T06:30:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100aa2e0 con 0x7f10100cf8a0 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40820/0 (socket says 172.21.15.100:40820) 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 -- 172.21.15.100:0/3540392691 learned_addr learned my addr 172.21.15.100:0/3540392691 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f10156d8700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10100b1150 0x7f10100ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1014ed7700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10100cf8a0 0x7f10100a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 -- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10100cf8a0 msgr2=0x7f10100a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10100cf8a0 0x7f10100a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 -- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10100b1150 msgr2=0x7f10100ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10100b1150 0x7f10100ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 -- 172.21.15.100:0/3540392691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009a70 con 0x7f101015b0a0 2023-11-17T06:30:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1015ed9700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f100800efc0 tx=0x7f100800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800cb40 con 0x7f101015b0a0 2023-11-17T06:30:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c0094b0 con 0x7f101015b0a0 2023-11-17T06:30:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800f040 con 0x7f101015b0a0 2023-11-17T06:30:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.694+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008003a40 con 0x7f101015b0a0 2023-11-17T06:30:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.698+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10100aa8a0 con 0x7f101015b0a0 2023-11-17T06:30:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.698+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10100669b0 con 0x7f101015b0a0 2023-11-17T06:30:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.698+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1008014480 con 0x7f101015b0a0 2023-11-17T06:30:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.702+0000 7f1005ffb700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 0x7f0ff40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.702+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10080844d0 con 0x7f101015b0a0 2023-11-17T06:30:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.702+0000 7f10156d8700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 0x7f0ff40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.702+0000 7f10156d8700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 0x7f0ff40689d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.706+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10100669b0 con 0x7f101015b0a0 2023-11-17T06:30:58.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.886+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10100669b0 con 0x7f101015b0a0 2023-11-17T06:30:58.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.886+0000 7f1005ffb700 1 -- 172.21.15.100:0/3540392691 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f10100669b0 con 0x7f101015b0a0 2023-11-17T06:30:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:58.893 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:30:55.214060+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 msgr2=0x7f0ff40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 0x7f0ff40689d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 msgr2=0x7f101014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f100800efc0 tx=0x7f100800c3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 shutdown_connections 2023-11-17T06:30:58.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ff4066510 0x7f0ff40689d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f101015b0a0 0x7f101014c200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10100cf8a0 0x7f10100a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 --2- 172.21.15.100:0/3540392691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10100b1150 0x7f10100ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 >> 172.21.15.100:0/3540392691 conn(0x7f101006a270 msgr2=0x7f10100ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 shutdown_connections 2023-11-17T06:30:58.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:58.890+0000 7f101793c700 1 -- 172.21.15.100:0/3540392691 wait complete. 2023-11-17T06:30:58.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:58.921 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:59.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 Processor -- start 2023-11-17T06:30:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 -- start start 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0cc7b0 con 0x7ffbdc1599b0 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0cd6d0 con 0x7ffbdc0cc300 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe4554700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0cd9b0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe22f0700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ffbdc1599b0 0x7ffbdc0ceeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50854/0 (socket says 172.21.15.100:50854) 2023-11-17T06:30:59.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe22f0700 1 -- 172.21.15.100:0/1590125669 learned_addr learned my addr 172.21.15.100:0/1590125669 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.098+0000 7ffbe1aef700 1 --2- 172.21.15.100:0/1590125669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698491600 0 0) 0x7ffbdc0cc7b0 con 0x7ffbdc1599b0 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc80035d0 con 0x7ffbdc1599b0 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221533753 0 0) 0x7ffbdc0cd6d0 con 0x7ffbdc0cc300 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbdc0cc7b0 con 0x7ffbdc0cc300 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe1aef700 1 -- 172.21.15.100:0/1590125669 >> v1:172.21.15.119:6789/0 conn(0x7ffbdc0cc300 legacy=0x7ffbdc070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe1aef700 1 -- 172.21.15.100:0/1590125669 >> v1:172.21.15.100:6789/0 conn(0x7ffbdc1599b0 legacy=0x7ffbdc0ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe1aef700 1 -- 172.21.15.100:0/1590125669 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0cdc90 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe1aef700 1 --2- 172.21.15.100:0/1590125669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc0cd080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009880 tx=0x7ffbcc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99f39a7028ae10c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011830 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc011990 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe12ee700 1 -- 172.21.15.100:0/1590125669 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011d20 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe4554700 1 -- 172.21.15.100:0/1590125669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 msgr2=0x7ffbdc0cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.102+0000 7ffbe4554700 1 --2- 172.21.15.100:0/1590125669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc0cd080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009880 tx=0x7ffbcc009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.106+0000 7ffbe4554700 1 -- 172.21.15.100:0/1590125669 shutdown_connections 2023-11-17T06:30:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.106+0000 7ffbe4554700 1 --2- 172.21.15.100:0/1590125669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc0cd080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.106+0000 7ffbe4554700 1 -- 172.21.15.100:0/1590125669 >> 172.21.15.100:0/1590125669 conn(0x7ffbdc06a450 msgr2=0x7ffbdc06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.106+0000 7ffbe4554700 1 -- 172.21.15.100:0/1590125669 shutdown_connections 2023-11-17T06:30:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.106+0000 7ffbe4554700 1 -- 172.21.15.100:0/1590125669 wait complete. 2023-11-17T06:30:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 Processor -- start 2023-11-17T06:30:59.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 -- start start 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 0x7ffbdc158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc1599b0 0x7ffbdc0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc158e70 con 0x7ffbdc0cc300 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1f3110 con 0x7ffbdc1599b0 2023-11-17T06:30:59.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe4554700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0c81d0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe22f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 0x7ffbdc158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe22f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 0x7ffbdc158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40826/0 (socket says 172.21.15.100:40826) 2023-11-17T06:30:59.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe22f0700 1 -- 172.21.15.100:0/2504181770 learned_addr learned my addr 172.21.15.100:0/2504181770 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe2af1700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc1599b0 0x7ffbdc0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 -- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc1599b0 msgr2=0x7ffbdc0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc1599b0 0x7ffbdc0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 -- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 msgr2=0x7ffbdc158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 0x7ffbdc158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 -- 172.21.15.100:0/2504181770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0094b0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbe1aef700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc1f2bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc015000 tx=0x7ffbcc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.110+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc01a8c0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc01e070 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc0c84b0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc01ac60 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0c8a70 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc04eea0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.114+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffbcc02d450 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.118+0000 7ffbd2ffd700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 0x7ffbc00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.118+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffbcc0849f0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.118+0000 7ffbe22f0700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 0x7ffbc00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.118+0000 7ffbe22f0700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 0x7ffbc00689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000f60 tx=0x7ffbd8007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.122+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbcc0521b0 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.306+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbdc0ccc30 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.306+0000 7ffbd2ffd700 1 -- 172.21.15.100:0/2504181770 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffbcc020020 con 0x7ffbdc0cf5c0 2023-11-17T06:30:59.312 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:30:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 msgr2=0x7ffbc00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 0x7ffbc00689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000f60 tx=0x7ffbd8007ec0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 msgr2=0x7ffbdc1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc1f2bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc015000 tx=0x7ffbcc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 shutdown_connections 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbdc1599b0 0x7ffbdc0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbdc0cf5c0 0x7ffbdc1f2bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ffbc0066510 0x7ffbc00689d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 --2- 172.21.15.100:0/2504181770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbdc0cc300 0x7ffbdc158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 >> 172.21.15.100:0/2504181770 conn(0x7ffbdc06a450 msgr2=0x7ffbdc0b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 shutdown_connections 2023-11-17T06:30:59.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.310+0000 7ffbe4554700 1 -- 172.21.15.100:0/2504181770 wait complete. 2023-11-17T06:30:59.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-17T06:30:59.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.502+0000 7f106f59e700 1 Processor -- start 2023-11-17T06:30:59.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.502+0000 7f106f59e700 1 -- start start 2023-11-17T06:30:59.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.502+0000 7f106f59e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10700c5070 0x7f10700c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.502+0000 7f106f59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700cd570 con 0x7f10700c9bb0 2023-11-17T06:30:59.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.502+0000 7f106f59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107006d110 con 0x7f10700cc880 2023-11-17T06:30:59.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107006cf30 con 0x7f10700c5070 2023-11-17T06:30:59.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106ed9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f10700c9bb0 0x7f10700ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50860/0 (socket says 172.21.15.100:50860) 2023-11-17T06:30:59.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106dd9b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f10700c5070 0x7f10700c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106ed9d700 1 -- 172.21.15.100:0/2199019830 learned_addr learned my addr 172.21.15.100:0/2199019830 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:30:59.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106dd9b700 1 -- 172.21.15.100:0/2199019830 >> v1:172.21.15.119:6789/0 conn(0x7f10700cc880 legacy=0x7f10700ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106dd9b700 1 -- 172.21.15.100:0/2199019830 >> v1:172.21.15.100:6789/0 conn(0x7f10700c9bb0 legacy=0x7f10700ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106dd9b700 1 -- 172.21.15.100:0/2199019830 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107006d3f0 con 0x7f10700c5070 2023-11-17T06:30:59.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106d59a700 1 -- 172.21.15.100:0/2199019830 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824375815 0 0) 0x7f10700cd570 con 0x7f10700c9bb0 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106dd9b700 1 --2- 172.21.15.100:0/2199019830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700c5070 0x7f10700c9670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1064009880 tx=0x7f1064009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16379bbb60c44f24 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106d59a700 1 -- 172.21.15.100:0/2199019830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064011830 con 0x7f10700c5070 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106d59a700 1 -- 172.21.15.100:0/2199019830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1064011990 con 0x7f10700c5070 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106d59a700 1 -- 172.21.15.100:0/2199019830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064011d20 con 0x7f10700c5070 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- 172.21.15.100:0/2199019830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700c5070 msgr2=0x7f10700c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 --2- 172.21.15.100:0/2199019830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700c5070 0x7f10700c9670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1064009880 tx=0x7f1064009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:59.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- 172.21.15.100:0/2199019830 shutdown_connections 2023-11-17T06:30:59.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 --2- 172.21.15.100:0/2199019830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700c5070 0x7f10700c9670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- 172.21.15.100:0/2199019830 >> 172.21.15.100:0/2199019830 conn(0x7f10700cb730 msgr2=0x7f10700cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- 172.21.15.100:0/2199019830 shutdown_connections 2023-11-17T06:30:59.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.506+0000 7f106f59e700 1 -- 172.21.15.100:0/2199019830 wait complete. 2023-11-17T06:30:59.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.510+0000 7f106f59e700 1 Processor -- start 2023-11-17T06:30:59.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.510+0000 7f106f59e700 1 -- start start 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10700c5070 0x7f1070160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10700c9bb0 0x7f10701626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107006c3f0 con 0x7f10700cc880 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b2460 con 0x7f10700c9bb0 2023-11-17T06:30:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b1b50 con 0x7f10700c5070 2023-11-17T06:30:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40838/0 (socket says 172.21.15.100:40838) 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 -- 172.21.15.100:0/2674425223 learned_addr learned my addr 172.21.15.100:0/2674425223 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106dd9b700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10700c9bb0 0x7f10701626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106e59c700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10700c5070 0x7f1070160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 -- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10700c5070 msgr2=0x7f1070160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10700c5070 0x7f1070160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 -- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10700c9bb0 msgr2=0x7f10701626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10700c9bb0 0x7f10701626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 -- 172.21.15.100:0/2674425223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640094b0 con 0x7f10700cc880 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106ed9d700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f106800cc70 tx=0x7f106800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800aac0 con 0x7f10700cc880 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800ac40 con 0x7f10700cc880 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10700b1e10 con 0x7f10700cc880 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680070d0 con 0x7f10700cc880 2023-11-17T06:30:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.514+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1070162c30 con 0x7f10700cc880 2023-11-17T06:30:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.518+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070065e90 con 0x7f10700cc880 2023-11-17T06:30:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.518+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1068007250 con 0x7f10700cc880 2023-11-17T06:30:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.522+0000 7f105effd700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 0x7f10500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.522+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10680838d0 con 0x7f10700cc880 2023-11-17T06:30:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.522+0000 7f106e59c700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 0x7f10500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.522+0000 7f106e59c700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 0x7f10500689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f107006c980 tx=0x7f1060009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.526+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10680510a0 con 0x7f10700cc880 2023-11-17T06:30:59.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.706+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f10700b25a0 con 0x7f10700cc880 2023-11-17T06:30:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.706+0000 7f105effd700 1 -- 172.21.15.100:0/2674425223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1068018090 con 0x7f10700cc880 2023-11-17T06:30:59.711 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:30:59.712 INFO:teuthology.orchestra.run.smithi100.stdout:] 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 msgr2=0x7f10500689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 0x7f10500689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f107006c980 tx=0x7f1060009040 comp rx=0 tx=0).stop 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 msgr2=0x7f10700c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f106800cc70 tx=0x7f106800cf80 comp rx=0 tx=0).stop 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 shutdown_connections 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1050066510 0x7f10500689d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10700cc880 0x7f10700c64e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10700c9bb0 0x7f10701626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 --2- 172.21.15.100:0/2674425223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10700c5070 0x7f1070160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 >> 172.21.15.100:0/2674425223 conn(0x7f10700cb730 msgr2=0x7f10700af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 shutdown_connections 2023-11-17T06:30:59.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.710+0000 7f106f59e700 1 -- 172.21.15.100:0/2674425223 wait complete. 2023-11-17T06:30:59.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-17T06:30:59.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-17T06:30:59.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.906+0000 7fa00d8d4700 1 Processor -- start 2023-11-17T06:30:59.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.906+0000 7fa00d8d4700 1 -- start start 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 0x7fa0080b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa008072380 0x7fa0080cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0080cbd70 0x7fa00815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080cc220 con 0x7fa008072380 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080b1990 con 0x7fa0080cbd70 2023-11-17T06:30:59.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa00d8d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa008070240 con 0x7fa0081449a0 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7f9ffffff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa008072380 0x7fa0080cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa006ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 0x7fa0080b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0080cbd70 0x7fa00815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa006ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 0x7fa0080b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:56680/0 (socket says 172.21.15.100:56680) 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0080cbd70 0x7fa00815ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:33780/0 (socket says 172.21.15.100:33780) 2023-11-17T06:30:59.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa006ffd700 1 -- 172.21.15.100:0/1221009450 learned_addr learned my addr 172.21.15.100:0/1221009450 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:59.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 -- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 msgr2=0x7fa0080b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:59.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 0x7fa0080b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 -- 172.21.15.100:0/1221009450 >> v2:172.21.15.100:3300/0 conn(0x7fa008072380 msgr2=0x7fa0080cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:59.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1221009450 >> v2:172.21.15.100:3300/0 conn(0x7fa008072380 0x7fa0080cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.910+0000 7fa0077fe700 1 -- 172.21.15.100:0/1221009450 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008144d80 con 0x7fa0080cbd70 2023-11-17T06:30:59.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0080cbd70 0x7fa00815ec20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa00806c960 tx=0x7fa00000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6887f689cd2dc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa0067fc700 1 -- 172.21.15.100:0/1221009450 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000e070 con 0x7fa0080cbd70 2023-11-17T06:30:59.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa0067fc700 1 -- 172.21.15.100:0/1221009450 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000bb20 con 0x7fa0080cbd70 2023-11-17T06:30:59.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa0067fc700 1 -- 172.21.15.100:0/1221009450 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000012430 con 0x7fa0080cbd70 2023-11-17T06:30:59.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0080cbd70 msgr2=0x7fa00815ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0080cbd70 0x7fa00815ec20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa00806c960 tx=0x7fa00000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1221009450 shutdown_connections 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0080cbd70 0x7fa00815ec20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1221009450 >> v2:172.21.15.100:3300/0 conn(0x7fa008072380 0x7fa0080cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1221009450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0081449a0 0x7fa0080b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1221009450 >> 172.21.15.100:0/1221009450 conn(0x7fa00806a270 msgr2=0x7fa00806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1221009450 shutdown_connections 2023-11-17T06:30:59.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.914+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1221009450 wait complete. 2023-11-17T06:30:59.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 Processor -- start 2023-11-17T06:30:59.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 -- start start 2023-11-17T06:30:59.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa008072380 0x7fa0081f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0080cbd70 0x7fa0080c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c98f0 con 0x7fa0081449a0 2023-11-17T06:30:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c8ce0 con 0x7fa008072380 2023-11-17T06:30:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa00d8d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c8fc0 con 0x7fa0080cbd70 2023-11-17T06:30:59.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40864/0 (socket says 172.21.15.100:40864) 2023-11-17T06:30:59.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa0077fe700 1 -- 172.21.15.100:0/1296251940 learned_addr learned my addr 172.21.15.100:0/1296251940 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:30:59.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7fa006ffd700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa008072380 0x7fa0081f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.918+0000 7f9ffffff700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0080cbd70 0x7fa0080c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 -- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0080cbd70 msgr2=0x7fa0080c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0080cbd70 0x7fa0080c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 -- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa008072380 msgr2=0x7fa0081f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa008072380 0x7fa0081f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 -- 172.21.15.100:0/1296251940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009a70 con 0x7fa0081449a0 2023-11-17T06:30:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa0077fe700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa000014040 tx=0x7fa000004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000004800 con 0x7fa0081449a0 2023-11-17T06:30:59.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa000020070 con 0x7fa0081449a0 2023-11-17T06:30:59.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0080c92a0 con 0x7fa0081449a0 2023-11-17T06:30:59.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000276c0 con 0x7fa0081449a0 2023-11-17T06:30:59.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0081f3ca0 con 0x7fa0081449a0 2023-11-17T06:30:59.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.922+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0080cc3f0 con 0x7fa0081449a0 2023-11-17T06:30:59.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.926+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa000012430 con 0x7fa0081449a0 2023-11-17T06:30:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.926+0000 7fa004ff9700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.926+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa000022070 con 0x7fa0081449a0 2023-11-17T06:30:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.930+0000 7fa006ffd700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.930+0000 7fa006ffd700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0080b4440 tx=0x7f9ff80092e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:30:59.934+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa000052e40 con 0x7fa0081449a0 2023-11-17T06:31:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.114+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa00804eea0 con 0x7fa0081449a0 2023-11-17T06:31:00.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.222+0000 7fa004ff9700 1 -- 172.21.15.100:0/1296251940 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa00002c0b0 con 0x7fa0081449a0 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 msgr2=0x7f9fec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0080b4440 tx=0x7f9ff80092e0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 msgr2=0x7fa0080c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa000014040 tx=0x7fa000004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 shutdown_connections 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9fec066510 0x7f9fec0689d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0081449a0 0x7fa0080c86b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0080cbd70 0x7fa0080c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 --2- 172.21.15.100:0/1296251940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa008072380 0x7fa0081f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 >> 172.21.15.100:0/1296251940 conn(0x7fa00806a270 msgr2=0x7fa008143bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 shutdown_connections 2023-11-17T06:31:00.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.226+0000 7fa00d8d4700 1 -- 172.21.15.100:0/1296251940 wait complete. 2023-11-17T06:31:00.237 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2023-11-17T06:31:00.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-17T06:31:00.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.434+0000 7f07db863700 1 Processor -- start 2023-11-17T06:31:00.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 -- start start 2023-11-17T06:31:00.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07d40cfa90 0x7f07d40cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07d40b63d0 0x7f07d40b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d415d6a0 con 0x7f07d415d2c0 2023-11-17T06:31:00.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40d2150 con 0x7f07d40b63d0 2023-11-17T06:31:00.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07db863700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40d0460 con 0x7f07d40cfa90 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07d9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07d40b63d0 0x7f07d40b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07d9e00700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07d40b63d0 0x7f07d40b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40880/0 (socket says 172.21.15.100:40880) 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07d9e00700 1 -- 172.21.15.100:0/1309357413 learned_addr learned my addr 172.21.15.100:0/1309357413 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.438+0000 7f07d8dfe700 1 --2- 172.21.15.100:0/1309357413 >> v2:172.21.15.119:3300/0 conn(0x7f07d40cfa90 0x7f07d40cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07d9e00700 1 -- 172.21.15.100:0/1309357413 >> v2:172.21.15.119:3300/0 conn(0x7f07d40cfa90 msgr2=0x7f07d40cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07d9e00700 1 --2- 172.21.15.100:0/1309357413 >> v2:172.21.15.119:3300/0 conn(0x7f07d40cfa90 0x7f07d40cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07d9e00700 1 -- 172.21.15.100:0/1309357413 >> v1:172.21.15.119:6789/0 conn(0x7f07d415d2c0 legacy=0x7f07d40d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07d9e00700 1 -- 172.21.15.100:0/1309357413 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40d14d0 con 0x7f07d40b63d0 2023-11-17T06:31:00.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07d9e00700 1 --2- 172.21.15.100:0/1309357413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d40b6800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f07d408c3f0 tx=0x7f07cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8922edaa84f955 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07cbfff700 1 -- 172.21.15.100:0/1309357413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00e070 con 0x7f07d40b63d0 2023-11-17T06:31:00.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07cbfff700 1 -- 172.21.15.100:0/1309357413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00b910 con 0x7f07d40b63d0 2023-11-17T06:31:00.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07cbfff700 1 -- 172.21.15.100:0/1309357413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00bcc0 con 0x7f07d40b63d0 2023-11-17T06:31:00.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 -- 172.21.15.100:0/1309357413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 msgr2=0x7f07d40b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 --2- 172.21.15.100:0/1309357413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d40b6800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f07d408c3f0 tx=0x7f07cc00b330 comp rx=0 tx=0).stop 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 -- 172.21.15.100:0/1309357413 shutdown_connections 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 --2- 172.21.15.100:0/1309357413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d40b6800 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 --2- 172.21.15.100:0/1309357413 >> v2:172.21.15.119:3300/0 conn(0x7f07d40cfa90 0x7f07d40cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 -- 172.21.15.100:0/1309357413 >> 172.21.15.100:0/1309357413 conn(0x7f07d406b370 msgr2=0x7f07d406b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 -- 172.21.15.100:0/1309357413 shutdown_connections 2023-11-17T06:31:00.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.442+0000 7f07db863700 1 -- 172.21.15.100:0/1309357413 wait complete. 2023-11-17T06:31:00.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.446+0000 7f07db863700 1 Processor -- start 2023-11-17T06:31:00.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.446+0000 7f07db863700 1 -- start start 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07d40cfa90 0x7f07d40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07d415d2c0 0x7f07d40ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41f2c50 con 0x7f07d40b63d0 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40b3060 con 0x7f07d40cfa90 2023-11-17T06:31:00.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40b3340 con 0x7f07d415d2c0 2023-11-17T06:31:00.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40890/0 (socket says 172.21.15.100:40890) 2023-11-17T06:31:00.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 -- 172.21.15.100:0/729813041 learned_addr learned my addr 172.21.15.100:0/729813041 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d8dfe700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07d40cfa90 0x7f07d40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d9e00700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07d415d2c0 0x7f07d40ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 -- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07d415d2c0 msgr2=0x7f07d40ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07d415d2c0 0x7f07d40ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 -- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07d40cfa90 msgr2=0x7f07d40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07d40cfa90 0x7f07d40b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 -- 172.21.15.100:0/729813041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc009b30 con 0x7f07d40b63d0 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07d95ff700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c410 tx=0x7f07d000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00052d0 con 0x7f07d40b63d0 2023-11-17T06:31:00.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0005430 con 0x7f07d40b63d0 2023-11-17T06:31:00.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d40b3620 con 0x7f07d40b63d0 2023-11-17T06:31:00.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00055a0 con 0x7f07d40b63d0 2023-11-17T06:31:00.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.450+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d40b1a20 con 0x7f07d40b63d0 2023-11-17T06:31:00.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.454+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d40b1bb0 con 0x7f07d40b63d0 2023-11-17T06:31:00.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.454+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f07d00036a0 con 0x7f07d40b63d0 2023-11-17T06:31:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.458+0000 7f07c9ffb700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 0x7f07b80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.458+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f07d0083370 con 0x7f07d40b63d0 2023-11-17T06:31:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.458+0000 7f07d8dfe700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 0x7f07b80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.458+0000 7f07d8dfe700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 0x7f07b80689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f07d40b5200 tx=0x7f07c4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.462+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07d0050930 con 0x7f07d40b63d0 2023-11-17T06:31:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:00.638+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07d4065e90 con 0x7f07d40b63d0 2023-11-17T06:31:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.230+0000 7f07c9ffb700 1 -- 172.21.15.100:0/729813041 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f07d00200d0 con 0x7f07d40b63d0 2023-11-17T06:31:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 msgr2=0x7f07b80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 0x7f07b80689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f07d40b5200 tx=0x7f07c4009240 comp rx=0 tx=0).stop 2023-11-17T06:31:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 msgr2=0x7f07d41f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c410 tx=0x7f07d000c720 comp rx=0 tx=0).stop 2023-11-17T06:31:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 shutdown_connections 2023-11-17T06:31:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07d415d2c0 0x7f07d40ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07d40cfa90 0x7f07d40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f07b8066510 0x7f07b80689d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 --2- 172.21.15.100:0/729813041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d40b63d0 0x7f07d41f2710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.238+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 >> 172.21.15.100:0/729813041 conn(0x7f07d406b370 msgr2=0x7f07d40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.246+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 shutdown_connections 2023-11-17T06:31:01.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.246+0000 7f07db863700 1 -- 172.21.15.100:0/729813041 wait complete. 2023-11-17T06:31:01.261 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2023-11-17T06:31:01.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-17T06:31:01.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 Processor -- start 2023-11-17T06:31:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 -- start start 2023-11-17T06:31:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06280cc5a0 0x7f06280c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06280ccaf0 0x7f06280ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0628165460 con 0x7f06280b0d00 2023-11-17T06:31:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06281660e0 con 0x7f06280ccaf0 2023-11-17T06:31:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.462+0000 7f063013c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0628165740 con 0x7f06280cc5a0 2023-11-17T06:31:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06280ccaf0 0x7f06280ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06280ccaf0 0x7f06280ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40894/0 (socket says 172.21.15.100:40894) 2023-11-17T06:31:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062ded8700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f06280b0d00 0x7f06280b10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50872/0 (socket says 172.21.15.100:50872) 2023-11-17T06:31:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 -- 172.21.15.100:0/648381777 learned_addr learned my addr 172.21.15.100:0/648381777 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062d6d7700 1 --2- 172.21.15.100:0/648381777 >> v2:172.21.15.119:3300/0 conn(0x7f06280cc5a0 0x7f06280c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 -- 172.21.15.100:0/648381777 >> v2:172.21.15.119:3300/0 conn(0x7f06280cc5a0 msgr2=0x7f06280c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 --2- 172.21.15.100:0/648381777 >> v2:172.21.15.119:3300/0 conn(0x7f06280cc5a0 0x7f06280c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 -- 172.21.15.100:0/648381777 >> v1:172.21.15.100:6789/0 conn(0x7f06280b0d00 legacy=0x7f06280b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 -- 172.21.15.100:0/648381777 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0628165a20 con 0x7f06280ccaf0 2023-11-17T06:31:01.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062e6d9700 1 --2- 172.21.15.100:0/648381777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280ccaf0 0x7f06280ccf80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f06280b1910 tx=0x7f062000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff150af380c8a3e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062ced6700 1 -- 172.21.15.100:0/648381777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000e070 con 0x7f06280ccaf0 2023-11-17T06:31:01.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062ced6700 1 -- 172.21.15.100:0/648381777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000b910 con 0x7f06280ccaf0 2023-11-17T06:31:01.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f062ced6700 1 -- 172.21.15.100:0/648381777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000bcc0 con 0x7f06280ccaf0 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 -- 172.21.15.100:0/648381777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280ccaf0 msgr2=0x7f06280ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 --2- 172.21.15.100:0/648381777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280ccaf0 0x7f06280ccf80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f06280b1910 tx=0x7f062000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 -- 172.21.15.100:0/648381777 shutdown_connections 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 --2- 172.21.15.100:0/648381777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280ccaf0 0x7f06280ccf80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 --2- 172.21.15.100:0/648381777 >> v2:172.21.15.119:3300/0 conn(0x7f06280cc5a0 0x7f06280c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.466+0000 7f063013c700 1 -- 172.21.15.100:0/648381777 >> 172.21.15.100:0/648381777 conn(0x7f062806a450 msgr2=0x7f062806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.470+0000 7f063013c700 1 -- 172.21.15.100:0/648381777 shutdown_connections 2023-11-17T06:31:01.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.470+0000 7f063013c700 1 -- 172.21.15.100:0/648381777 wait complete. 2023-11-17T06:31:01.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.470+0000 7f063013c700 1 Processor -- start 2023-11-17T06:31:01.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.470+0000 7f063013c700 1 -- start start 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06280b0d00 0x7f06280af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 0x7f06280b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06281626c0 con 0x7f06280cc5a0 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06281629a0 con 0x7f06280ccaf0 2023-11-17T06:31:01.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0628162c80 con 0x7f06280b0d00 2023-11-17T06:31:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40910/0 (socket says 172.21.15.100:40910) 2023-11-17T06:31:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 -- 172.21.15.100:0/2012189331 learned_addr learned my addr 172.21.15.100:0/2012189331 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062ded8700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06280b0d00 0x7f06280af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062e6d9700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 0x7f06280b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 -- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06280b0d00 msgr2=0x7f06280af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06280b0d00 0x7f06280af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 -- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 msgr2=0x7f06280b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 0x7f06280b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 -- 172.21.15.100:0/2012189331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009b30 con 0x7f06280cc5a0 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062e6d9700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 0x7f06280b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f062d6d7700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f061800e9d0 tx=0x7f061800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618009720 con 0x7f06280cc5a0 2023-11-17T06:31:01.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800c850 con 0x7f06280cc5a0 2023-11-17T06:31:01.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800cbc0 con 0x7f06280cc5a0 2023-11-17T06:31:01.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628162f60 con 0x7f06280cc5a0 2023-11-17T06:31:01.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.474+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0628162190 con 0x7f06280cc5a0 2023-11-17T06:31:01.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.478+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0628162410 con 0x7f06280cc5a0 2023-11-17T06:31:01.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.478+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f061800cd20 con 0x7f06280cc5a0 2023-11-17T06:31:01.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.478+0000 7f061e7fc700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 0x7f060c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.478+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0618083f10 con 0x7f06280cc5a0 2023-11-17T06:31:01.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.482+0000 7f062ded8700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 0x7f060c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.482+0000 7f062ded8700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 0x7f060c0689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.486+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0618051350 con 0x7f06280cc5a0 2023-11-17T06:31:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:01.694+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f062804eea0 con 0x7f06280cc5a0 2023-11-17T06:31:02.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.266+0000 7f061e7fc700 1 -- 172.21.15.100:0/2012189331 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0618054970 con 0x7f06280cc5a0 2023-11-17T06:31:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.274+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 msgr2=0x7f060c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.274+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 0x7f060c0689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624007ef0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.274+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 msgr2=0x7f06280afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.274+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f061800e9d0 tx=0x7f061800ece0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 shutdown_connections 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06280ccaf0 0x7f06280b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f060c066510 0x7f060c0689d0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624007ef0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06280cc5a0 0x7f06280afcd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 --2- 172.21.15.100:0/2012189331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06280b0d00 0x7f06280af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.278+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 >> 172.21.15.100:0/2012189331 conn(0x7f062806a450 msgr2=0x7f062806a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.282+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 shutdown_connections 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.282+0000 7f063013c700 1 -- 172.21.15.100:0/2012189331 wait complete. 2023-11-17T06:31:02.293 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 4 and data pool 5 2023-11-17T06:31:02.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:02.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.474+0000 7f161ec9d700 1 Processor -- start 2023-11-17T06:31:02.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 -- start start 2023-11-17T06:31:02.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16180ca680 0x7f16180c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180cd570 con 0x7f16180c4060 2023-11-17T06:31:02.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161806cf30 con 0x7f16180ca680 2023-11-17T06:31:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161ec9d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161806c3f0 con 0x7f16180cc880 2023-11-17T06:31:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161d49a700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f16180c4060 0x7f16180c44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58024/0 (socket says 172.21.15.100:58024) 2023-11-17T06:31:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161d49a700 1 -- 172.21.15.100:0/3414047367 learned_addr learned my addr 172.21.15.100:0/3414047367 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161dc9b700 1 --2- 172.21.15.100:0/3414047367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161e49c700 1 --2- 172.21.15.100:0/3414047367 >> v2:172.21.15.119:3300/0 conn(0x7f16180ca680 0x7f16180c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161cc99700 1 -- 172.21.15.100:0/3414047367 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808312162 0 0) 0x7f16180cd570 con 0x7f16180c4060 2023-11-17T06:31:02.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161cc99700 1 -- 172.21.15.100:0/3414047367 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16040035d0 con 0x7f16180c4060 2023-11-17T06:31:02.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161dc9b700 1 -- 172.21.15.100:0/3414047367 >> v2:172.21.15.119:3300/0 conn(0x7f16180ca680 msgr2=0x7f16180c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161dc9b700 1 --2- 172.21.15.100:0/3414047367 >> v2:172.21.15.119:3300/0 conn(0x7f16180ca680 0x7f16180c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161dc9b700 1 -- 172.21.15.100:0/3414047367 >> v1:172.21.15.100:6789/0 conn(0x7f16180c4060 legacy=0x7f16180c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.478+0000 7f161dc9b700 1 -- 172.21.15.100:0/3414047367 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180cd1a0 con 0x7f16180cc880 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161dc9b700 1 --2- 172.21.15.100:0/3414047367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180ccc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1614009850 tx=0x7f1614009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ddf4c40e87ee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161cc99700 1 -- 172.21.15.100:0/3414047367 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011830 con 0x7f16180cc880 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161cc99700 1 -- 172.21.15.100:0/3414047367 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011990 con 0x7f16180cc880 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161cc99700 1 -- 172.21.15.100:0/3414047367 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011d40 con 0x7f16180cc880 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 -- 172.21.15.100:0/3414047367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 msgr2=0x7f16180ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 --2- 172.21.15.100:0/3414047367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180ccc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1614009850 tx=0x7f1614009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 -- 172.21.15.100:0/3414047367 shutdown_connections 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 --2- 172.21.15.100:0/3414047367 >> v2:172.21.15.119:3300/0 conn(0x7f16180ca680 0x7f16180c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 --2- 172.21.15.100:0/3414047367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180ccc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 -- 172.21.15.100:0/3414047367 >> 172.21.15.100:0/3414047367 conn(0x7f16180cb730 msgr2=0x7f16180cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 -- 172.21.15.100:0/3414047367 shutdown_connections 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.482+0000 7f161ec9d700 1 -- 172.21.15.100:0/3414047367 wait complete. 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 Processor -- start 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 -- start start 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ca680 0x7f16180b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b32b0 con 0x7f16180c4060 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618070220 con 0x7f16180ca680 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161ec9d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b2a10 con 0x7f16180cc880 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40842/0 (socket says 172.21.15.100:40842) 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 -- 172.21.15.100:0/997127957 learned_addr learned my addr 172.21.15.100:0/997127957 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161d49a700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ca680 0x7f16180b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161e49c700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 -- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 msgr2=0x7f16180b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 -- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ca680 msgr2=0x7f16180b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ca680 0x7f16180b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.486+0000 7f161dc9b700 1 -- 172.21.15.100:0/997127957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140094b0 con 0x7f16180c4060 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f161dc9b700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c00 tx=0x7f1614004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161401a910 con 0x7f16180c4060 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161401f070 con 0x7f16180c4060 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16180b2cf0 con 0x7f16180c4060 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161401ac90 con 0x7f16180c4060 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181464a0 con 0x7f16180c4060 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.490+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16180cdde0 con 0x7f16180c4060 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.494+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f161401b430 con 0x7f16180c4060 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.494+0000 7f160e7fc700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 0x7f15fc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.494+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1614084e10 con 0x7f16180c4060 2023-11-17T06:31:02.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.494+0000 7f161d49a700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 0x7f15fc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.494+0000 7f161d49a700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 0x7f15fc068a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16180c5b70 tx=0x7f1608007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.498+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1614052320 con 0x7f16180c4060 2023-11-17T06:31:02.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.674+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f161806fff0 con 0x7f16180c4060 2023-11-17T06:31:02.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.674+0000 7f160e7fc700 1 -- 172.21.15.100:0/997127957 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f161806fff0 con 0x7f16180c4060 2023-11-17T06:31:02.680 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:02.681 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:01.701466+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 msgr2=0x7f15fc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 0x7f15fc068a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16180c5b70 tx=0x7f1608007de0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 msgr2=0x7f1618145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c00 tx=0x7f1614004770 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 shutdown_connections 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16180cc880 0x7f16180b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ca680 0x7f16180b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15fc066540 0x7f15fc068a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 --2- 172.21.15.100:0/997127957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16180c4060 0x7f1618145f60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 >> 172.21.15.100:0/997127957 conn(0x7f16180cb730 msgr2=0x7f1618147d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 shutdown_connections 2023-11-17T06:31:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.678+0000 7f161ec9d700 1 -- 172.21.15.100:0/997127957 wait complete. 2023-11-17T06:31:02.705 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 Processor -- start 2023-11-17T06:31:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 -- start start 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c0144ac0 0x7f58c006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58c00cde70 0x7f58c00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c006d160 con 0x7f58c00c9840 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c006da00 con 0x7f58c00cde70 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58c56b6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c006cf70 con 0x7f58c0144ac0 2023-11-17T06:31:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58c00cde70 0x7f58c00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58c00cde70 0x7f58c00c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40848/0 (socket says 172.21.15.100:40848) 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 -- 172.21.15.100:0/813177461 learned_addr learned my addr 172.21.15.100:0/813177461 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bffff700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c0144ac0 0x7f58c006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 -- 172.21.15.100:0/813177461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c0144ac0 msgr2=0x7f58c006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c0144ac0 0x7f58c006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 -- 172.21.15.100:0/813177461 >> v1:172.21.15.119:6789/0 conn(0x7f58c00c9840 legacy=0x7f58c00ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.874+0000 7f58bf7fe700 1 -- 172.21.15.100:0/813177461 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c006d440 con 0x7f58c00cde70 2023-11-17T06:31:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58bf7fe700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00cde70 0x7f58c00c9300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009910 tx=0x7f58b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd9f20b1bdcf0af server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58beffd700 1 -- 172.21.15.100:0/813177461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011830 con 0x7f58c00cde70 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58beffd700 1 -- 172.21.15.100:0/813177461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4011990 con 0x7f58c00cde70 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58beffd700 1 -- 172.21.15.100:0/813177461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011d40 con 0x7f58c00cde70 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 -- 172.21.15.100:0/813177461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00cde70 msgr2=0x7f58c00c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00cde70 0x7f58c00c9300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009910 tx=0x7f58b4009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 -- 172.21.15.100:0/813177461 shutdown_connections 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00cde70 0x7f58c00c9300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 --2- 172.21.15.100:0/813177461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c0144ac0 0x7f58c006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 -- 172.21.15.100:0/813177461 >> 172.21.15.100:0/813177461 conn(0x7f58c00cb730 msgr2=0x7f58c00cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 -- 172.21.15.100:0/813177461 shutdown_connections 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.878+0000 7f58c56b6700 1 -- 172.21.15.100:0/813177461 wait complete. 2023-11-17T06:31:02.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.882+0000 7f58c56b6700 1 Processor -- start 2023-11-17T06:31:02.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.882+0000 7f58c56b6700 1 -- start start 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c00c9840 0x7f58c01e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 0x7f58c00c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c013fe40 con 0x7f58c0144ac0 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00c5520 con 0x7f58c00cde70 2023-11-17T06:31:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00b0040 con 0x7f58c00c9840 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40850/0 (socket says 172.21.15.100:40850) 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 -- 172.21.15.100:0/2455891751 learned_addr learned my addr 172.21.15.100:0/2455891751 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bffff700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c00c9840 0x7f58c01e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bf7fe700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 0x7f58c00c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 -- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c00c9840 msgr2=0x7f58c01e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c00c9840 0x7f58c01e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 -- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 msgr2=0x7f58c00c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 0x7f58c00c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 -- 172.21.15.100:0/2455891751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009570 con 0x7f58c0144ac0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bf7fe700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 0x7f58c00c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c4eb5700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c480 tx=0x7f58b800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80052d0 con 0x7f58c0144ac0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8005430 con 0x7f58c0144ac0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c00b0320 con 0x7f58c0144ac0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80055a0 con 0x7f58c0144ac0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c00c4f80 con 0x7f58c0144ac0 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.886+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c01e2740 con 0x7f58c0144ac0 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.890+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58b80038e0 con 0x7f58c0144ac0 2023-11-17T06:31:02.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.890+0000 7f58bcff9700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 0x7f58ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.890+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b80832d0 con 0x7f58c0144ac0 2023-11-17T06:31:02.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.890+0000 7f58bffff700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 0x7f58ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.890+0000 7f58bffff700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 0x7f58ac068a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58b0011340 tx=0x7f58b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:02.898+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58c01e2740 con 0x7f58c0144ac0 2023-11-17T06:31:03.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.070+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58c01e2740 con 0x7f58c0144ac0 2023-11-17T06:31:03.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.074+0000 7f58bcff9700 1 -- 172.21.15.100:0/2455891751 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f58c01e2740 con 0x7f58c0144ac0 2023-11-17T06:31:03.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:03.079 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:01.701466+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.074+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 msgr2=0x7f58ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 0x7f58ac068a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58b0011340 tx=0x7f58b000b040 comp rx=0 tx=0).stop 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 msgr2=0x7f58c013f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c480 tx=0x7f58b800c790 comp rx=0 tx=0).stop 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 shutdown_connections 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58ac066540 0x7f58ac068a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c0144ac0 0x7f58c013f4b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58c00cde70 0x7f58c00c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 --2- 172.21.15.100:0/2455891751 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58c00c9840 0x7f58c01e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 >> 172.21.15.100:0/2455891751 conn(0x7f58c00cb730 msgr2=0x7f58c01434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 shutdown_connections 2023-11-17T06:31:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.078+0000 7f58c56b6700 1 -- 172.21.15.100:0/2455891751 wait complete. 2023-11-17T06:31:03.102 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-17T06:31:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 Processor -- start 2023-11-17T06:31:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 -- start start 2023-11-17T06:31:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f21b00cd8b0 0x7f21b0161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21b015d2b0 0x7f21b01616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b0160ce0 con 0x7f21b015ced0 2023-11-17T06:31:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00cdd40 con 0x7f21b015d2b0 2023-11-17T06:31:03.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b6fe6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00ce020 con 0x7f21b00cd8b0 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b67e5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21b015d2b0 0x7f21b01616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b57e3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f21b00cd8b0 0x7f21b0161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b67e5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21b015d2b0 0x7f21b01616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40860/0 (socket says 172.21.15.100:40860) 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.278+0000 7f21b67e5700 1 -- 172.21.15.100:0/2592568240 learned_addr learned my addr 172.21.15.100:0/2592568240 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b67e5700 1 -- 172.21.15.100:0/2592568240 >> v2:172.21.15.119:3300/0 conn(0x7f21b00cd8b0 msgr2=0x7f21b0161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b67e5700 1 --2- 172.21.15.100:0/2592568240 >> v2:172.21.15.119:3300/0 conn(0x7f21b00cd8b0 0x7f21b0161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b67e5700 1 -- 172.21.15.100:0/2592568240 >> v1:172.21.15.119:6789/0 conn(0x7f21b015ced0 legacy=0x7f21b00d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b67e5700 1 -- 172.21.15.100:0/2592568240 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00ce300 con 0x7f21b015d2b0 2023-11-17T06:31:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b67e5700 1 --2- 172.21.15.100:0/2592568240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b01616b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21b008c320 tx=0x7f21a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49b67561acf96e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b4fe2700 1 -- 172.21.15.100:0/2592568240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800e070 con 0x7f21b015d2b0 2023-11-17T06:31:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b4fe2700 1 -- 172.21.15.100:0/2592568240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800b910 con 0x7f21b015d2b0 2023-11-17T06:31:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b4fe2700 1 -- 172.21.15.100:0/2592568240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800bcc0 con 0x7f21b015d2b0 2023-11-17T06:31:03.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 -- 172.21.15.100:0/2592568240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 msgr2=0x7f21b01616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/2592568240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b01616b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21b008c320 tx=0x7f21a800b330 comp rx=0 tx=0).stop 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 -- 172.21.15.100:0/2592568240 shutdown_connections 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/2592568240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b01616b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/2592568240 >> v2:172.21.15.119:3300/0 conn(0x7f21b00cd8b0 0x7f21b0161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 -- 172.21.15.100:0/2592568240 >> 172.21.15.100:0/2592568240 conn(0x7f21b006b370 msgr2=0x7f21b006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 -- 172.21.15.100:0/2592568240 shutdown_connections 2023-11-17T06:31:03.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.282+0000 7f21b6fe6700 1 -- 172.21.15.100:0/2592568240 wait complete. 2023-11-17T06:31:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 Processor -- start 2023-11-17T06:31:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 -- start start 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21b015ced0 0x7f21b00b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21b00c9be0 0x7f21b01572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01f24b0 con 0x7f21b015d2b0 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01f3460 con 0x7f21b015ced0 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b6fe6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b32e0 con 0x7f21b00c9be0 2023-11-17T06:31:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b57e3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b57e3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40874/0 (socket says 172.21.15.100:40874) 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b57e3700 1 -- 172.21.15.100:0/66559684 learned_addr learned my addr 172.21.15.100:0/66559684 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b67e5700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21b00c9be0 0x7f21b01572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.286+0000 7f21b5fe4700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21b015ced0 0x7f21b00b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 -- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21b00c9be0 msgr2=0x7f21b01572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21b00c9be0 0x7f21b01572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 -- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21b015ced0 msgr2=0x7f21b00b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21b015ced0 0x7f21b00b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 -- 172.21.15.100:0/66559684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009b30 con 0x7f21b015d2b0 2023-11-17T06:31:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b57e3700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21a000e870 tx=0x7f21a000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00095a0 con 0x7f21b015d2b0 2023-11-17T06:31:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0013680 con 0x7f21b015d2b0 2023-11-17T06:31:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00139f0 con 0x7f21b015d2b0 2023-11-17T06:31:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b00cb2c0 con 0x7f21b015d2b0 2023-11-17T06:31:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b01f2980 con 0x7f21b015d2b0 2023-11-17T06:31:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b00b9060 con 0x7f21b015d2b0 2023-11-17T06:31:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.294+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f21a0013b50 con 0x7f21b015d2b0 2023-11-17T06:31:03.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.294+0000 7f21a67fc700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 0x7f2194068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.294+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21a0083ca0 con 0x7f21b015d2b0 2023-11-17T06:31:03.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.294+0000 7f21b5fe4700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 0x7f2194068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.294+0000 7f21b5fe4700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 0x7f2194068a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21ac000f60 tx=0x7f21ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.302+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f21a0051120 con 0x7f21b015d2b0 2023-11-17T06:31:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:03.510+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21b00b20b0 con 0x7f21b015d2b0 2023-11-17T06:31:04.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.286+0000 7f21a67fc700 1 -- 172.21.15.100:0/66559684 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f21a0054740 con 0x7f21b015d2b0 2023-11-17T06:31:06.528 INFO:tasks.ceph.mds.b.smithi119.stderr:2023-11-17T06:31:06.206+0000 7f99a1fa0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 msgr2=0x7f2194068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 0x7f2194068a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21ac000f60 tx=0x7f21ac009040 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 msgr2=0x7f21b015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21a000e870 tx=0x7f21a000eb80 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 shutdown_connections 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21b00c9be0 0x7f21b01572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2194066540 0x7f2194068a00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21b015d2b0 0x7f21b015f1f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 --2- 172.21.15.100:0/66559684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21b015ced0 0x7f21b00b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 >> 172.21.15.100:0/66559684 conn(0x7f21b006b370 msgr2=0x7f21b015c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 shutdown_connections 2023-11-17T06:31:06.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:04.290+0000 7f21b6fe6700 1 -- 172.21.15.100:0/66559684 wait complete. 2023-11-17T06:31:06.531 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-17T06:31:06.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-17T06:31:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.710+0000 7f09e355d700 1 Processor -- start 2023-11-17T06:31:06.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.710+0000 7f09e355d700 1 -- start start 2023-11-17T06:31:06.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09dc0cf7e0 0x7f09dc0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc0c9810 con 0x7f09dc0c2390 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0cd980 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0cd3c0 con 0x7f09dc161590 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09dc0cf7e0 0x7f09dc0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09dc0cf7e0 0x7f09dc0cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40884/0 (socket says 172.21.15.100:40884) 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 -- 172.21.15.100:0/3430268962 learned_addr learned my addr 172.21.15.100:0/3430268962 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:06.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e255b700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 -- 172.21.15.100:0/3430268962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 msgr2=0x7f09dc0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 -- 172.21.15.100:0/3430268962 >> v1:172.21.15.119:6789/0 conn(0x7f09dc0c2390 legacy=0x7f09dc0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 -- 172.21.15.100:0/3430268962 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0cd6a0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e2d5c700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc0cb100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f84029d49800e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e1559700 1 -- 172.21.15.100:0/3430268962 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400e070 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e1559700 1 -- 172.21.15.100:0/3430268962 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400b9c0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e1559700 1 -- 172.21.15.100:0/3430268962 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400bd70 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 -- 172.21.15.100:0/3430268962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 msgr2=0x7f09dc0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.714+0000 7f09e355d700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc0cb100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 -- 172.21.15.100:0/3430268962 shutdown_connections 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc0cb100 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 --2- 172.21.15.100:0/3430268962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 -- 172.21.15.100:0/3430268962 >> 172.21.15.100:0/3430268962 conn(0x7f09dc06a690 msgr2=0x7f09dc06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 -- 172.21.15.100:0/3430268962 shutdown_connections 2023-11-17T06:31:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 -- 172.21.15.100:0/3430268962 wait complete. 2023-11-17T06:31:06.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 Processor -- start 2023-11-17T06:31:06.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.718+0000 7f09e355d700 1 -- start start 2023-11-17T06:31:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09dc0c2390 0x7f09dc15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15e5a0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15d990 con 0x7f09dc0c2390 2023-11-17T06:31:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e355d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15dc70 con 0x7f09dc161590 2023-11-17T06:31:06.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40900/0 (socket says 172.21.15.100:40900) 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 -- 172.21.15.100:0/3584488822 learned_addr learned my addr 172.21.15.100:0/3584488822 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e255b700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09dc0c2390 0x7f09dc15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e2d5c700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 -- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 msgr2=0x7f09dc071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 -- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09dc0c2390 msgr2=0x7f09dc15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09dc0c2390 0x7f09dc15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 -- 172.21.15.100:0/3584488822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009b30 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09e1d5a700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c4d0 tx=0x7f09cc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0052d0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.722+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc005430 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.726+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0055a0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.726+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc15df50 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.726+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc15f440 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.726+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc067e10 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.726+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f09cc0038c0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.730+0000 7f09d2ffd700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 0x7f09c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.730+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09cc0831f0 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.730+0000 7f09e255b700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 0x7f09c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.730+0000 7f09e255b700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 0x7f09c00689d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09d8007a60 tx=0x7f09d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.734+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09cc050670 con 0x7f09dc0cf7e0 2023-11-17T06:31:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:06.950+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09dc15f5d0 con 0x7f09dc0cf7e0 2023-11-17T06:31:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.298+0000 7f09d2ffd700 1 -- 172.21.15.100:0/3584488822 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09cc053c90 con 0x7f09dc0cf7e0 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 msgr2=0x7f09c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 0x7f09c00689d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09d8007a60 tx=0x7f09d8008040 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 msgr2=0x7f09dc15cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c4d0 tx=0x7f09cc00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 shutdown_connections 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09dc161590 0x7f09dc071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f09c0066510 0x7f09c00689d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09dc0cf7e0 0x7f09dc15cfb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 --2- 172.21.15.100:0/3584488822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09dc0c2390 0x7f09dc15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 >> 172.21.15.100:0/3584488822 conn(0x7f09dc06a690 msgr2=0x7f09dc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 shutdown_connections 2023-11-17T06:31:07.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.302+0000 7f09e355d700 1 -- 172.21.15.100:0/3584488822 wait complete. 2023-11-17T06:31:07.333 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-17T06:31:07.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 Processor -- start 2023-11-17T06:31:07.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 -- start start 2023-11-17T06:31:07.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 0x7f71700ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71700c4060 0x7f71700c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71700cd570 con 0x7f71700c4a00 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717006cf30 con 0x7f71700c4060 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f717662d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717006c3f0 con 0x7f71700cc880 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f7174e2a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71700c4060 0x7f71700c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f7174e2a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71700c4060 0x7f71700c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40912/0 (socket says 172.21.15.100:40912) 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.502+0000 7f7174e2a700 1 -- 172.21.15.100:0/3515865385 learned_addr learned my addr 172.21.15.100:0/3515865385 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:07.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7174e2a700 1 -- 172.21.15.100:0/3515865385 >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 msgr2=0x7f71700ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717562b700 1 --2- 172.21.15.100:0/3515865385 >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 0x7f71700ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7174e2a700 1 --2- 172.21.15.100:0/3515865385 >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 0x7f71700ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7174e2a700 1 -- 172.21.15.100:0/3515865385 >> v1:172.21.15.119:6789/0 conn(0x7f71700c4a00 legacy=0x7f71700c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7174e2a700 1 -- 172.21.15.100:0/3515865385 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700cd1a0 con 0x7f71700c4060 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717562b700 1 --2- 172.21.15.100:0/3515865385 >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 0x7f71700ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7174e2a700 1 --2- 172.21.15.100:0/3515865385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71700c44c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71700ae820 tx=0x7f7160009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1627e89e5392b1b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7167fff700 1 -- 172.21.15.100:0/3515865385 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160004230 con 0x7f71700c4060 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7167fff700 1 -- 172.21.15.100:0/3515865385 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7160004390 con 0x7f71700c4060 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f7167fff700 1 -- 172.21.15.100:0/3515865385 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600036c0 con 0x7f71700c4060 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 -- 172.21.15.100:0/3515865385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 msgr2=0x7f71700c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 --2- 172.21.15.100:0/3515865385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71700c44c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71700ae820 tx=0x7f7160009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 -- 172.21.15.100:0/3515865385 shutdown_connections 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 --2- 172.21.15.100:0/3515865385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71700c44c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 --2- 172.21.15.100:0/3515865385 >> v2:172.21.15.119:3300/0 conn(0x7f71700cc880 0x7f71700ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 -- 172.21.15.100:0/3515865385 >> 172.21.15.100:0/3515865385 conn(0x7f71700cb730 msgr2=0x7f71700cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 -- 172.21.15.100:0/3515865385 shutdown_connections 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.506+0000 7f717662d700 1 -- 172.21.15.100:0/3515865385 wait complete. 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 Processor -- start 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 -- start start 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71700c4a00 0x7f7170160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71700cc880 0x7f7170071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f82f0 con 0x7f71700c4060 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f7980 con 0x7f71700cc880 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717662d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f7c60 con 0x7f71700c4a00 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40922/0 (socket says 172.21.15.100:40922) 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 -- 172.21.15.100:0/3636140177 learned_addr learned my addr 172.21.15.100:0/3636140177 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f7174e2a700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71700c4a00 0x7f7170160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f7175e2c700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71700cc880 0x7f7170071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 -- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71700c4a00 msgr2=0x7f7170160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71700c4a00 0x7f7170160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 -- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71700cc880 msgr2=0x7f7170071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71700cc880 0x7f7170071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 -- 172.21.15.100:0/3636140177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009570 con 0x7f71700c4060 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.510+0000 7f717562b700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c770 tx=0x7f716c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011800 con 0x7f71700c4060 2023-11-17T06:31:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011960 con 0x7f71700c4060 2023-11-17T06:31:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71701f7f40 con 0x7f71700c4060 2023-11-17T06:31:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011d10 con 0x7f71700c4060 2023-11-17T06:31:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71701f7670 con 0x7f71700c4060 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.514+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71700cdde0 con 0x7f71700c4060 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.518+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f716c018360 con 0x7f71700c4060 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.518+0000 7f7165ffb700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 0x7f71540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.518+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716c083ca0 con 0x7f71700c4060 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.518+0000 7f7174e2a700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 0x7f71540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.518+0000 7f7174e2a700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 0x7f71540689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f71700ae820 tx=0x7f7160008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.522+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f716c0511b0 con 0x7f71700c4060 2023-11-17T06:31:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.730+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f717006d6b0 con 0x7f71700c4060 2023-11-17T06:31:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.734+0000 7f7165ffb700 1 -- 172.21.15.100:0/3636140177 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f717006d6b0 con 0x7f71700c4060 2023-11-17T06:31:07.738 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:07.739 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:06.955546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/1192926084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":1192926084},{"type":"v1","addr":"172.21.15.119:6835","nonce":1192926084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 msgr2=0x7f71540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 0x7f71540689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f71700ae820 tx=0x7f7160008030 comp rx=0 tx=0).stop 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 msgr2=0x7f71701f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c770 tx=0x7f716c00ca80 comp rx=0 tx=0).stop 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 shutdown_connections 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71700cc880 0x7f7170071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71700c4a00 0x7f7170160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7154066510 0x7f71540689d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 --2- 172.21.15.100:0/3636140177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700c4060 0x7f71701f7130 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 >> 172.21.15.100:0/3636140177 conn(0x7f71700cb730 msgr2=0x7f7170148080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 shutdown_connections 2023-11-17T06:31:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.738+0000 7f717662d700 1 -- 172.21.15.100:0/3636140177 wait complete. 2023-11-17T06:31:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2023-11-17T06:31:07.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:07.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 Processor -- start 2023-11-17T06:31:07.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 -- start start 2023-11-17T06:31:07.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27a40cb3c0 0x7f27a40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a4070ad0 con 0x7f27a415b0a0 2023-11-17T06:31:07.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a40cb7a0 con 0x7f27a40b1150 2023-11-17T06:31:07.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.938+0000 7f27aa039700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a4071f20 con 0x7f27a40cb3c0 2023-11-17T06:31:07.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a37fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f27a415b0a0 0x7f27a40b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58028/0 (socket says 172.21.15.100:58028) 2023-11-17T06:31:07.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a37fe700 1 -- 172.21.15.100:0/83041118 learned_addr learned my addr 172.21.15.100:0/83041118 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:07.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a3fff700 1 --2- 172.21.15.100:0/83041118 >> v2:172.21.15.100:3300/0 conn(0x7f27a40cb3c0 0x7f27a40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a3fff700 1 -- 172.21.15.100:0/83041118 >> v1:172.21.15.119:6789/0 conn(0x7f27a40b1150 legacy=0x7f27a415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:07.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a3fff700 1 -- 172.21.15.100:0/83041118 >> v1:172.21.15.100:6789/0 conn(0x7f27a415b0a0 legacy=0x7f27a40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a3fff700 1 -- 172.21.15.100:0/83041118 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a40721a0 con 0x7f27a40cb3c0 2023-11-17T06:31:07.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a3fff700 1 --2- 172.21.15.100:0/83041118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40cb3c0 0x7f27a40cf8a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f279c009850 tx=0x7f279c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d9440f12a4c73b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a2ffd700 1 -- 172.21.15.100:0/83041118 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c011830 con 0x7f27a40cb3c0 2023-11-17T06:31:07.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a2ffd700 1 -- 172.21.15.100:0/83041118 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c011990 con 0x7f27a40cb3c0 2023-11-17T06:31:07.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27a2ffd700 1 -- 172.21.15.100:0/83041118 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c011d20 con 0x7f27a40cb3c0 2023-11-17T06:31:07.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 -- 172.21.15.100:0/83041118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40cb3c0 msgr2=0x7f27a40cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 --2- 172.21.15.100:0/83041118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40cb3c0 0x7f27a40cf8a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f279c009850 tx=0x7f279c009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:07.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 -- 172.21.15.100:0/83041118 shutdown_connections 2023-11-17T06:31:07.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 --2- 172.21.15.100:0/83041118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40cb3c0 0x7f27a40cf8a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 -- 172.21.15.100:0/83041118 >> 172.21.15.100:0/83041118 conn(0x7f27a406a270 msgr2=0x7f27a406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 -- 172.21.15.100:0/83041118 shutdown_connections 2023-11-17T06:31:07.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.942+0000 7f27aa039700 1 -- 172.21.15.100:0/83041118 wait complete. 2023-11-17T06:31:07.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.946+0000 7f27aa039700 1 Processor -- start 2023-11-17T06:31:07.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.946+0000 7f27aa039700 1 -- start start 2023-11-17T06:31:07.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27a40cb3c0 0x7f27a415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 0x7f27a4151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a414fe30 con 0x7f27a40b1150 2023-11-17T06:31:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40c3b70 con 0x7f27a415b0a0 2023-11-17T06:31:07.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40c3e50 con 0x7f27a40cb3c0 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40942/0 (socket says 172.21.15.100:40942) 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 -- 172.21.15.100:0/2074942624 learned_addr learned my addr 172.21.15.100:0/2074942624 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a3fff700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 0x7f27a4151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f279affd700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27a40cb3c0 0x7f27a415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 -- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27a40cb3c0 msgr2=0x7f27a415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27a40cb3c0 0x7f27a415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 -- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 msgr2=0x7f27a4151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 0x7f27a4151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 -- 172.21.15.100:0/2074942624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0094b0 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a3fff700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 0x7f27a4151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a37fe700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2794001eb0 tx=0x7f279400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794005d90 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27940070d0 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a415ccb0 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794007440 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.950+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a40c4130 con 0x7f27a40b1150 2023-11-17T06:31:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.954+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a415d1d0 con 0x7f27a40b1150 2023-11-17T06:31:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.954+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27940075a0 con 0x7f27a40b1150 2023-11-17T06:31:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.958+0000 7f27a0ff9700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 0x7f27840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.958+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2794083110 con 0x7f27a40b1150 2023-11-17T06:31:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.958+0000 7f279affd700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 0x7f27840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.958+0000 7f279affd700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 0x7f27840689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27a415c820 tx=0x7f278c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:07.962+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27a415d1d0 con 0x7f27a40b1150 2023-11-17T06:31:08.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.138+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27a415d1d0 con 0x7f27a40b1150 2023-11-17T06:31:08.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.142+0000 7f27a0ff9700 1 -- 172.21.15.100:0/2074942624 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f27940505a0 con 0x7f27a40b1150 2023-11-17T06:31:08.148 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:08.148 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:03.255881+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:08.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 msgr2=0x7f27840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 0x7f27840689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27a415c820 tx=0x7f278c009040 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 msgr2=0x7f27a414f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2794001eb0 tx=0x7f279400c7b0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 shutdown_connections 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27a415b0a0 0x7f27a4151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27a40cb3c0 0x7f27a415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2784066510 0x7f27840689d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 --2- 172.21.15.100:0/2074942624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27a40b1150 0x7f27a414f8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 >> 172.21.15.100:0/2074942624 conn(0x7f27a406a270 msgr2=0x7f27a40ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 shutdown_connections 2023-11-17T06:31:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.146+0000 7f27aa039700 1 -- 172.21.15.100:0/2074942624 wait complete. 2023-11-17T06:31:08.174 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-17T06:31:08.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:31:08.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.338+0000 7f51557dc700 1 Processor -- start 2023-11-17T06:31:08.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.338+0000 7f51557dc700 1 -- start start 2023-11-17T06:31:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f51557dc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51500c9f00 0x7f515015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f51557dc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51500cee90 0x7f51500cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f51557dc700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500ce450 con 0x7f5150071bf0 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f51557dc700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500cc330 con 0x7f51500cee90 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f51557dc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500ca2e0 con 0x7f51500c9f00 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51500cee90 0x7f51500cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514effd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51500c9f00 0x7f515015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f5147fff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5150071bf0 0x7f51500b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:41940/0 (socket says 172.21.15.100:41940) 2023-11-17T06:31:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f5147fff700 1 -- 172.21.15.100:0/1162747049 learned_addr learned my addr 172.21.15.100:0/1162747049 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514effd700 1 -- 172.21.15.100:0/1162747049 >> v2:172.21.15.100:3300/0 conn(0x7f51500cee90 msgr2=0x7f51500cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514effd700 1 --2- 172.21.15.100:0/1162747049 >> v2:172.21.15.100:3300/0 conn(0x7f51500cee90 0x7f51500cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514effd700 1 -- 172.21.15.100:0/1162747049 >> v1:172.21.15.119:6789/0 conn(0x7f5150071bf0 legacy=0x7f51500b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514e7fc700 1 -- 172.21.15.100:0/1162747049 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805664879 0 0) 0x7f51500ce450 con 0x7f5150071bf0 2023-11-17T06:31:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.342+0000 7f514effd700 1 -- 172.21.15.100:0/1162747049 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150072600 con 0x7f51500c9f00 2023-11-17T06:31:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f514effd700 1 --2- 172.21.15.100:0/1162747049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500c9f00 0x7f515015a900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51500b1a50 tx=0x7f5140009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60e012fcaaaafcf server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f514e7fc700 1 -- 172.21.15.100:0/1162747049 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011830 con 0x7f51500c9f00 2023-11-17T06:31:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f514e7fc700 1 -- 172.21.15.100:0/1162747049 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140011990 con 0x7f51500c9f00 2023-11-17T06:31:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f514e7fc700 1 -- 172.21.15.100:0/1162747049 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011d20 con 0x7f51500c9f00 2023-11-17T06:31:08.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 -- 172.21.15.100:0/1162747049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500c9f00 msgr2=0x7f515015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 --2- 172.21.15.100:0/1162747049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500c9f00 0x7f515015a900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51500b1a50 tx=0x7f5140009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:08.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 -- 172.21.15.100:0/1162747049 shutdown_connections 2023-11-17T06:31:08.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 --2- 172.21.15.100:0/1162747049 >> v2:172.21.15.100:3300/0 conn(0x7f51500cee90 0x7f51500cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 --2- 172.21.15.100:0/1162747049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500c9f00 0x7f515015a900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 -- 172.21.15.100:0/1162747049 >> 172.21.15.100:0/1162747049 conn(0x7f515006a270 msgr2=0x7f515006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 -- 172.21.15.100:0/1162747049 shutdown_connections 2023-11-17T06:31:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.346+0000 7f51557dc700 1 -- 172.21.15.100:0/1162747049 wait complete. 2023-11-17T06:31:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 Processor -- start 2023-11-17T06:31:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 -- start start 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5150071bf0 0x7f51500ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 0x7f515014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51501e31f0 con 0x7f51500c9f00 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ae550 con 0x7f51500cee90 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51557dc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501e2570 con 0x7f5150071bf0 2023-11-17T06:31:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40970/0 (socket says 172.21.15.100:40970) 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 -- 172.21.15.100:0/26831912 learned_addr learned my addr 172.21.15.100:0/26831912 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f514f7fe700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 0x7f515014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f514effd700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5150071bf0 0x7f51500ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 -- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5150071bf0 msgr2=0x7f51500ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5150071bf0 0x7f51500ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 -- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 msgr2=0x7f515014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 0x7f515014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 -- 172.21.15.100:0/26831912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400094b0 con 0x7f51500c9f00 2023-11-17T06:31:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f514f7fe700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 0x7f515014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f5147fff700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f513800c580 tx=0x7f513800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.350+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138004ca0 con 0x7f51500c9f00 2023-11-17T06:31:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138004e20 con 0x7f51500c9f00 2023-11-17T06:31:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51501e2850 con 0x7f51500c9f00 2023-11-17T06:31:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138007310 con 0x7f51500c9f00 2023-11-17T06:31:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51501e2e10 con 0x7f51500c9f00 2023-11-17T06:31:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515004eea0 con 0x7f51500c9f00 2023-11-17T06:31:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.354+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5138007470 con 0x7f51500c9f00 2023-11-17T06:31:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.358+0000 7f51477fe700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 0x7f51300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.358+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5138083c70 con 0x7f51500c9f00 2023-11-17T06:31:08.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.358+0000 7f514effd700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 0x7f51300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.358+0000 7f514effd700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 0x7f51300689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f51400090b0 tx=0x7f5140008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.362+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f51380510e0 con 0x7f51500c9f00 2023-11-17T06:31:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.534+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51500cf840 con 0x7f5130066510 2023-11-17T06:31:08.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.542+0000 7f51477fe700 1 -- 172.21.15.100:0/26831912 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286867 (secure 0 0 0) 0x7f5140011c00 con 0x7f5130066510 2023-11-17T06:31:08.554 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:08.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 msgr2=0x7f51300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 0x7f51300689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f51400090b0 tx=0x7f5140008030 comp rx=0 tx=0).stop 2023-11-17T06:31:08.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 msgr2=0x7f51500afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f513800c580 tx=0x7f513800c940 comp rx=0 tx=0).stop 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 shutdown_connections 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51500cee90 0x7f515014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5130066510 0x7f51300689d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51500c9f00 0x7f51500afcb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 --2- 172.21.15.100:0/26831912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5150071bf0 0x7f51500ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 >> 172.21.15.100:0/26831912 conn(0x7f515006a270 msgr2=0x7f51500cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 shutdown_connections 2023-11-17T06:31:08.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.550+0000 7f51557dc700 1 -- 172.21.15.100:0/26831912 wait complete. 2023-11-17T06:31:08.560 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:31:08.579 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-11-17T06:31:07.292701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4169728,"data_stored":2329320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.055695"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.296532+0000","last_change":"2023-11-17T06:31:02.280922+0000","last_active":"2023-11-17T06:31:02.296532+0000","last_peered":"2023-11-17T06:31:02.296532+0000","last_clean":"2023-11-17T06:31:02.296532+0000","last_became_active":"2023-11-17T06:31:02.280645+0000","last_became_peered":"2023-11-17T06:31:02.280645+0000","last_unstale":"2023-11-17T06:31:02.296532+0000","last_undegraded":"2023-11-17T06:31:02.296532+0000","last_fullsized":"2023-11-17T06:31:02.296532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.297780+0000","last_change":"2023-11-17T06:31:02.292837+0000","last_active":"2023-11-17T06:31:02.297780+0000","last_peered":"2023-11-17T06:31:02.297780+0000","last_clean":"2023-11-17T06:31:02.297780+0000","last_became_active":"2023-11-17T06:31:02.290578+0000","last_became_peered":"2023-11-17T06:31:02.290578+0000","last_unstale":"2023-11-17T06:31:02.297780+0000","last_undegraded":"2023-11-17T06:31:02.297780+0000","last_fullsized":"2023-11-17T06:31:02.297780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:33.925804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298211+0000","last_change":"2023-11-17T06:31:02.295051+0000","last_active":"2023-11-17T06:31:02.298211+0000","last_peered":"2023-11-17T06:31:02.298211+0000","last_clean":"2023-11-17T06:31:02.298211+0000","last_became_active":"2023-11-17T06:31:02.291109+0000","last_became_peered":"2023-11-17T06:31:02.291109+0000","last_unstale":"2023-11-17T06:31:02.298211+0000","last_undegraded":"2023-11-17T06:31:02.298211+0000","last_fullsized":"2023-11-17T06:31:02.298211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:01.559062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309211+0000","last_change":"2023-11-17T06:31:02.292264+0000","last_active":"2023-11-17T06:31:02.309211+0000","last_peered":"2023-11-17T06:31:02.309211+0000","last_clean":"2023-11-17T06:31:02.309211+0000","last_became_active":"2023-11-17T06:31:02.291970+0000","last_became_peered":"2023-11-17T06:31:02.291970+0000","last_unstale":"2023-11-17T06:31:02.309211+0000","last_undegraded":"2023-11-17T06:31:02.309211+0000","last_fullsized":"2023-11-17T06:31:02.309211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:38.294973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289452+0000","last_change":"2023-11-17T06:31:02.283284+0000","last_active":"2023-11-17T06:31:02.289452+0000","last_peered":"2023-11-17T06:31:02.289452+0000","last_clean":"2023-11-17T06:31:02.289452+0000","last_became_active":"2023-11-17T06:31:02.282933+0000","last_became_peered":"2023-11-17T06:31:02.282933+0000","last_unstale":"2023-11-17T06:31:02.289452+0000","last_undegraded":"2023-11-17T06:31:02.289452+0000","last_fullsized":"2023-11-17T06:31:02.289452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:23.582328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.274084+0000","last_change":"2023-11-17T06:31:02.270593+0000","last_active":"2023-11-17T06:31:02.274084+0000","last_peered":"2023-11-17T06:31:02.274084+0000","last_clean":"2023-11-17T06:31:02.274084+0000","last_became_active":"2023-11-17T06:31:02.270268+0000","last_became_peered":"2023-11-17T06:31:02.270268+0000","last_unstale":"2023-11-17T06:31:02.274084+0000","last_undegraded":"2023-11-17T06:31:02.274084+0000","last_fullsized":"2023-11-17T06:31:02.274084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294314+0000","last_change":"2023-11-17T06:31:02.288496+0000","last_active":"2023-11-17T06:31:02.294314+0000","last_peered":"2023-11-17T06:31:02.294314+0000","last_clean":"2023-11-17T06:31:02.294314+0000","last_became_active":"2023-11-17T06:31:02.288153+0000","last_became_peered":"2023-11-17T06:31:02.288153+0000","last_unstale":"2023-11-17T06:31:02.294314+0000","last_undegraded":"2023-11-17T06:31:02.294314+0000","last_fullsized":"2023-11-17T06:31:02.294314+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:45.827681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283344+0000","last_change":"2023-11-17T06:31:02.278501+0000","last_active":"2023-11-17T06:31:02.283344+0000","last_peered":"2023-11-17T06:31:02.283344+0000","last_clean":"2023-11-17T06:31:02.283344+0000","last_became_active":"2023-11-17T06:31:02.276955+0000","last_became_peered":"2023-11-17T06:31:02.276955+0000","last_unstale":"2023-11-17T06:31:02.283344+0000","last_undegraded":"2023-11-17T06:31:02.283344+0000","last_fullsized":"2023-11-17T06:31:02.283344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:12.421188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310748+0000","last_change":"2023-11-17T06:31:02.309765+0000","last_active":"2023-11-17T06:31:02.310748+0000","last_peered":"2023-11-17T06:31:02.310748+0000","last_clean":"2023-11-17T06:31:02.310748+0000","last_became_active":"2023-11-17T06:31:02.309552+0000","last_became_peered":"2023-11-17T06:31:02.309552+0000","last_unstale":"2023-11-17T06:31:02.310748+0000","last_undegraded":"2023-11-17T06:31:02.310748+0000","last_fullsized":"2023-11-17T06:31:02.310748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:23.582328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304863+0000","last_change":"2023-11-17T06:31:02.286820+0000","last_active":"2023-11-17T06:31:02.304863+0000","last_peered":"2023-11-17T06:31:02.304863+0000","last_clean":"2023-11-17T06:31:02.304863+0000","last_became_active":"2023-11-17T06:31:02.286532+0000","last_became_peered":"2023-11-17T06:31:02.286532+0000","last_unstale":"2023-11-17T06:31:02.304863+0000","last_undegraded":"2023-11-17T06:31:02.304863+0000","last_fullsized":"2023-11-17T06:31:02.304863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306569+0000","last_change":"2023-11-17T06:31:02.305695+0000","last_active":"2023-11-17T06:31:02.306569+0000","last_peered":"2023-11-17T06:31:02.306569+0000","last_clean":"2023-11-17T06:31:02.306569+0000","last_became_active":"2023-11-17T06:31:02.305359+0000","last_became_peered":"2023-11-17T06:31:02.305359+0000","last_unstale":"2023-11-17T06:31:02.306569+0000","last_undegraded":"2023-11-17T06:31:02.306569+0000","last_fullsized":"2023-11-17T06:31:02.306569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:33.925804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283099+0000","last_change":"2023-11-17T06:31:02.281007+0000","last_active":"2023-11-17T06:31:02.283099+0000","last_peered":"2023-11-17T06:31:02.283099+0000","last_clean":"2023-11-17T06:31:02.283099+0000","last_became_active":"2023-11-17T06:31:02.280743+0000","last_became_peered":"2023-11-17T06:31:02.280743+0000","last_unstale":"2023-11-17T06:31:02.283099+0000","last_undegraded":"2023-11-17T06:31:02.283099+0000","last_fullsized":"2023-11-17T06:31:02.283099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299851+0000","last_change":"2023-11-17T06:31:02.294172+0000","last_active":"2023-11-17T06:31:02.299851+0000","last_peered":"2023-11-17T06:31:02.299851+0000","last_clean":"2023-11-17T06:31:02.299851+0000","last_became_active":"2023-11-17T06:31:02.293845+0000","last_became_peered":"2023-11-17T06:31:02.293845+0000","last_unstale":"2023-11-17T06:31:02.299851+0000","last_undegraded":"2023-11-17T06:31:02.299851+0000","last_fullsized":"2023-11-17T06:31:02.299851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:40:01.224408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285257+0000","last_change":"2023-11-17T06:31:02.280262+0000","last_active":"2023-11-17T06:31:02.285257+0000","last_peered":"2023-11-17T06:31:02.285257+0000","last_clean":"2023-11-17T06:31:02.285257+0000","last_became_active":"2023-11-17T06:31:02.279896+0000","last_became_peered":"2023-11-17T06:31:02.279896+0000","last_unstale":"2023-11-17T06:31:02.285257+0000","last_undegraded":"2023-11-17T06:31:02.285257+0000","last_fullsized":"2023-11-17T06:31:02.285257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289363+0000","last_change":"2023-11-17T06:31:02.284721+0000","last_active":"2023-11-17T06:31:02.289363+0000","last_peered":"2023-11-17T06:31:02.289363+0000","last_clean":"2023-11-17T06:31:02.289363+0000","last_became_active":"2023-11-17T06:31:02.284385+0000","last_became_peered":"2023-11-17T06:31:02.284385+0000","last_unstale":"2023-11-17T06:31:02.289363+0000","last_undegraded":"2023-11-17T06:31:02.289363+0000","last_fullsized":"2023-11-17T06:31:02.289363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:22.800061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290422+0000","last_change":"2023-11-17T06:31:02.281653+0000","last_active":"2023-11-17T06:31:02.290422+0000","last_peered":"2023-11-17T06:31:02.290422+0000","last_clean":"2023-11-17T06:31:02.290422+0000","last_became_active":"2023-11-17T06:31:02.281380+0000","last_became_peered":"2023-11-17T06:31:02.281380+0000","last_unstale":"2023-11-17T06:31:02.290422+0000","last_undegraded":"2023-11-17T06:31:02.290422+0000","last_fullsized":"2023-11-17T06:31:02.290422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:22.800061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290832+0000","last_change":"2023-11-17T06:31:02.283321+0000","last_active":"2023-11-17T06:31:02.290832+0000","last_peered":"2023-11-17T06:31:02.290832+0000","last_clean":"2023-11-17T06:31:02.290832+0000","last_became_active":"2023-11-17T06:31:02.283066+0000","last_became_peered":"2023-11-17T06:31:02.283066+0000","last_unstale":"2023-11-17T06:31:02.290832+0000","last_undegraded":"2023-11-17T06:31:02.290832+0000","last_fullsized":"2023-11-17T06:31:02.290832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294506+0000","last_change":"2023-11-17T06:31:02.291122+0000","last_active":"2023-11-17T06:31:02.294506+0000","last_peered":"2023-11-17T06:31:02.294506+0000","last_clean":"2023-11-17T06:31:02.294506+0000","last_became_active":"2023-11-17T06:31:02.290234+0000","last_became_peered":"2023-11-17T06:31:02.290234+0000","last_unstale":"2023-11-17T06:31:02.294506+0000","last_undegraded":"2023-11-17T06:31:02.294506+0000","last_fullsized":"2023-11-17T06:31:02.294506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:03:46.723791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298708+0000","last_change":"2023-11-17T06:31:02.292041+0000","last_active":"2023-11-17T06:31:02.298708+0000","last_peered":"2023-11-17T06:31:02.298708+0000","last_clean":"2023-11-17T06:31:02.298708+0000","last_became_active":"2023-11-17T06:31:02.291670+0000","last_became_peered":"2023-11-17T06:31:02.291670+0000","last_unstale":"2023-11-17T06:31:02.298708+0000","last_undegraded":"2023-11-17T06:31:02.298708+0000","last_fullsized":"2023-11-17T06:31:02.298708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285058+0000","last_change":"2023-11-17T06:31:02.280573+0000","last_active":"2023-11-17T06:31:02.285058+0000","last_peered":"2023-11-17T06:31:02.285058+0000","last_clean":"2023-11-17T06:31:02.285058+0000","last_became_active":"2023-11-17T06:31:02.277139+0000","last_became_peered":"2023-11-17T06:31:02.277139+0000","last_unstale":"2023-11-17T06:31:02.285058+0000","last_undegraded":"2023-11-17T06:31:02.285058+0000","last_fullsized":"2023-11-17T06:31:02.285058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:12.196986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298996+0000","last_change":"2023-11-17T06:31:02.291861+0000","last_active":"2023-11-17T06:31:02.298996+0000","last_peered":"2023-11-17T06:31:02.298996+0000","last_clean":"2023-11-17T06:31:02.298996+0000","last_became_active":"2023-11-17T06:31:02.291578+0000","last_became_peered":"2023-11-17T06:31:02.291578+0000","last_unstale":"2023-11-17T06:31:02.298996+0000","last_undegraded":"2023-11-17T06:31:02.298996+0000","last_fullsized":"2023-11-17T06:31:02.298996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:25:17.758145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.301014+0000","last_change":"2023-11-17T06:31:02.292425+0000","last_active":"2023-11-17T06:31:02.301014+0000","last_peered":"2023-11-17T06:31:02.301014+0000","last_clean":"2023-11-17T06:31:02.301014+0000","last_became_active":"2023-11-17T06:31:02.292148+0000","last_became_peered":"2023-11-17T06:31:02.292148+0000","last_unstale":"2023-11-17T06:31:02.301014+0000","last_undegraded":"2023-11-17T06:31:02.301014+0000","last_fullsized":"2023-11-17T06:31:02.301014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:42:17.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.288834+0000","last_change":"2023-11-17T06:31:02.282869+0000","last_active":"2023-11-17T06:31:02.288834+0000","last_peered":"2023-11-17T06:31:02.288834+0000","last_clean":"2023-11-17T06:31:02.288834+0000","last_became_active":"2023-11-17T06:31:02.282557+0000","last_became_peered":"2023-11-17T06:31:02.282557+0000","last_unstale":"2023-11-17T06:31:02.288834+0000","last_undegraded":"2023-11-17T06:31:02.288834+0000","last_fullsized":"2023-11-17T06:31:02.288834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281723+0000","last_change":"2023-11-17T06:31:02.279045+0000","last_active":"2023-11-17T06:31:02.281723+0000","last_peered":"2023-11-17T06:31:02.281723+0000","last_clean":"2023-11-17T06:31:02.281723+0000","last_became_active":"2023-11-17T06:31:02.278599+0000","last_became_peered":"2023-11-17T06:31:02.278599+0000","last_unstale":"2023-11-17T06:31:02.281723+0000","last_undegraded":"2023-11-17T06:31:02.281723+0000","last_fullsized":"2023-11-17T06:31:02.281723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:45.827681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309089+0000","last_change":"2023-11-17T06:31:02.289960+0000","last_active":"2023-11-17T06:31:02.309089+0000","last_peered":"2023-11-17T06:31:02.309089+0000","last_clean":"2023-11-17T06:31:02.309089+0000","last_became_active":"2023-11-17T06:31:02.289674+0000","last_became_peered":"2023-11-17T06:31:02.289674+0000","last_unstale":"2023-11-17T06:31:02.309089+0000","last_undegraded":"2023-11-17T06:31:02.309089+0000","last_fullsized":"2023-11-17T06:31:02.309089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:41.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280448+0000","last_change":"2023-11-17T06:31:02.273266+0000","last_active":"2023-11-17T06:31:02.280448+0000","last_peered":"2023-11-17T06:31:02.280448+0000","last_clean":"2023-11-17T06:31:02.280448+0000","last_became_active":"2023-11-17T06:31:02.272927+0000","last_became_peered":"2023-11-17T06:31:02.272927+0000","last_unstale":"2023-11-17T06:31:02.280448+0000","last_undegraded":"2023-11-17T06:31:02.280448+0000","last_fullsized":"2023-11-17T06:31:02.280448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:28:50.456809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309093+0000","last_change":"2023-11-17T06:31:02.290131+0000","last_active":"2023-11-17T06:31:02.309093+0000","last_peered":"2023-11-17T06:31:02.309093+0000","last_clean":"2023-11-17T06:31:02.309093+0000","last_became_active":"2023-11-17T06:31:02.289878+0000","last_became_peered":"2023-11-17T06:31:02.289878+0000","last_unstale":"2023-11-17T06:31:02.309093+0000","last_undegraded":"2023-11-17T06:31:02.309093+0000","last_fullsized":"2023-11-17T06:31:02.309093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:14.552355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294928+0000","last_change":"2023-11-17T06:31:02.291937+0000","last_active":"2023-11-17T06:31:02.294928+0000","last_peered":"2023-11-17T06:31:02.294928+0000","last_clean":"2023-11-17T06:31:02.294928+0000","last_became_active":"2023-11-17T06:31:02.291672+0000","last_became_peered":"2023-11-17T06:31:02.291672+0000","last_unstale":"2023-11-17T06:31:02.294928+0000","last_undegraded":"2023-11-17T06:31:02.294928+0000","last_fullsized":"2023-11-17T06:31:02.294928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289240+0000","last_change":"2023-11-17T06:31:02.286467+0000","last_active":"2023-11-17T06:31:02.289240+0000","last_peered":"2023-11-17T06:31:02.289240+0000","last_clean":"2023-11-17T06:31:02.289240+0000","last_became_active":"2023-11-17T06:31:02.286176+0000","last_became_peered":"2023-11-17T06:31:02.286176+0000","last_unstale":"2023-11-17T06:31:02.289240+0000","last_undegraded":"2023-11-17T06:31:02.289240+0000","last_fullsized":"2023-11-17T06:31:02.289240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:02.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290418+0000","last_change":"2023-11-17T06:31:02.280116+0000","last_active":"2023-11-17T06:31:02.290418+0000","last_peered":"2023-11-17T06:31:02.290418+0000","last_clean":"2023-11-17T06:31:02.290418+0000","last_became_active":"2023-11-17T06:31:02.279799+0000","last_became_peered":"2023-11-17T06:31:02.279799+0000","last_unstale":"2023-11-17T06:31:02.290418+0000","last_undegraded":"2023-11-17T06:31:02.290418+0000","last_fullsized":"2023-11-17T06:31:02.290418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295243+0000","last_change":"2023-11-17T06:31:02.277794+0000","last_active":"2023-11-17T06:31:02.295243+0000","last_peered":"2023-11-17T06:31:02.295243+0000","last_clean":"2023-11-17T06:31:02.295243+0000","last_became_active":"2023-11-17T06:31:02.277507+0000","last_became_peered":"2023-11-17T06:31:02.277507+0000","last_unstale":"2023-11-17T06:31:02.295243+0000","last_undegraded":"2023-11-17T06:31:02.295243+0000","last_fullsized":"2023-11-17T06:31:02.295243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295453+0000","last_change":"2023-11-17T06:31:02.291452+0000","last_active":"2023-11-17T06:31:02.295453+0000","last_peered":"2023-11-17T06:31:02.295453+0000","last_clean":"2023-11-17T06:31:02.295453+0000","last_became_active":"2023-11-17T06:31:02.291162+0000","last_became_peered":"2023-11-17T06:31:02.291162+0000","last_unstale":"2023-11-17T06:31:02.295453+0000","last_undegraded":"2023-11-17T06:31:02.295453+0000","last_fullsized":"2023-11-17T06:31:02.295453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:01.559062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.302846+0000","last_change":"2023-11-17T06:31:02.296352+0000","last_active":"2023-11-17T06:31:02.302846+0000","last_peered":"2023-11-17T06:31:02.302846+0000","last_clean":"2023-11-17T06:31:02.302846+0000","last_became_active":"2023-11-17T06:31:02.296045+0000","last_became_peered":"2023-11-17T06:31:02.296045+0000","last_unstale":"2023-11-17T06:31:02.302846+0000","last_undegraded":"2023-11-17T06:31:02.302846+0000","last_fullsized":"2023-11-17T06:31:02.302846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305994+0000","last_change":"2023-11-17T06:31:01.253532+0000","last_active":"2023-11-17T06:31:02.305994+0000","last_peered":"2023-11-17T06:31:02.305994+0000","last_clean":"2023-11-17T06:31:02.305994+0000","last_became_active":"2023-11-17T06:31:01.253239+0000","last_became_peered":"2023-11-17T06:31:01.253239+0000","last_unstale":"2023-11-17T06:31:02.305994+0000","last_undegraded":"2023-11-17T06:31:02.305994+0000","last_fullsized":"2023-11-17T06:31:02.305994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:37.284444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299489+0000","last_change":"2023-11-17T06:31:02.289483+0000","last_active":"2023-11-17T06:31:02.299489+0000","last_peered":"2023-11-17T06:31:02.299489+0000","last_clean":"2023-11-17T06:31:02.299489+0000","last_became_active":"2023-11-17T06:31:02.289167+0000","last_became_peered":"2023-11-17T06:31:02.289167+0000","last_unstale":"2023-11-17T06:31:02.299489+0000","last_undegraded":"2023-11-17T06:31:02.299489+0000","last_fullsized":"2023-11-17T06:31:02.299489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304769+0000","last_change":"2023-11-17T06:31:01.269875+0000","last_active":"2023-11-17T06:31:02.304769+0000","last_peered":"2023-11-17T06:31:02.304769+0000","last_clean":"2023-11-17T06:31:02.304769+0000","last_became_active":"2023-11-17T06:31:01.269401+0000","last_became_peered":"2023-11-17T06:31:01.269401+0000","last_unstale":"2023-11-17T06:31:02.304769+0000","last_undegraded":"2023-11-17T06:31:02.304769+0000","last_fullsized":"2023-11-17T06:31:02.304769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:37.284444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290825+0000","last_change":"2023-11-17T06:31:02.288737+0000","last_active":"2023-11-17T06:31:02.290825+0000","last_peered":"2023-11-17T06:31:02.290825+0000","last_clean":"2023-11-17T06:31:02.290825+0000","last_became_active":"2023-11-17T06:31:02.287281+0000","last_became_peered":"2023-11-17T06:31:02.287281+0000","last_unstale":"2023-11-17T06:31:02.290825+0000","last_undegraded":"2023-11-17T06:31:02.290825+0000","last_fullsized":"2023-11-17T06:31:02.290825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:26:46.326075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310859+0000","last_change":"2023-11-17T06:31:01.269957+0000","last_active":"2023-11-17T06:31:02.310859+0000","last_peered":"2023-11-17T06:31:02.310859+0000","last_clean":"2023-11-17T06:31:02.310859+0000","last_became_active":"2023-11-17T06:31:01.269682+0000","last_became_peered":"2023-11-17T06:31:01.269682+0000","last_unstale":"2023-11-17T06:31:02.310859+0000","last_undegraded":"2023-11-17T06:31:02.310859+0000","last_fullsized":"2023-11-17T06:31:02.310859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:21.789531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309114+0000","last_change":"2023-11-17T06:31:02.290642+0000","last_active":"2023-11-17T06:31:02.309114+0000","last_peered":"2023-11-17T06:31:02.309114+0000","last_clean":"2023-11-17T06:31:02.309114+0000","last_became_active":"2023-11-17T06:31:02.289548+0000","last_became_peered":"2023-11-17T06:31:02.289548+0000","last_unstale":"2023-11-17T06:31:02.309114+0000","last_undegraded":"2023-11-17T06:31:02.309114+0000","last_fullsized":"2023-11-17T06:31:02.309114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310303+0000","last_change":"2023-11-17T06:31:01.268547+0000","last_active":"2023-11-17T06:31:02.310303+0000","last_peered":"2023-11-17T06:31:02.310303+0000","last_clean":"2023-11-17T06:31:02.310303+0000","last_became_active":"2023-11-17T06:31:01.268264+0000","last_became_peered":"2023-11-17T06:31:01.268264+0000","last_unstale":"2023-11-17T06:31:02.310303+0000","last_undegraded":"2023-11-17T06:31:02.310303+0000","last_fullsized":"2023-11-17T06:31:02.310303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:26:45.315545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295458+0000","last_change":"2023-11-17T06:31:02.292766+0000","last_active":"2023-11-17T06:31:02.295458+0000","last_peered":"2023-11-17T06:31:02.295458+0000","last_clean":"2023-11-17T06:31:02.295458+0000","last_became_active":"2023-11-17T06:31:02.291147+0000","last_became_peered":"2023-11-17T06:31:02.291147+0000","last_unstale":"2023-11-17T06:31:02.295458+0000","last_undegraded":"2023-11-17T06:31:02.295458+0000","last_fullsized":"2023-11-17T06:31:02.295458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:03.470944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306933+0000","last_change":"2023-11-17T06:31:01.269863+0000","last_active":"2023-11-17T06:31:02.306933+0000","last_peered":"2023-11-17T06:31:02.306933+0000","last_clean":"2023-11-17T06:31:02.306933+0000","last_became_active":"2023-11-17T06:31:01.269633+0000","last_became_peered":"2023-11-17T06:31:01.269633+0000","last_unstale":"2023-11-17T06:31:02.306933+0000","last_undegraded":"2023-11-17T06:31:02.306933+0000","last_fullsized":"2023-11-17T06:31:02.306933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:35.854946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295210+0000","last_change":"2023-11-17T06:31:02.292765+0000","last_active":"2023-11-17T06:31:02.295210+0000","last_peered":"2023-11-17T06:31:02.295210+0000","last_clean":"2023-11-17T06:31:02.295210+0000","last_became_active":"2023-11-17T06:31:02.292500+0000","last_became_peered":"2023-11-17T06:31:02.292500+0000","last_unstale":"2023-11-17T06:31:02.295210+0000","last_undegraded":"2023-11-17T06:31:02.295210+0000","last_fullsized":"2023-11-17T06:31:02.295210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:46.078201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306916+0000","last_change":"2023-11-17T06:31:01.269941+0000","last_active":"2023-11-17T06:31:02.306916+0000","last_peered":"2023-11-17T06:31:02.306916+0000","last_clean":"2023-11-17T06:31:02.306916+0000","last_became_active":"2023-11-17T06:31:01.269579+0000","last_became_peered":"2023-11-17T06:31:01.269579+0000","last_unstale":"2023-11-17T06:31:02.306916+0000","last_undegraded":"2023-11-17T06:31:02.306916+0000","last_fullsized":"2023-11-17T06:31:02.306916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305585+0000","last_change":"2023-11-17T06:31:02.300349+0000","last_active":"2023-11-17T06:31:02.305585+0000","last_peered":"2023-11-17T06:31:02.305585+0000","last_clean":"2023-11-17T06:31:02.305585+0000","last_became_active":"2023-11-17T06:31:02.297981+0000","last_became_peered":"2023-11-17T06:31:02.297981+0000","last_unstale":"2023-11-17T06:31:02.305585+0000","last_undegraded":"2023-11-17T06:31:02.305585+0000","last_fullsized":"2023-11-17T06:31:02.305585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261737+0000","last_change":"2023-11-17T06:31:01.264612+0000","last_active":"2023-11-17T06:31:02.261737+0000","last_peered":"2023-11-17T06:31:02.261737+0000","last_clean":"2023-11-17T06:31:02.261737+0000","last_became_active":"2023-11-17T06:31:01.264319+0000","last_became_peered":"2023-11-17T06:31:01.264319+0000","last_unstale":"2023-11-17T06:31:02.261737+0000","last_undegraded":"2023-11-17T06:31:02.261737+0000","last_fullsized":"2023-11-17T06:31:02.261737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:00.548532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308988+0000","last_change":"2023-11-17T06:31:02.288772+0000","last_active":"2023-11-17T06:31:02.308988+0000","last_peered":"2023-11-17T06:31:02.308988+0000","last_clean":"2023-11-17T06:31:02.308988+0000","last_became_active":"2023-11-17T06:31:02.285563+0000","last_became_peered":"2023-11-17T06:31:02.285563+0000","last_unstale":"2023-11-17T06:31:02.308988+0000","last_undegraded":"2023-11-17T06:31:02.308988+0000","last_fullsized":"2023-11-17T06:31:02.308988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281006+0000","last_change":"2023-11-17T06:31:01.267568+0000","last_active":"2023-11-17T06:31:02.281006+0000","last_peered":"2023-11-17T06:31:02.281006+0000","last_clean":"2023-11-17T06:31:02.281006+0000","last_became_active":"2023-11-17T06:31:01.267299+0000","last_became_peered":"2023-11-17T06:31:01.267299+0000","last_unstale":"2023-11-17T06:31:02.281006+0000","last_undegraded":"2023-11-17T06:31:02.281006+0000","last_fullsized":"2023-11-17T06:31:02.281006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.275018+0000","last_change":"2023-11-17T06:31:02.270524+0000","last_active":"2023-11-17T06:31:02.275018+0000","last_peered":"2023-11-17T06:31:02.275018+0000","last_clean":"2023-11-17T06:31:02.275018+0000","last_became_active":"2023-11-17T06:31:02.270006+0000","last_became_peered":"2023-11-17T06:31:02.270006+0000","last_unstale":"2023-11-17T06:31:02.275018+0000","last_undegraded":"2023-11-17T06:31:02.275018+0000","last_fullsized":"2023-11-17T06:31:02.275018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:12.421188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.263979+0000","last_change":"2023-11-17T06:31:01.271783+0000","last_active":"2023-11-17T06:31:02.263979+0000","last_peered":"2023-11-17T06:31:02.263979+0000","last_clean":"2023-11-17T06:31:02.263979+0000","last_became_active":"2023-11-17T06:31:01.271507+0000","last_became_peered":"2023-11-17T06:31:01.271507+0000","last_unstale":"2023-11-17T06:31:02.263979+0000","last_undegraded":"2023-11-17T06:31:02.263979+0000","last_fullsized":"2023-11-17T06:31:02.263979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.908906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308912+0000","last_change":"2023-11-17T06:31:02.306108+0000","last_active":"2023-11-17T06:31:02.308912+0000","last_peered":"2023-11-17T06:31:02.308912+0000","last_clean":"2023-11-17T06:31:02.308912+0000","last_became_active":"2023-11-17T06:31:02.305802+0000","last_became_peered":"2023-11-17T06:31:02.305802+0000","last_unstale":"2023-11-17T06:31:02.308912+0000","last_undegraded":"2023-11-17T06:31:02.308912+0000","last_fullsized":"2023-11-17T06:31:02.308912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:03:24.368603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.284257+0000","last_change":"2023-11-17T06:31:01.262661+0000","last_active":"2023-11-17T06:31:02.284257+0000","last_peered":"2023-11-17T06:31:02.284257+0000","last_clean":"2023-11-17T06:31:02.284257+0000","last_became_active":"2023-11-17T06:31:01.261946+0000","last_became_peered":"2023-11-17T06:31:01.261946+0000","last_unstale":"2023-11-17T06:31:02.284257+0000","last_undegraded":"2023-11-17T06:31:02.284257+0000","last_fullsized":"2023-11-17T06:31:02.284257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.282339+0000","last_change":"2023-11-17T06:31:02.272986+0000","last_active":"2023-11-17T06:31:02.282339+0000","last_peered":"2023-11-17T06:31:02.282339+0000","last_clean":"2023-11-17T06:31:02.282339+0000","last_became_active":"2023-11-17T06:31:02.271558+0000","last_became_peered":"2023-11-17T06:31:02.271558+0000","last_unstale":"2023-11-17T06:31:02.282339+0000","last_undegraded":"2023-11-17T06:31:02.282339+0000","last_fullsized":"2023-11-17T06:31:02.282339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306599+0000","last_change":"2023-11-17T06:31:01.269272+0000","last_active":"2023-11-17T06:31:02.306599+0000","last_peered":"2023-11-17T06:31:02.306599+0000","last_clean":"2023-11-17T06:31:02.306599+0000","last_became_active":"2023-11-17T06:31:01.268932+0000","last_became_peered":"2023-11-17T06:31:01.268932+0000","last_unstale":"2023-11-17T06:31:02.306599+0000","last_undegraded":"2023-11-17T06:31:02.306599+0000","last_fullsized":"2023-11-17T06:31:02.306599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:32.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.301627+0000","last_change":"2023-11-17T06:31:02.296334+0000","last_active":"2023-11-17T06:31:02.301627+0000","last_peered":"2023-11-17T06:31:02.301627+0000","last_clean":"2023-11-17T06:31:02.301627+0000","last_became_active":"2023-11-17T06:31:02.296055+0000","last_became_peered":"2023-11-17T06:31:02.296055+0000","last_unstale":"2023-11-17T06:31:02.301627+0000","last_undegraded":"2023-11-17T06:31:02.301627+0000","last_fullsized":"2023-11-17T06:31:02.301627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.314739+0000","last_change":"2023-11-17T06:31:01.266867+0000","last_active":"2023-11-17T06:31:02.314739+0000","last_peered":"2023-11-17T06:31:02.314739+0000","last_clean":"2023-11-17T06:31:02.314739+0000","last_became_active":"2023-11-17T06:31:01.266610+0000","last_became_peered":"2023-11-17T06:31:01.266610+0000","last_unstale":"2023-11-17T06:31:02.314739+0000","last_undegraded":"2023-11-17T06:31:02.314739+0000","last_fullsized":"2023-11-17T06:31:02.314739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:02.460414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304767+0000","last_change":"2023-11-17T06:31:02.287152+0000","last_active":"2023-11-17T06:31:02.304767+0000","last_peered":"2023-11-17T06:31:02.304767+0000","last_clean":"2023-11-17T06:31:02.304767+0000","last_became_active":"2023-11-17T06:31:02.284279+0000","last_became_peered":"2023-11-17T06:31:02.284279+0000","last_unstale":"2023-11-17T06:31:02.304767+0000","last_undegraded":"2023-11-17T06:31:02.304767+0000","last_fullsized":"2023-11-17T06:31:02.304767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307179+0000","last_change":"2023-11-17T06:31:01.262985+0000","last_active":"2023-11-17T06:31:02.307179+0000","last_peered":"2023-11-17T06:31:02.307179+0000","last_clean":"2023-11-17T06:31:02.307179+0000","last_became_active":"2023-11-17T06:31:01.262690+0000","last_became_peered":"2023-11-17T06:31:01.262690+0000","last_unstale":"2023-11-17T06:31:02.307179+0000","last_undegraded":"2023-11-17T06:31:02.307179+0000","last_fullsized":"2023-11-17T06:31:02.307179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:08:24.198437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.297817+0000","last_change":"2023-11-17T06:31:02.293008+0000","last_active":"2023-11-17T06:31:02.297817+0000","last_peered":"2023-11-17T06:31:02.297817+0000","last_clean":"2023-11-17T06:31:02.297817+0000","last_became_active":"2023-11-17T06:31:02.292499+0000","last_became_peered":"2023-11-17T06:31:02.292499+0000","last_unstale":"2023-11-17T06:31:02.297817+0000","last_undegraded":"2023-11-17T06:31:02.297817+0000","last_fullsized":"2023-11-17T06:31:02.297817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:11:38.820521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280385+0000","last_change":"2023-11-17T06:31:01.267798+0000","last_active":"2023-11-17T06:31:02.280385+0000","last_peered":"2023-11-17T06:31:02.280385+0000","last_clean":"2023-11-17T06:31:02.280385+0000","last_became_active":"2023-11-17T06:31:01.267491+0000","last_became_peered":"2023-11-17T06:31:01.267491+0000","last_unstale":"2023-11-17T06:31:02.280385+0000","last_undegraded":"2023-11-17T06:31:02.280385+0000","last_fullsized":"2023-11-17T06:31:02.280385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295434+0000","last_change":"2023-11-17T06:31:02.291440+0000","last_active":"2023-11-17T06:31:02.295434+0000","last_peered":"2023-11-17T06:31:02.295434+0000","last_clean":"2023-11-17T06:31:02.295434+0000","last_became_active":"2023-11-17T06:31:02.290784+0000","last_became_peered":"2023-11-17T06:31:02.290784+0000","last_unstale":"2023-11-17T06:31:02.295434+0000","last_undegraded":"2023-11-17T06:31:02.295434+0000","last_fullsized":"2023-11-17T06:31:02.295434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261723+0000","last_change":"2023-11-17T06:31:01.270442+0000","last_active":"2023-11-17T06:31:02.261723+0000","last_peered":"2023-11-17T06:31:02.261723+0000","last_clean":"2023-11-17T06:31:02.261723+0000","last_became_active":"2023-11-17T06:31:01.268907+0000","last_became_peered":"2023-11-17T06:31:01.268907+0000","last_unstale":"2023-11-17T06:31:02.261723+0000","last_undegraded":"2023-11-17T06:31:02.261723+0000","last_fullsized":"2023-11-17T06:31:02.261723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:44.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298269+0000","last_change":"2023-11-17T06:31:02.288031+0000","last_active":"2023-11-17T06:31:02.298269+0000","last_peered":"2023-11-17T06:31:02.298269+0000","last_clean":"2023-11-17T06:31:02.298269+0000","last_became_active":"2023-11-17T06:31:02.285502+0000","last_became_peered":"2023-11-17T06:31:02.285502+0000","last_unstale":"2023-11-17T06:31:02.298269+0000","last_undegraded":"2023-11-17T06:31:02.298269+0000","last_fullsized":"2023-11-17T06:31:02.298269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:51:04.803116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.312234+0000","last_change":"2023-11-17T06:31:01.267069+0000","last_active":"2023-11-17T06:31:02.312234+0000","last_peered":"2023-11-17T06:31:02.312234+0000","last_clean":"2023-11-17T06:31:02.312234+0000","last_became_active":"2023-11-17T06:31:01.266766+0000","last_became_peered":"2023-11-17T06:31:01.266766+0000","last_unstale":"2023-11-17T06:31:02.312234+0000","last_undegraded":"2023-11-17T06:31:02.312234+0000","last_fullsized":"2023-11-17T06:31:02.312234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299473+0000","last_change":"2023-11-17T06:31:02.294553+0000","last_active":"2023-11-17T06:31:02.299473+0000","last_peered":"2023-11-17T06:31:02.299473+0000","last_clean":"2023-11-17T06:31:02.299473+0000","last_became_active":"2023-11-17T06:31:02.293947+0000","last_became_peered":"2023-11-17T06:31:02.293947+0000","last_unstale":"2023-11-17T06:31:02.299473+0000","last_undegraded":"2023-11-17T06:31:02.299473+0000","last_fullsized":"2023-11-17T06:31:02.299473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310184+0000","last_change":"2023-11-17T06:31:01.264987+0000","last_active":"2023-11-17T06:31:02.310184+0000","last_peered":"2023-11-17T06:31:02.310184+0000","last_clean":"2023-11-17T06:31:02.310184+0000","last_became_active":"2023-11-17T06:31:01.264494+0000","last_became_peered":"2023-11-17T06:31:01.264494+0000","last_unstale":"2023-11-17T06:31:02.310184+0000","last_undegraded":"2023-11-17T06:31:02.310184+0000","last_fullsized":"2023-11-17T06:31:02.310184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:11.410659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292025+0000","last_change":"2023-11-17T06:31:02.288021+0000","last_active":"2023-11-17T06:31:02.292025+0000","last_peered":"2023-11-17T06:31:02.292025+0000","last_clean":"2023-11-17T06:31:02.292025+0000","last_became_active":"2023-11-17T06:31:02.287727+0000","last_became_peered":"2023-11-17T06:31:02.287727+0000","last_unstale":"2023-11-17T06:31:02.292025+0000","last_undegraded":"2023-11-17T06:31:02.292025+0000","last_fullsized":"2023-11-17T06:31:02.292025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307185+0000","last_change":"2023-11-17T06:31:01.262972+0000","last_active":"2023-11-17T06:31:02.307185+0000","last_peered":"2023-11-17T06:31:02.307185+0000","last_clean":"2023-11-17T06:31:02.307185+0000","last_became_active":"2023-11-17T06:31:01.262654+0000","last_became_peered":"2023-11-17T06:31:01.262654+0000","last_unstale":"2023-11-17T06:31:02.307185+0000","last_undegraded":"2023-11-17T06:31:02.307185+0000","last_fullsized":"2023-11-17T06:31:02.307185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:01.013380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309189+0000","last_change":"2023-11-17T06:31:02.290947+0000","last_active":"2023-11-17T06:31:02.309189+0000","last_peered":"2023-11-17T06:31:02.309189+0000","last_clean":"2023-11-17T06:31:02.309189+0000","last_became_active":"2023-11-17T06:31:02.290688+0000","last_became_peered":"2023-11-17T06:31:02.290688+0000","last_unstale":"2023-11-17T06:31:02.309189+0000","last_undegraded":"2023-11-17T06:31:02.309189+0000","last_fullsized":"2023-11-17T06:31:02.309189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:25.116521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305755+0000","last_change":"2023-11-17T06:31:01.261930+0000","last_active":"2023-11-17T06:31:02.305755+0000","last_peered":"2023-11-17T06:31:02.305755+0000","last_clean":"2023-11-17T06:31:02.305755+0000","last_became_active":"2023-11-17T06:31:01.261476+0000","last_became_peered":"2023-11-17T06:31:01.261476+0000","last_unstale":"2023-11-17T06:31:02.305755+0000","last_undegraded":"2023-11-17T06:31:02.305755+0000","last_fullsized":"2023-11-17T06:31:02.305755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:21:37.344611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281843+0000","last_change":"2023-11-17T06:31:02.275895+0000","last_active":"2023-11-17T06:31:02.281843+0000","last_peered":"2023-11-17T06:31:02.281843+0000","last_clean":"2023-11-17T06:31:02.281843+0000","last_became_active":"2023-11-17T06:31:02.275548+0000","last_became_peered":"2023-11-17T06:31:02.275548+0000","last_unstale":"2023-11-17T06:31:02.281843+0000","last_undegraded":"2023-11-17T06:31:02.281843+0000","last_fullsized":"2023-11-17T06:31:02.281843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:02.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.278357+0000","last_change":"2023-11-17T06:31:01.272092+0000","last_active":"2023-11-17T06:31:02.278357+0000","last_peered":"2023-11-17T06:31:02.278357+0000","last_clean":"2023-11-17T06:31:02.278357+0000","last_became_active":"2023-11-17T06:31:01.271817+0000","last_became_peered":"2023-11-17T06:31:01.271817+0000","last_unstale":"2023-11-17T06:31:02.278357+0000","last_undegraded":"2023-11-17T06:31:02.278357+0000","last_fullsized":"2023-11-17T06:31:02.278357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:53:02.401247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290733+0000","last_change":"2023-11-17T06:31:02.286947+0000","last_active":"2023-11-17T06:31:02.290733+0000","last_peered":"2023-11-17T06:31:02.290733+0000","last_clean":"2023-11-17T06:31:02.290733+0000","last_became_active":"2023-11-17T06:31:02.286675+0000","last_became_peered":"2023-11-17T06:31:02.286675+0000","last_unstale":"2023-11-17T06:31:02.290733+0000","last_undegraded":"2023-11-17T06:31:02.290733+0000","last_fullsized":"2023-11-17T06:31:02.290733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:24:19.588458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309865+0000","last_change":"2023-11-17T06:31:01.259254+0000","last_active":"2023-11-17T06:31:02.309865+0000","last_peered":"2023-11-17T06:31:02.309865+0000","last_clean":"2023-11-17T06:31:02.309865+0000","last_became_active":"2023-11-17T06:31:01.258766+0000","last_became_peered":"2023-11-17T06:31:01.258766+0000","last_unstale":"2023-11-17T06:31:02.309865+0000","last_undegraded":"2023-11-17T06:31:02.309865+0000","last_fullsized":"2023-11-17T06:31:02.309865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294647+0000","last_change":"2023-11-17T06:31:02.291660+0000","last_active":"2023-11-17T06:31:02.294647+0000","last_peered":"2023-11-17T06:31:02.294647+0000","last_clean":"2023-11-17T06:31:02.294647+0000","last_became_active":"2023-11-17T06:31:02.291382+0000","last_became_peered":"2023-11-17T06:31:02.291382+0000","last_unstale":"2023-11-17T06:31:02.294647+0000","last_undegraded":"2023-11-17T06:31:02.294647+0000","last_fullsized":"2023-11-17T06:31:02.294647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:04:24.025515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.271750+0000","last_change":"2023-11-17T06:31:01.266405+0000","last_active":"2023-11-17T06:31:02.271750+0000","last_peered":"2023-11-17T06:31:02.271750+0000","last_clean":"2023-11-17T06:31:02.271750+0000","last_became_active":"2023-11-17T06:31:01.266086+0000","last_became_peered":"2023-11-17T06:31:01.266086+0000","last_unstale":"2023-11-17T06:31:02.271750+0000","last_undegraded":"2023-11-17T06:31:02.271750+0000","last_fullsized":"2023-11-17T06:31:02.271750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290590+0000","last_change":"2023-11-17T06:31:02.285784+0000","last_active":"2023-11-17T06:31:02.290590+0000","last_peered":"2023-11-17T06:31:02.290590+0000","last_clean":"2023-11-17T06:31:02.290590+0000","last_became_active":"2023-11-17T06:31:02.285438+0000","last_became_peered":"2023-11-17T06:31:02.285438+0000","last_unstale":"2023-11-17T06:31:02.290590+0000","last_undegraded":"2023-11-17T06:31:02.290590+0000","last_fullsized":"2023-11-17T06:31:02.290590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:25:17.758145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.278985+0000","last_change":"2023-11-17T06:31:01.266442+0000","last_active":"2023-11-17T06:31:02.278985+0000","last_peered":"2023-11-17T06:31:02.278985+0000","last_clean":"2023-11-17T06:31:02.278985+0000","last_became_active":"2023-11-17T06:31:01.266065+0000","last_became_peered":"2023-11-17T06:31:01.266065+0000","last_unstale":"2023-11-17T06:31:02.278985+0000","last_undegraded":"2023-11-17T06:31:02.278985+0000","last_fullsized":"2023-11-17T06:31:02.278985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:51:03.792586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294332+0000","last_change":"2023-11-17T06:31:02.290231+0000","last_active":"2023-11-17T06:31:02.294332+0000","last_peered":"2023-11-17T06:31:02.294332+0000","last_clean":"2023-11-17T06:31:02.294332+0000","last_became_active":"2023-11-17T06:31:02.289968+0000","last_became_peered":"2023-11-17T06:31:02.289968+0000","last_unstale":"2023-11-17T06:31:02.294332+0000","last_undegraded":"2023-11-17T06:31:02.294332+0000","last_fullsized":"2023-11-17T06:31:02.294332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.266090+0000","last_change":"2023-11-17T06:31:01.265165+0000","last_active":"2023-11-17T06:31:02.266090+0000","last_peered":"2023-11-17T06:31:02.266090+0000","last_clean":"2023-11-17T06:31:02.266090+0000","last_became_active":"2023-11-17T06:31:01.264845+0000","last_became_peered":"2023-11-17T06:31:01.264845+0000","last_unstale":"2023-11-17T06:31:02.266090+0000","last_undegraded":"2023-11-17T06:31:02.266090+0000","last_fullsized":"2023-11-17T06:31:02.266090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:02.460414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285032+0000","last_change":"2023-11-17T06:31:02.280425+0000","last_active":"2023-11-17T06:31:02.285032+0000","last_peered":"2023-11-17T06:31:02.285032+0000","last_clean":"2023-11-17T06:31:02.285032+0000","last_became_active":"2023-11-17T06:31:02.280156+0000","last_became_peered":"2023-11-17T06:31:02.280156+0000","last_unstale":"2023-11-17T06:31:02.285032+0000","last_undegraded":"2023-11-17T06:31:02.285032+0000","last_fullsized":"2023-11-17T06:31:02.285032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:20:36.576718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309533+0000","last_change":"2023-11-17T06:31:01.267850+0000","last_active":"2023-11-17T06:31:02.309533+0000","last_peered":"2023-11-17T06:31:02.309533+0000","last_clean":"2023-11-17T06:31:02.309533+0000","last_became_active":"2023-11-17T06:31:01.265863+0000","last_became_peered":"2023-11-17T06:31:01.265863+0000","last_unstale":"2023-11-17T06:31:02.309533+0000","last_undegraded":"2023-11-17T06:31:02.309533+0000","last_fullsized":"2023-11-17T06:31:02.309533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:35.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307290+0000","last_change":"2023-11-17T06:31:02.305742+0000","last_active":"2023-11-17T06:31:02.307290+0000","last_peered":"2023-11-17T06:31:02.307290+0000","last_clean":"2023-11-17T06:31:02.307290+0000","last_became_active":"2023-11-17T06:31:02.305321+0000","last_became_peered":"2023-11-17T06:31:02.305321+0000","last_unstale":"2023-11-17T06:31:02.307290+0000","last_undegraded":"2023-11-17T06:31:02.307290+0000","last_fullsized":"2023-11-17T06:31:02.307290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.284136+0000","last_change":"2023-11-17T06:31:01.253703+0000","last_active":"2023-11-17T06:31:02.284136+0000","last_peered":"2023-11-17T06:31:02.284136+0000","last_clean":"2023-11-17T06:31:02.284136+0000","last_became_active":"2023-11-17T06:31:01.253345+0000","last_became_peered":"2023-11-17T06:31:01.253345+0000","last_unstale":"2023-11-17T06:31:02.284136+0000","last_undegraded":"2023-11-17T06:31:02.284136+0000","last_fullsized":"2023-11-17T06:31:02.284136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:24.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308802+0000","last_change":"2023-11-17T06:31:02.305645+0000","last_active":"2023-11-17T06:31:02.308802+0000","last_peered":"2023-11-17T06:31:02.308802+0000","last_clean":"2023-11-17T06:31:02.308802+0000","last_became_active":"2023-11-17T06:31:02.305317+0000","last_became_peered":"2023-11-17T06:31:02.305317+0000","last_unstale":"2023-11-17T06:31:02.308802+0000","last_undegraded":"2023-11-17T06:31:02.308802+0000","last_fullsized":"2023-11-17T06:31:02.308802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283995+0000","last_change":"2023-11-17T06:31:01.263146+0000","last_active":"2023-11-17T06:31:02.283995+0000","last_peered":"2023-11-17T06:31:02.283995+0000","last_clean":"2023-11-17T06:31:02.283995+0000","last_became_active":"2023-11-17T06:31:01.262869+0000","last_became_peered":"2023-11-17T06:31:01.262869+0000","last_unstale":"2023-11-17T06:31:02.283995+0000","last_undegraded":"2023-11-17T06:31:02.283995+0000","last_fullsized":"2023-11-17T06:31:02.283995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:00.548532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298374+0000","last_change":"2023-11-17T06:31:02.290234+0000","last_active":"2023-11-17T06:31:02.298374+0000","last_peered":"2023-11-17T06:31:02.298374+0000","last_clean":"2023-11-17T06:31:02.298374+0000","last_became_active":"2023-11-17T06:31:02.289931+0000","last_became_peered":"2023-11-17T06:31:02.289931+0000","last_unstale":"2023-11-17T06:31:02.298374+0000","last_undegraded":"2023-11-17T06:31:02.298374+0000","last_fullsized":"2023-11-17T06:31:02.298374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.279011+0000","last_change":"2023-11-17T06:31:01.251330+0000","last_active":"2023-11-17T06:31:02.279011+0000","last_peered":"2023-11-17T06:31:02.279011+0000","last_clean":"2023-11-17T06:31:02.279011+0000","last_became_active":"2023-11-17T06:31:01.250997+0000","last_became_peered":"2023-11-17T06:31:01.250997+0000","last_unstale":"2023-11-17T06:31:02.279011+0000","last_undegraded":"2023-11-17T06:31:02.279011+0000","last_fullsized":"2023-11-17T06:31:02.279011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.303217+0000","last_change":"2023-11-17T06:31:02.300098+0000","last_active":"2023-11-17T06:31:02.303217+0000","last_peered":"2023-11-17T06:31:02.303217+0000","last_clean":"2023-11-17T06:31:02.303217+0000","last_became_active":"2023-11-17T06:31:02.298662+0000","last_became_peered":"2023-11-17T06:31:02.298662+0000","last_unstale":"2023-11-17T06:31:02.303217+0000","last_undegraded":"2023-11-17T06:31:02.303217+0000","last_fullsized":"2023-11-17T06:31:02.303217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280755+0000","last_change":"2023-11-17T06:31:01.255343+0000","last_active":"2023-11-17T06:31:02.280755+0000","last_peered":"2023-11-17T06:31:02.280755+0000","last_clean":"2023-11-17T06:31:02.280755+0000","last_became_active":"2023-11-17T06:31:01.255035+0000","last_became_peered":"2023-11-17T06:31:01.255035+0000","last_unstale":"2023-11-17T06:31:02.280755+0000","last_undegraded":"2023-11-17T06:31:02.280755+0000","last_fullsized":"2023-11-17T06:31:02.280755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:44.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292437+0000","last_change":"2023-11-17T06:31:02.287063+0000","last_active":"2023-11-17T06:31:02.292437+0000","last_peered":"2023-11-17T06:31:02.292437+0000","last_clean":"2023-11-17T06:31:02.292437+0000","last_became_active":"2023-11-17T06:31:02.284905+0000","last_became_peered":"2023-11-17T06:31:02.284905+0000","last_unstale":"2023-11-17T06:31:02.292437+0000","last_undegraded":"2023-11-17T06:31:02.292437+0000","last_fullsized":"2023-11-17T06:31:02.292437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.279117+0000","last_change":"2023-11-17T06:31:01.264123+0000","last_active":"2023-11-17T06:31:02.279117+0000","last_peered":"2023-11-17T06:31:02.279117+0000","last_clean":"2023-11-17T06:31:02.279117+0000","last_became_active":"2023-11-17T06:31:01.263780+0000","last_became_peered":"2023-11-17T06:31:01.263780+0000","last_unstale":"2023-11-17T06:31:02.279117+0000","last_undegraded":"2023-11-17T06:31:02.279117+0000","last_fullsized":"2023-11-17T06:31:02.279117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:01.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289326+0000","last_change":"2023-11-17T06:31:02.286550+0000","last_active":"2023-11-17T06:31:02.289326+0000","last_peered":"2023-11-17T06:31:02.289326+0000","last_clean":"2023-11-17T06:31:02.289326+0000","last_became_active":"2023-11-17T06:31:02.286166+0000","last_became_peered":"2023-11-17T06:31:02.286166+0000","last_unstale":"2023-11-17T06:31:02.289326+0000","last_undegraded":"2023-11-17T06:31:02.289326+0000","last_fullsized":"2023-11-17T06:31:02.289326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:20:36.576718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261918+0000","last_change":"2023-11-17T06:31:01.271249+0000","last_active":"2023-11-17T06:31:02.261918+0000","last_peered":"2023-11-17T06:31:02.261918+0000","last_clean":"2023-11-17T06:31:02.261918+0000","last_became_active":"2023-11-17T06:31:01.269270+0000","last_became_peered":"2023-11-17T06:31:01.269270+0000","last_unstale":"2023-11-17T06:31:02.261918+0000","last_undegraded":"2023-11-17T06:31:02.261918+0000","last_fullsized":"2023-11-17T06:31:02.261918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:11.410659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292063+0000","last_change":"2023-11-17T06:31:02.282905+0000","last_active":"2023-11-17T06:31:02.292063+0000","last_peered":"2023-11-17T06:31:02.292063+0000","last_clean":"2023-11-17T06:31:02.292063+0000","last_became_active":"2023-11-17T06:31:02.282603+0000","last_became_peered":"2023-11-17T06:31:02.282603+0000","last_unstale":"2023-11-17T06:31:02.292063+0000","last_undegraded":"2023-11-17T06:31:02.292063+0000","last_fullsized":"2023-11-17T06:31:02.292063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.272836+0000","last_change":"2023-11-17T06:31:01.264661+0000","last_active":"2023-11-17T06:31:02.272836+0000","last_peered":"2023-11-17T06:31:02.272836+0000","last_clean":"2023-11-17T06:31:02.272836+0000","last_became_active":"2023-11-17T06:31:01.264324+0000","last_became_peered":"2023-11-17T06:31:01.264324+0000","last_unstale":"2023-11-17T06:31:02.272836+0000","last_undegraded":"2023-11-17T06:31:02.272836+0000","last_fullsized":"2023-11-17T06:31:02.272836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-17T06:31:01.263433+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:31:01.263433+0000","last_peered":"2023-11-17T06:31:01.263433+0000","last_clean":"2023-11-17T06:31:01.263433+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:31:01.263433+0000","last_undegraded":"2023-11-17T06:31:01.263433+0000","last_fullsized":"2023-11-17T06:31:01.263433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":733941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.341,"15min":1.385},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.571,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.377,"15min":1.4239999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.556,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":1.2649999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.046},{"interface":"front","average":{"1min":1.141,"5min":1.556,"15min":1.625},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.667,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":1.105}]},{"osd":2,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.379,"15min":1.4119999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.508,"5min":1.919,"15min":1.919},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.125,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3979999999999999,"5min":1.52,"15min":1.52},"last":1.21}]},{"osd":3,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.5209999999999999,"15min":1.585},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.391,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.306},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.621,"15min":1.673},"min":{"1min":0.96699999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5900000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.387}]},{"osd":4,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.264,"15min":1.288},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4950000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.343},{"interface":"front","average":{"1min":1.226,"5min":1.421,"15min":1.4530000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6439999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4890000000000001,"15min":1.5309999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.4550000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.411,"15min":1.4379999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.587,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.429}]},{"osd":6,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.5349999999999999,"15min":1.5700000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.556,"5min":2.375,"15min":2.375},"last":1.5},{"interface":"front","average":{"1min":1.302,"5min":1.492,"15min":1.524},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.621,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4710000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.75},{"interface":"front","average":{"1min":1.089,"5min":1.1659999999999999,"15min":1.179},"min":{"1min":0.85699999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.456,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0900000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1619999999999999,"15min":1.1719999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.464,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.266,"15min":1.2949999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.345,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.208,"15min":1.2250000000000001},"min":{"1min":0.83199999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4259999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.319,"15min":1.337},"min":{"1min":1.002,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.3839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.355,"15min":1.3759999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5149999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.3080000000000001,"15min":1.3400000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.444,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.175}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.3120000000000001,"15min":1.3520000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4390000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.258},{"interface":"front","average":{"1min":1.226,"5min":1.4179999999999999,"15min":1.45},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.5860000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4990000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.28,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.552,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.333},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.45,"15min":1.482},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.4790000000000001,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.518,"15min":1.548},"min":{"1min":1.0409999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5289999999999999,"5min":2.548,"15min":2.548},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4850000000000001,"15min":1.5109999999999999},"min":{"1min":0.96999999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5960000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.133,"15min":1.133},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.335},{"interface":"front","average":{"1min":1.159,"5min":1.333,"15min":1.3620000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.873,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2509999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.167},{"interface":"front","average":{"1min":1.113,"5min":1.3089999999999999,"15min":1.341},"min":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9810000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.4159999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.90100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.048,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1},{"interface":"front","average":{"1min":1.198,"5min":1.3839999999999999,"15min":1.415},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.901,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.288}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4430000000000001,"15min":1.47},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.6319999999999999,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.522,"15min":1.552},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.9930000000000001,"5min":3.48,"15min":3.48},"last":1.373}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.3819999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.3380000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.448},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.5149999999999999,"15min":1.5549999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.907,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.6359999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.464,"15min":1.492},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0960000000000001,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.554,"15min":1.5840000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0800000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.5640000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.6180000000000001,"15min":1.6459999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.833,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.647,"15min":1.675},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.1459999999999999,"5min":3.355,"15min":3.355},"last":1.595}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1639999999999999,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5509999999999999,"5min":2.286,"15min":2.286},"last":0.753},{"interface":"front","average":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7370000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2090000000000001,"15min":1.2110000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.169,"15min":1.1539999999999999},"min":{"1min":0.91100000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.615,"15min":1.6930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.498,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.087},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.534,"15min":1.5920000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.8200000000000001,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.04}]},{"osd":3,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.216,"15min":1.216},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.298}]},{"osd":5,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.1779999999999999,"15min":1.1639999999999999},"min":{"1min":0.77000000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.27,"5min":1.28,"15min":1.282},"min":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.78200000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4670000000000001,"15min":1.4870000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.4489999999999998,"5min":2.681,"15min":2.681},"last":1.129}]},{"osd":7,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.331,"15min":1.355},"min":{"1min":0.86499999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.625,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.474,"15min":1.4850000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.3799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.91400000000000003,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4319999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.034},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.103},"min":{"1min":0.66100000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.556,"15min":1.556},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.159,"15min":1.175},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.246}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0840000000000001,"15min":1.0780000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.214,"15min":1.244},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.161}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.421,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.88,"15min":0.88},"max":{"1min":1.583,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.4179999999999999,"15min":1.45},"min":{"1min":0.74199999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.837,"5min":2.359,"15min":2.359},"last":1.337}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.95799999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.716,"5min":2.375,"15min":2.375},"last":1.786},{"interface":"front","average":{"1min":1.22,"5min":1.476,"15min":1.5189999999999999},"min":{"1min":1.0469999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.474,"5min":2.202,"15min":2.202},"last":1.216}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.488,"15min":1.5169999999999999},"min":{"1min":0.98899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.8400000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.383},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5700000000000001},"min":{"1min":0.95099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.528,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.863}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.571,"15min":1.621},"min":{"1min":0.99199999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.5169999999999999,"5min":2.431,"15min":2.431},"last":1.427},{"interface":"front","average":{"1min":1.323,"5min":1.5800000000000001,"15min":1.623},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.8759999999999999,"5min":2.427,"15min":2.427},"last":1.28}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.89900000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.745},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78700000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.276,"15min":1.276},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.276,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.1890000000000001,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.2789999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.272}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3520000000000001,"15min":1.3720000000000001},"min":{"1min":1.022,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.4710000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.208},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.27,"15min":1.2989999999999999},"min":{"1min":0.92700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.55,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.462}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.395,"15min":1.429},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.673,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.248},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4450000000000001,"15min":1.468},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.575,"5min":1.948,"15min":1.948},"last":1.3069999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.4199999999999999,"15min":1.45},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.593,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.571},{"interface":"front","average":{"1min":1.274,"5min":1.492,"15min":1.528},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.4590000000000001,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.3680000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.466,"15min":1.492},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.601,"5min":2.194,"15min":2.194},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.5629999999999999,"15min":1.5940000000000001},"min":{"1min":1.173,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.76,"5min":2.464,"15min":2.464},"last":1.512}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.034,"15min":1.018},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.7789999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.998,"15min":0.999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2150000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.079,"15min":1.0740000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.115,"15min":1.119},"min":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1840000000000002,"5min":2.262,"15min":2.262},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.3280000000000001,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.056},{"interface":"front","average":{"1min":1.079,"5min":1.3160000000000001,"15min":1.3560000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.4710000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.89800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.169,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.4430000000000001,"15min":1.4630000000000001},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.891,"5min":3.891,"15min":3.891},"last":1.7050000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.4319999999999999,"15min":1.4450000000000001},"min":{"1min":0.89200000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.5580000000000001,"15min":1.5920000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.383,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.1879999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.5329999999999999,"15min":1.5609999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4039999999999999,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.617,"15min":1.625},"min":{"1min":1.012,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.6699999999999999,"15min":1.712},"min":{"1min":0.94099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.5289999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.613,"15min":1.641},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.5129999999999999,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.413}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":733941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.93500000000000005,"15min":0.91900000000000004},"min":{"1min":0.68700000000000006,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.026},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.1259999999999999,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.573}]},{"osd":2,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.468}]},{"osd":3,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0860000000000001,"15min":1.0960000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.179,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.645,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.262,"15min":1.244},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.8100000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.3500000000000001,"15min":1.375},"min":{"1min":0.90200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5920000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.528}]},{"osd":5,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.415,"15min":1.4350000000000001},"min":{"1min":1.0029999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.97,"5min":3.121,"15min":3.121},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.365,"15min":1.3720000000000001},"min":{"1min":1.1479999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.778,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.6259999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4690000000000001,"15min":1.5009999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.6619999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.6759999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.528,"15min":1.5429999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.306,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.76},{"interface":"front","average":{"1min":1.389,"5min":1.4950000000000001,"15min":1.5129999999999999},"min":{"1min":1.0820000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.0710000000000002,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:31:08.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:31:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.798+0000 7f4f1d808700 1 Processor -- start 2023-11-17T06:31:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.798+0000 7f4f1d808700 1 -- start start 2023-11-17T06:31:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f180cf9e0 0x7f4f180cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180d0380 con 0x7f4f1815d1c0 2023-11-17T06:31:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f181619b0 con 0x7f4f180d1c60 2023-11-17T06:31:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180d1180 con 0x7f4f180cf9e0 2023-11-17T06:31:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f167fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f180cf9e0 0x7f4f180cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f16ffd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4f1815d1c0 0x7f4f18160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58038/0 (socket says 172.21.15.100:58038) 2023-11-17T06:31:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f16ffd700 1 -- 172.21.15.100:0/470534942 learned_addr learned my addr 172.21.15.100:0/470534942 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f167fc700 1 -- 172.21.15.100:0/470534942 >> v1:172.21.15.119:6789/0 conn(0x7f4f180d1c60 legacy=0x7f4f180d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f167fc700 1 -- 172.21.15.100:0/470534942 >> v1:172.21.15.100:6789/0 conn(0x7f4f1815d1c0 legacy=0x7f4f18160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f167fc700 1 -- 172.21.15.100:0/470534942 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180d1460 con 0x7f4f180cf9e0 2023-11-17T06:31:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f167fc700 1 --2- 172.21.15.100:0/470534942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180cf9e0 0x7f4f180cfe40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009850 tx=0x7f4f0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf27416a57db1f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f15ffb700 1 -- 172.21.15.100:0/470534942 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011830 con 0x7f4f180cf9e0 2023-11-17T06:31:08.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f15ffb700 1 -- 172.21.15.100:0/470534942 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c011990 con 0x7f4f180cf9e0 2023-11-17T06:31:08.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f15ffb700 1 -- 172.21.15.100:0/470534942 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011d20 con 0x7f4f180cf9e0 2023-11-17T06:31:08.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 -- 172.21.15.100:0/470534942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180cf9e0 msgr2=0x7f4f180cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.802+0000 7f4f1d808700 1 --2- 172.21.15.100:0/470534942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180cf9e0 0x7f4f180cfe40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009850 tx=0x7f4f0c009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:08.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 -- 172.21.15.100:0/470534942 shutdown_connections 2023-11-17T06:31:08.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 --2- 172.21.15.100:0/470534942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180cf9e0 0x7f4f180cfe40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 -- 172.21.15.100:0/470534942 >> 172.21.15.100:0/470534942 conn(0x7f4f180d2fd0 msgr2=0x7f4f180d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 -- 172.21.15.100:0/470534942 shutdown_connections 2023-11-17T06:31:08.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 -- 172.21.15.100:0/470534942 wait complete. 2023-11-17T06:31:08.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 Processor -- start 2023-11-17T06:31:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.806+0000 7f4f1d808700 1 -- start start 2023-11-17T06:31:08.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 0x7f4f181f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 0x7f4f181f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f5fb0 con 0x7f4f180d1c60 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f2f50 con 0x7f4f180cf9e0 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f3230 con 0x7f4f1815d1c0 2023-11-17T06:31:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40994/0 (socket says 172.21.15.100:40994) 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 -- 172.21.15.100:0/3502679163 learned_addr learned my addr 172.21.15.100:0/3502679163 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f16ffd700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 0x7f4f181f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f177fe700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 0x7f4f181f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 -- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 msgr2=0x7f4f181f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 0x7f4f181f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 -- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 msgr2=0x7f4f181f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 0x7f4f181f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 -- 172.21.15.100:0/3502679163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0094b0 con 0x7f4f180d1c60 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f16ffd700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 0x7f4f181f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f177fe700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 0x7f4f181f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f167fc700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806c670 tx=0x7f4f0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0038c0 con 0x7f4f180d1c60 2023-11-17T06:31:08.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c003a20 con 0x7f4f180d1c60 2023-11-17T06:31:08.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c003dd0 con 0x7f4f180d1c60 2023-11-17T06:31:08.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f181f3510 con 0x7f4f180d1c60 2023-11-17T06:31:08.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.810+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f181f37f0 con 0x7f4f180d1c60 2023-11-17T06:31:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.814+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18065e90 con 0x7f4f180d1c60 2023-11-17T06:31:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.814+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f0c01a430 con 0x7f4f180d1c60 2023-11-17T06:31:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.814+0000 7f4efffff700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 0x7f4f040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.814+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f0c021030 con 0x7f4f180d1c60 2023-11-17T06:31:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.814+0000 7f4f16ffd700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 0x7f4f040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.818+0000 7f4f16ffd700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 0x7f4f040689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007fd0 tx=0x7f4f08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.818+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f0c052c70 con 0x7f4f180d1c60 2023-11-17T06:31:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.986+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f180b6100 con 0x7f4f04066510 2023-11-17T06:31:09.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:08.998+0000 7f4efffff700 1 -- 172.21.15.100:0/3502679163 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286867 (secure 0 0 0) 0x7f4f080014f0 con 0x7f4f04066510 2023-11-17T06:31:09.007 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:09.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 msgr2=0x7f4f040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 0x7f4f040689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007fd0 tx=0x7f4f08009040 comp rx=0 tx=0).stop 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 msgr2=0x7f4f180ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806c670 tx=0x7f4f0c004770 comp rx=0 tx=0).stop 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 shutdown_connections 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f1815d1c0 0x7f4f181f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4f04066510 0x7f4f040689d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f180d1c60 0x7f4f180ccad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 --2- 172.21.15.100:0/3502679163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f180cf9e0 0x7f4f181f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 >> 172.21.15.100:0/3502679163 conn(0x7f4f180d2fd0 msgr2=0x7f4f18160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 shutdown_connections 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.002+0000 7f4f1d808700 1 -- 172.21.15.100:0/3502679163 wait complete. 2023-11-17T06:31:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:31:09.031 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-11-17T06:31:07.292701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4169728,"data_stored":2329320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.055695"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.296532+0000","last_change":"2023-11-17T06:31:02.280922+0000","last_active":"2023-11-17T06:31:02.296532+0000","last_peered":"2023-11-17T06:31:02.296532+0000","last_clean":"2023-11-17T06:31:02.296532+0000","last_became_active":"2023-11-17T06:31:02.280645+0000","last_became_peered":"2023-11-17T06:31:02.280645+0000","last_unstale":"2023-11-17T06:31:02.296532+0000","last_undegraded":"2023-11-17T06:31:02.296532+0000","last_fullsized":"2023-11-17T06:31:02.296532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.297780+0000","last_change":"2023-11-17T06:31:02.292837+0000","last_active":"2023-11-17T06:31:02.297780+0000","last_peered":"2023-11-17T06:31:02.297780+0000","last_clean":"2023-11-17T06:31:02.297780+0000","last_became_active":"2023-11-17T06:31:02.290578+0000","last_became_peered":"2023-11-17T06:31:02.290578+0000","last_unstale":"2023-11-17T06:31:02.297780+0000","last_undegraded":"2023-11-17T06:31:02.297780+0000","last_fullsized":"2023-11-17T06:31:02.297780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:33.925804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298211+0000","last_change":"2023-11-17T06:31:02.295051+0000","last_active":"2023-11-17T06:31:02.298211+0000","last_peered":"2023-11-17T06:31:02.298211+0000","last_clean":"2023-11-17T06:31:02.298211+0000","last_became_active":"2023-11-17T06:31:02.291109+0000","last_became_peered":"2023-11-17T06:31:02.291109+0000","last_unstale":"2023-11-17T06:31:02.298211+0000","last_undegraded":"2023-11-17T06:31:02.298211+0000","last_fullsized":"2023-11-17T06:31:02.298211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:01.559062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309211+0000","last_change":"2023-11-17T06:31:02.292264+0000","last_active":"2023-11-17T06:31:02.309211+0000","last_peered":"2023-11-17T06:31:02.309211+0000","last_clean":"2023-11-17T06:31:02.309211+0000","last_became_active":"2023-11-17T06:31:02.291970+0000","last_became_peered":"2023-11-17T06:31:02.291970+0000","last_unstale":"2023-11-17T06:31:02.309211+0000","last_undegraded":"2023-11-17T06:31:02.309211+0000","last_fullsized":"2023-11-17T06:31:02.309211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:38.294973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289452+0000","last_change":"2023-11-17T06:31:02.283284+0000","last_active":"2023-11-17T06:31:02.289452+0000","last_peered":"2023-11-17T06:31:02.289452+0000","last_clean":"2023-11-17T06:31:02.289452+0000","last_became_active":"2023-11-17T06:31:02.282933+0000","last_became_peered":"2023-11-17T06:31:02.282933+0000","last_unstale":"2023-11-17T06:31:02.289452+0000","last_undegraded":"2023-11-17T06:31:02.289452+0000","last_fullsized":"2023-11-17T06:31:02.289452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:23.582328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.274084+0000","last_change":"2023-11-17T06:31:02.270593+0000","last_active":"2023-11-17T06:31:02.274084+0000","last_peered":"2023-11-17T06:31:02.274084+0000","last_clean":"2023-11-17T06:31:02.274084+0000","last_became_active":"2023-11-17T06:31:02.270268+0000","last_became_peered":"2023-11-17T06:31:02.270268+0000","last_unstale":"2023-11-17T06:31:02.274084+0000","last_undegraded":"2023-11-17T06:31:02.274084+0000","last_fullsized":"2023-11-17T06:31:02.274084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294314+0000","last_change":"2023-11-17T06:31:02.288496+0000","last_active":"2023-11-17T06:31:02.294314+0000","last_peered":"2023-11-17T06:31:02.294314+0000","last_clean":"2023-11-17T06:31:02.294314+0000","last_became_active":"2023-11-17T06:31:02.288153+0000","last_became_peered":"2023-11-17T06:31:02.288153+0000","last_unstale":"2023-11-17T06:31:02.294314+0000","last_undegraded":"2023-11-17T06:31:02.294314+0000","last_fullsized":"2023-11-17T06:31:02.294314+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:45.827681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283344+0000","last_change":"2023-11-17T06:31:02.278501+0000","last_active":"2023-11-17T06:31:02.283344+0000","last_peered":"2023-11-17T06:31:02.283344+0000","last_clean":"2023-11-17T06:31:02.283344+0000","last_became_active":"2023-11-17T06:31:02.276955+0000","last_became_peered":"2023-11-17T06:31:02.276955+0000","last_unstale":"2023-11-17T06:31:02.283344+0000","last_undegraded":"2023-11-17T06:31:02.283344+0000","last_fullsized":"2023-11-17T06:31:02.283344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:12.421188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310748+0000","last_change":"2023-11-17T06:31:02.309765+0000","last_active":"2023-11-17T06:31:02.310748+0000","last_peered":"2023-11-17T06:31:02.310748+0000","last_clean":"2023-11-17T06:31:02.310748+0000","last_became_active":"2023-11-17T06:31:02.309552+0000","last_became_peered":"2023-11-17T06:31:02.309552+0000","last_unstale":"2023-11-17T06:31:02.310748+0000","last_undegraded":"2023-11-17T06:31:02.310748+0000","last_fullsized":"2023-11-17T06:31:02.310748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:23.582328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304863+0000","last_change":"2023-11-17T06:31:02.286820+0000","last_active":"2023-11-17T06:31:02.304863+0000","last_peered":"2023-11-17T06:31:02.304863+0000","last_clean":"2023-11-17T06:31:02.304863+0000","last_became_active":"2023-11-17T06:31:02.286532+0000","last_became_peered":"2023-11-17T06:31:02.286532+0000","last_unstale":"2023-11-17T06:31:02.304863+0000","last_undegraded":"2023-11-17T06:31:02.304863+0000","last_fullsized":"2023-11-17T06:31:02.304863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306569+0000","last_change":"2023-11-17T06:31:02.305695+0000","last_active":"2023-11-17T06:31:02.306569+0000","last_peered":"2023-11-17T06:31:02.306569+0000","last_clean":"2023-11-17T06:31:02.306569+0000","last_became_active":"2023-11-17T06:31:02.305359+0000","last_became_peered":"2023-11-17T06:31:02.305359+0000","last_unstale":"2023-11-17T06:31:02.306569+0000","last_undegraded":"2023-11-17T06:31:02.306569+0000","last_fullsized":"2023-11-17T06:31:02.306569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:33.925804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283099+0000","last_change":"2023-11-17T06:31:02.281007+0000","last_active":"2023-11-17T06:31:02.283099+0000","last_peered":"2023-11-17T06:31:02.283099+0000","last_clean":"2023-11-17T06:31:02.283099+0000","last_became_active":"2023-11-17T06:31:02.280743+0000","last_became_peered":"2023-11-17T06:31:02.280743+0000","last_unstale":"2023-11-17T06:31:02.283099+0000","last_undegraded":"2023-11-17T06:31:02.283099+0000","last_fullsized":"2023-11-17T06:31:02.283099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299851+0000","last_change":"2023-11-17T06:31:02.294172+0000","last_active":"2023-11-17T06:31:02.299851+0000","last_peered":"2023-11-17T06:31:02.299851+0000","last_clean":"2023-11-17T06:31:02.299851+0000","last_became_active":"2023-11-17T06:31:02.293845+0000","last_became_peered":"2023-11-17T06:31:02.293845+0000","last_unstale":"2023-11-17T06:31:02.299851+0000","last_undegraded":"2023-11-17T06:31:02.299851+0000","last_fullsized":"2023-11-17T06:31:02.299851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:40:01.224408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285257+0000","last_change":"2023-11-17T06:31:02.280262+0000","last_active":"2023-11-17T06:31:02.285257+0000","last_peered":"2023-11-17T06:31:02.285257+0000","last_clean":"2023-11-17T06:31:02.285257+0000","last_became_active":"2023-11-17T06:31:02.279896+0000","last_became_peered":"2023-11-17T06:31:02.279896+0000","last_unstale":"2023-11-17T06:31:02.285257+0000","last_undegraded":"2023-11-17T06:31:02.285257+0000","last_fullsized":"2023-11-17T06:31:02.285257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289363+0000","last_change":"2023-11-17T06:31:02.284721+0000","last_active":"2023-11-17T06:31:02.289363+0000","last_peered":"2023-11-17T06:31:02.289363+0000","last_clean":"2023-11-17T06:31:02.289363+0000","last_became_active":"2023-11-17T06:31:02.284385+0000","last_became_peered":"2023-11-17T06:31:02.284385+0000","last_unstale":"2023-11-17T06:31:02.289363+0000","last_undegraded":"2023-11-17T06:31:02.289363+0000","last_fullsized":"2023-11-17T06:31:02.289363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:22.800061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290422+0000","last_change":"2023-11-17T06:31:02.281653+0000","last_active":"2023-11-17T06:31:02.290422+0000","last_peered":"2023-11-17T06:31:02.290422+0000","last_clean":"2023-11-17T06:31:02.290422+0000","last_became_active":"2023-11-17T06:31:02.281380+0000","last_became_peered":"2023-11-17T06:31:02.281380+0000","last_unstale":"2023-11-17T06:31:02.290422+0000","last_undegraded":"2023-11-17T06:31:02.290422+0000","last_fullsized":"2023-11-17T06:31:02.290422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:22.800061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290832+0000","last_change":"2023-11-17T06:31:02.283321+0000","last_active":"2023-11-17T06:31:02.290832+0000","last_peered":"2023-11-17T06:31:02.290832+0000","last_clean":"2023-11-17T06:31:02.290832+0000","last_became_active":"2023-11-17T06:31:02.283066+0000","last_became_peered":"2023-11-17T06:31:02.283066+0000","last_unstale":"2023-11-17T06:31:02.290832+0000","last_undegraded":"2023-11-17T06:31:02.290832+0000","last_fullsized":"2023-11-17T06:31:02.290832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294506+0000","last_change":"2023-11-17T06:31:02.291122+0000","last_active":"2023-11-17T06:31:02.294506+0000","last_peered":"2023-11-17T06:31:02.294506+0000","last_clean":"2023-11-17T06:31:02.294506+0000","last_became_active":"2023-11-17T06:31:02.290234+0000","last_became_peered":"2023-11-17T06:31:02.290234+0000","last_unstale":"2023-11-17T06:31:02.294506+0000","last_undegraded":"2023-11-17T06:31:02.294506+0000","last_fullsized":"2023-11-17T06:31:02.294506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:03:46.723791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298708+0000","last_change":"2023-11-17T06:31:02.292041+0000","last_active":"2023-11-17T06:31:02.298708+0000","last_peered":"2023-11-17T06:31:02.298708+0000","last_clean":"2023-11-17T06:31:02.298708+0000","last_became_active":"2023-11-17T06:31:02.291670+0000","last_became_peered":"2023-11-17T06:31:02.291670+0000","last_unstale":"2023-11-17T06:31:02.298708+0000","last_undegraded":"2023-11-17T06:31:02.298708+0000","last_fullsized":"2023-11-17T06:31:02.298708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285058+0000","last_change":"2023-11-17T06:31:02.280573+0000","last_active":"2023-11-17T06:31:02.285058+0000","last_peered":"2023-11-17T06:31:02.285058+0000","last_clean":"2023-11-17T06:31:02.285058+0000","last_became_active":"2023-11-17T06:31:02.277139+0000","last_became_peered":"2023-11-17T06:31:02.277139+0000","last_unstale":"2023-11-17T06:31:02.285058+0000","last_undegraded":"2023-11-17T06:31:02.285058+0000","last_fullsized":"2023-11-17T06:31:02.285058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:12.196986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298996+0000","last_change":"2023-11-17T06:31:02.291861+0000","last_active":"2023-11-17T06:31:02.298996+0000","last_peered":"2023-11-17T06:31:02.298996+0000","last_clean":"2023-11-17T06:31:02.298996+0000","last_became_active":"2023-11-17T06:31:02.291578+0000","last_became_peered":"2023-11-17T06:31:02.291578+0000","last_unstale":"2023-11-17T06:31:02.298996+0000","last_undegraded":"2023-11-17T06:31:02.298996+0000","last_fullsized":"2023-11-17T06:31:02.298996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:25:17.758145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.301014+0000","last_change":"2023-11-17T06:31:02.292425+0000","last_active":"2023-11-17T06:31:02.301014+0000","last_peered":"2023-11-17T06:31:02.301014+0000","last_clean":"2023-11-17T06:31:02.301014+0000","last_became_active":"2023-11-17T06:31:02.292148+0000","last_became_peered":"2023-11-17T06:31:02.292148+0000","last_unstale":"2023-11-17T06:31:02.301014+0000","last_undegraded":"2023-11-17T06:31:02.301014+0000","last_fullsized":"2023-11-17T06:31:02.301014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:42:17.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.288834+0000","last_change":"2023-11-17T06:31:02.282869+0000","last_active":"2023-11-17T06:31:02.288834+0000","last_peered":"2023-11-17T06:31:02.288834+0000","last_clean":"2023-11-17T06:31:02.288834+0000","last_became_active":"2023-11-17T06:31:02.282557+0000","last_became_peered":"2023-11-17T06:31:02.282557+0000","last_unstale":"2023-11-17T06:31:02.288834+0000","last_undegraded":"2023-11-17T06:31:02.288834+0000","last_fullsized":"2023-11-17T06:31:02.288834+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281723+0000","last_change":"2023-11-17T06:31:02.279045+0000","last_active":"2023-11-17T06:31:02.281723+0000","last_peered":"2023-11-17T06:31:02.281723+0000","last_clean":"2023-11-17T06:31:02.281723+0000","last_became_active":"2023-11-17T06:31:02.278599+0000","last_became_peered":"2023-11-17T06:31:02.278599+0000","last_unstale":"2023-11-17T06:31:02.281723+0000","last_undegraded":"2023-11-17T06:31:02.281723+0000","last_fullsized":"2023-11-17T06:31:02.281723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:45.827681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309089+0000","last_change":"2023-11-17T06:31:02.289960+0000","last_active":"2023-11-17T06:31:02.309089+0000","last_peered":"2023-11-17T06:31:02.309089+0000","last_clean":"2023-11-17T06:31:02.309089+0000","last_became_active":"2023-11-17T06:31:02.289674+0000","last_became_peered":"2023-11-17T06:31:02.289674+0000","last_unstale":"2023-11-17T06:31:02.309089+0000","last_undegraded":"2023-11-17T06:31:02.309089+0000","last_fullsized":"2023-11-17T06:31:02.309089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:41.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280448+0000","last_change":"2023-11-17T06:31:02.273266+0000","last_active":"2023-11-17T06:31:02.280448+0000","last_peered":"2023-11-17T06:31:02.280448+0000","last_clean":"2023-11-17T06:31:02.280448+0000","last_became_active":"2023-11-17T06:31:02.272927+0000","last_became_peered":"2023-11-17T06:31:02.272927+0000","last_unstale":"2023-11-17T06:31:02.280448+0000","last_undegraded":"2023-11-17T06:31:02.280448+0000","last_fullsized":"2023-11-17T06:31:02.280448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:28:50.456809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309093+0000","last_change":"2023-11-17T06:31:02.290131+0000","last_active":"2023-11-17T06:31:02.309093+0000","last_peered":"2023-11-17T06:31:02.309093+0000","last_clean":"2023-11-17T06:31:02.309093+0000","last_became_active":"2023-11-17T06:31:02.289878+0000","last_became_peered":"2023-11-17T06:31:02.289878+0000","last_unstale":"2023-11-17T06:31:02.309093+0000","last_undegraded":"2023-11-17T06:31:02.309093+0000","last_fullsized":"2023-11-17T06:31:02.309093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:14.552355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294928+0000","last_change":"2023-11-17T06:31:02.291937+0000","last_active":"2023-11-17T06:31:02.294928+0000","last_peered":"2023-11-17T06:31:02.294928+0000","last_clean":"2023-11-17T06:31:02.294928+0000","last_became_active":"2023-11-17T06:31:02.291672+0000","last_became_peered":"2023-11-17T06:31:02.291672+0000","last_unstale":"2023-11-17T06:31:02.294928+0000","last_undegraded":"2023-11-17T06:31:02.294928+0000","last_fullsized":"2023-11-17T06:31:02.294928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289240+0000","last_change":"2023-11-17T06:31:02.286467+0000","last_active":"2023-11-17T06:31:02.289240+0000","last_peered":"2023-11-17T06:31:02.289240+0000","last_clean":"2023-11-17T06:31:02.289240+0000","last_became_active":"2023-11-17T06:31:02.286176+0000","last_became_peered":"2023-11-17T06:31:02.286176+0000","last_unstale":"2023-11-17T06:31:02.289240+0000","last_undegraded":"2023-11-17T06:31:02.289240+0000","last_fullsized":"2023-11-17T06:31:02.289240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:02.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290418+0000","last_change":"2023-11-17T06:31:02.280116+0000","last_active":"2023-11-17T06:31:02.290418+0000","last_peered":"2023-11-17T06:31:02.290418+0000","last_clean":"2023-11-17T06:31:02.290418+0000","last_became_active":"2023-11-17T06:31:02.279799+0000","last_became_peered":"2023-11-17T06:31:02.279799+0000","last_unstale":"2023-11-17T06:31:02.290418+0000","last_undegraded":"2023-11-17T06:31:02.290418+0000","last_fullsized":"2023-11-17T06:31:02.290418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295243+0000","last_change":"2023-11-17T06:31:02.277794+0000","last_active":"2023-11-17T06:31:02.295243+0000","last_peered":"2023-11-17T06:31:02.295243+0000","last_clean":"2023-11-17T06:31:02.295243+0000","last_became_active":"2023-11-17T06:31:02.277507+0000","last_became_peered":"2023-11-17T06:31:02.277507+0000","last_unstale":"2023-11-17T06:31:02.295243+0000","last_undegraded":"2023-11-17T06:31:02.295243+0000","last_fullsized":"2023-11-17T06:31:02.295243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295453+0000","last_change":"2023-11-17T06:31:02.291452+0000","last_active":"2023-11-17T06:31:02.295453+0000","last_peered":"2023-11-17T06:31:02.295453+0000","last_clean":"2023-11-17T06:31:02.295453+0000","last_became_active":"2023-11-17T06:31:02.291162+0000","last_became_peered":"2023-11-17T06:31:02.291162+0000","last_unstale":"2023-11-17T06:31:02.295453+0000","last_undegraded":"2023-11-17T06:31:02.295453+0000","last_fullsized":"2023-11-17T06:31:02.295453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:01.559062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.302846+0000","last_change":"2023-11-17T06:31:02.296352+0000","last_active":"2023-11-17T06:31:02.302846+0000","last_peered":"2023-11-17T06:31:02.302846+0000","last_clean":"2023-11-17T06:31:02.302846+0000","last_became_active":"2023-11-17T06:31:02.296045+0000","last_became_peered":"2023-11-17T06:31:02.296045+0000","last_unstale":"2023-11-17T06:31:02.302846+0000","last_undegraded":"2023-11-17T06:31:02.302846+0000","last_fullsized":"2023-11-17T06:31:02.302846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305994+0000","last_change":"2023-11-17T06:31:01.253532+0000","last_active":"2023-11-17T06:31:02.305994+0000","last_peered":"2023-11-17T06:31:02.305994+0000","last_clean":"2023-11-17T06:31:02.305994+0000","last_became_active":"2023-11-17T06:31:01.253239+0000","last_became_peered":"2023-11-17T06:31:01.253239+0000","last_unstale":"2023-11-17T06:31:02.305994+0000","last_undegraded":"2023-11-17T06:31:02.305994+0000","last_fullsized":"2023-11-17T06:31:02.305994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:37.284444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299489+0000","last_change":"2023-11-17T06:31:02.289483+0000","last_active":"2023-11-17T06:31:02.299489+0000","last_peered":"2023-11-17T06:31:02.299489+0000","last_clean":"2023-11-17T06:31:02.299489+0000","last_became_active":"2023-11-17T06:31:02.289167+0000","last_became_peered":"2023-11-17T06:31:02.289167+0000","last_unstale":"2023-11-17T06:31:02.299489+0000","last_undegraded":"2023-11-17T06:31:02.299489+0000","last_fullsized":"2023-11-17T06:31:02.299489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304769+0000","last_change":"2023-11-17T06:31:01.269875+0000","last_active":"2023-11-17T06:31:02.304769+0000","last_peered":"2023-11-17T06:31:02.304769+0000","last_clean":"2023-11-17T06:31:02.304769+0000","last_became_active":"2023-11-17T06:31:01.269401+0000","last_became_peered":"2023-11-17T06:31:01.269401+0000","last_unstale":"2023-11-17T06:31:02.304769+0000","last_undegraded":"2023-11-17T06:31:02.304769+0000","last_fullsized":"2023-11-17T06:31:02.304769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:51:37.284444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290825+0000","last_change":"2023-11-17T06:31:02.288737+0000","last_active":"2023-11-17T06:31:02.290825+0000","last_peered":"2023-11-17T06:31:02.290825+0000","last_clean":"2023-11-17T06:31:02.290825+0000","last_became_active":"2023-11-17T06:31:02.287281+0000","last_became_peered":"2023-11-17T06:31:02.287281+0000","last_unstale":"2023-11-17T06:31:02.290825+0000","last_undegraded":"2023-11-17T06:31:02.290825+0000","last_fullsized":"2023-11-17T06:31:02.290825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:26:46.326075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310859+0000","last_change":"2023-11-17T06:31:01.269957+0000","last_active":"2023-11-17T06:31:02.310859+0000","last_peered":"2023-11-17T06:31:02.310859+0000","last_clean":"2023-11-17T06:31:02.310859+0000","last_became_active":"2023-11-17T06:31:01.269682+0000","last_became_peered":"2023-11-17T06:31:01.269682+0000","last_unstale":"2023-11-17T06:31:02.310859+0000","last_undegraded":"2023-11-17T06:31:02.310859+0000","last_fullsized":"2023-11-17T06:31:02.310859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:03:21.789531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309114+0000","last_change":"2023-11-17T06:31:02.290642+0000","last_active":"2023-11-17T06:31:02.309114+0000","last_peered":"2023-11-17T06:31:02.309114+0000","last_clean":"2023-11-17T06:31:02.309114+0000","last_became_active":"2023-11-17T06:31:02.289548+0000","last_became_peered":"2023-11-17T06:31:02.289548+0000","last_unstale":"2023-11-17T06:31:02.309114+0000","last_undegraded":"2023-11-17T06:31:02.309114+0000","last_fullsized":"2023-11-17T06:31:02.309114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310303+0000","last_change":"2023-11-17T06:31:01.268547+0000","last_active":"2023-11-17T06:31:02.310303+0000","last_peered":"2023-11-17T06:31:02.310303+0000","last_clean":"2023-11-17T06:31:02.310303+0000","last_became_active":"2023-11-17T06:31:01.268264+0000","last_became_peered":"2023-11-17T06:31:01.268264+0000","last_unstale":"2023-11-17T06:31:02.310303+0000","last_undegraded":"2023-11-17T06:31:02.310303+0000","last_fullsized":"2023-11-17T06:31:02.310303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:26:45.315545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295458+0000","last_change":"2023-11-17T06:31:02.292766+0000","last_active":"2023-11-17T06:31:02.295458+0000","last_peered":"2023-11-17T06:31:02.295458+0000","last_clean":"2023-11-17T06:31:02.295458+0000","last_became_active":"2023-11-17T06:31:02.291147+0000","last_became_peered":"2023-11-17T06:31:02.291147+0000","last_unstale":"2023-11-17T06:31:02.295458+0000","last_undegraded":"2023-11-17T06:31:02.295458+0000","last_fullsized":"2023-11-17T06:31:02.295458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:03.470944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306933+0000","last_change":"2023-11-17T06:31:01.269863+0000","last_active":"2023-11-17T06:31:02.306933+0000","last_peered":"2023-11-17T06:31:02.306933+0000","last_clean":"2023-11-17T06:31:02.306933+0000","last_became_active":"2023-11-17T06:31:01.269633+0000","last_became_peered":"2023-11-17T06:31:01.269633+0000","last_unstale":"2023-11-17T06:31:02.306933+0000","last_undegraded":"2023-11-17T06:31:02.306933+0000","last_fullsized":"2023-11-17T06:31:02.306933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:35.854946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295210+0000","last_change":"2023-11-17T06:31:02.292765+0000","last_active":"2023-11-17T06:31:02.295210+0000","last_peered":"2023-11-17T06:31:02.295210+0000","last_clean":"2023-11-17T06:31:02.295210+0000","last_became_active":"2023-11-17T06:31:02.292500+0000","last_became_peered":"2023-11-17T06:31:02.292500+0000","last_unstale":"2023-11-17T06:31:02.295210+0000","last_undegraded":"2023-11-17T06:31:02.295210+0000","last_fullsized":"2023-11-17T06:31:02.295210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:46.078201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306916+0000","last_change":"2023-11-17T06:31:01.269941+0000","last_active":"2023-11-17T06:31:02.306916+0000","last_peered":"2023-11-17T06:31:02.306916+0000","last_clean":"2023-11-17T06:31:02.306916+0000","last_became_active":"2023-11-17T06:31:01.269579+0000","last_became_peered":"2023-11-17T06:31:01.269579+0000","last_unstale":"2023-11-17T06:31:02.306916+0000","last_undegraded":"2023-11-17T06:31:02.306916+0000","last_fullsized":"2023-11-17T06:31:02.306916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305585+0000","last_change":"2023-11-17T06:31:02.300349+0000","last_active":"2023-11-17T06:31:02.305585+0000","last_peered":"2023-11-17T06:31:02.305585+0000","last_clean":"2023-11-17T06:31:02.305585+0000","last_became_active":"2023-11-17T06:31:02.297981+0000","last_became_peered":"2023-11-17T06:31:02.297981+0000","last_unstale":"2023-11-17T06:31:02.305585+0000","last_undegraded":"2023-11-17T06:31:02.305585+0000","last_fullsized":"2023-11-17T06:31:02.305585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:13:54.750953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261737+0000","last_change":"2023-11-17T06:31:01.264612+0000","last_active":"2023-11-17T06:31:02.261737+0000","last_peered":"2023-11-17T06:31:02.261737+0000","last_clean":"2023-11-17T06:31:02.261737+0000","last_became_active":"2023-11-17T06:31:01.264319+0000","last_became_peered":"2023-11-17T06:31:01.264319+0000","last_unstale":"2023-11-17T06:31:02.261737+0000","last_undegraded":"2023-11-17T06:31:02.261737+0000","last_fullsized":"2023-11-17T06:31:02.261737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:00.548532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308988+0000","last_change":"2023-11-17T06:31:02.288772+0000","last_active":"2023-11-17T06:31:02.308988+0000","last_peered":"2023-11-17T06:31:02.308988+0000","last_clean":"2023-11-17T06:31:02.308988+0000","last_became_active":"2023-11-17T06:31:02.285563+0000","last_became_peered":"2023-11-17T06:31:02.285563+0000","last_unstale":"2023-11-17T06:31:02.308988+0000","last_undegraded":"2023-11-17T06:31:02.308988+0000","last_fullsized":"2023-11-17T06:31:02.308988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281006+0000","last_change":"2023-11-17T06:31:01.267568+0000","last_active":"2023-11-17T06:31:02.281006+0000","last_peered":"2023-11-17T06:31:02.281006+0000","last_clean":"2023-11-17T06:31:02.281006+0000","last_became_active":"2023-11-17T06:31:01.267299+0000","last_became_peered":"2023-11-17T06:31:01.267299+0000","last_unstale":"2023-11-17T06:31:02.281006+0000","last_undegraded":"2023-11-17T06:31:02.281006+0000","last_fullsized":"2023-11-17T06:31:02.281006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.275018+0000","last_change":"2023-11-17T06:31:02.270524+0000","last_active":"2023-11-17T06:31:02.275018+0000","last_peered":"2023-11-17T06:31:02.275018+0000","last_clean":"2023-11-17T06:31:02.275018+0000","last_became_active":"2023-11-17T06:31:02.270006+0000","last_became_peered":"2023-11-17T06:31:02.270006+0000","last_unstale":"2023-11-17T06:31:02.275018+0000","last_undegraded":"2023-11-17T06:31:02.275018+0000","last_fullsized":"2023-11-17T06:31:02.275018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:12.421188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.263979+0000","last_change":"2023-11-17T06:31:01.271783+0000","last_active":"2023-11-17T06:31:02.263979+0000","last_peered":"2023-11-17T06:31:02.263979+0000","last_clean":"2023-11-17T06:31:02.263979+0000","last_became_active":"2023-11-17T06:31:01.271507+0000","last_became_peered":"2023-11-17T06:31:01.271507+0000","last_unstale":"2023-11-17T06:31:02.263979+0000","last_undegraded":"2023-11-17T06:31:02.263979+0000","last_fullsized":"2023-11-17T06:31:02.263979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:22.908906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308912+0000","last_change":"2023-11-17T06:31:02.306108+0000","last_active":"2023-11-17T06:31:02.308912+0000","last_peered":"2023-11-17T06:31:02.308912+0000","last_clean":"2023-11-17T06:31:02.308912+0000","last_became_active":"2023-11-17T06:31:02.305802+0000","last_became_peered":"2023-11-17T06:31:02.305802+0000","last_unstale":"2023-11-17T06:31:02.308912+0000","last_undegraded":"2023-11-17T06:31:02.308912+0000","last_fullsized":"2023-11-17T06:31:02.308912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:03:24.368603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.284257+0000","last_change":"2023-11-17T06:31:01.262661+0000","last_active":"2023-11-17T06:31:02.284257+0000","last_peered":"2023-11-17T06:31:02.284257+0000","last_clean":"2023-11-17T06:31:02.284257+0000","last_became_active":"2023-11-17T06:31:01.261946+0000","last_became_peered":"2023-11-17T06:31:01.261946+0000","last_unstale":"2023-11-17T06:31:02.284257+0000","last_undegraded":"2023-11-17T06:31:02.284257+0000","last_fullsized":"2023-11-17T06:31:02.284257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.282339+0000","last_change":"2023-11-17T06:31:02.272986+0000","last_active":"2023-11-17T06:31:02.282339+0000","last_peered":"2023-11-17T06:31:02.282339+0000","last_clean":"2023-11-17T06:31:02.282339+0000","last_became_active":"2023-11-17T06:31:02.271558+0000","last_became_peered":"2023-11-17T06:31:02.271558+0000","last_unstale":"2023-11-17T06:31:02.282339+0000","last_undegraded":"2023-11-17T06:31:02.282339+0000","last_fullsized":"2023-11-17T06:31:02.282339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.306599+0000","last_change":"2023-11-17T06:31:01.269272+0000","last_active":"2023-11-17T06:31:02.306599+0000","last_peered":"2023-11-17T06:31:02.306599+0000","last_clean":"2023-11-17T06:31:02.306599+0000","last_became_active":"2023-11-17T06:31:01.268932+0000","last_became_peered":"2023-11-17T06:31:01.268932+0000","last_unstale":"2023-11-17T06:31:02.306599+0000","last_undegraded":"2023-11-17T06:31:02.306599+0000","last_fullsized":"2023-11-17T06:31:02.306599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:32.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.301627+0000","last_change":"2023-11-17T06:31:02.296334+0000","last_active":"2023-11-17T06:31:02.301627+0000","last_peered":"2023-11-17T06:31:02.301627+0000","last_clean":"2023-11-17T06:31:02.301627+0000","last_became_active":"2023-11-17T06:31:02.296055+0000","last_became_peered":"2023-11-17T06:31:02.296055+0000","last_unstale":"2023-11-17T06:31:02.301627+0000","last_undegraded":"2023-11-17T06:31:02.301627+0000","last_fullsized":"2023-11-17T06:31:02.301627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.314739+0000","last_change":"2023-11-17T06:31:01.266867+0000","last_active":"2023-11-17T06:31:02.314739+0000","last_peered":"2023-11-17T06:31:02.314739+0000","last_clean":"2023-11-17T06:31:02.314739+0000","last_became_active":"2023-11-17T06:31:01.266610+0000","last_became_peered":"2023-11-17T06:31:01.266610+0000","last_unstale":"2023-11-17T06:31:02.314739+0000","last_undegraded":"2023-11-17T06:31:02.314739+0000","last_fullsized":"2023-11-17T06:31:02.314739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:02.460414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.304767+0000","last_change":"2023-11-17T06:31:02.287152+0000","last_active":"2023-11-17T06:31:02.304767+0000","last_peered":"2023-11-17T06:31:02.304767+0000","last_clean":"2023-11-17T06:31:02.304767+0000","last_became_active":"2023-11-17T06:31:02.284279+0000","last_became_peered":"2023-11-17T06:31:02.284279+0000","last_unstale":"2023-11-17T06:31:02.304767+0000","last_undegraded":"2023-11-17T06:31:02.304767+0000","last_fullsized":"2023-11-17T06:31:02.304767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307179+0000","last_change":"2023-11-17T06:31:01.262985+0000","last_active":"2023-11-17T06:31:02.307179+0000","last_peered":"2023-11-17T06:31:02.307179+0000","last_clean":"2023-11-17T06:31:02.307179+0000","last_became_active":"2023-11-17T06:31:01.262690+0000","last_became_peered":"2023-11-17T06:31:01.262690+0000","last_unstale":"2023-11-17T06:31:02.307179+0000","last_undegraded":"2023-11-17T06:31:02.307179+0000","last_fullsized":"2023-11-17T06:31:02.307179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:08:24.198437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.297817+0000","last_change":"2023-11-17T06:31:02.293008+0000","last_active":"2023-11-17T06:31:02.297817+0000","last_peered":"2023-11-17T06:31:02.297817+0000","last_clean":"2023-11-17T06:31:02.297817+0000","last_became_active":"2023-11-17T06:31:02.292499+0000","last_became_peered":"2023-11-17T06:31:02.292499+0000","last_unstale":"2023-11-17T06:31:02.297817+0000","last_undegraded":"2023-11-17T06:31:02.297817+0000","last_fullsized":"2023-11-17T06:31:02.297817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:11:38.820521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280385+0000","last_change":"2023-11-17T06:31:01.267798+0000","last_active":"2023-11-17T06:31:02.280385+0000","last_peered":"2023-11-17T06:31:02.280385+0000","last_clean":"2023-11-17T06:31:02.280385+0000","last_became_active":"2023-11-17T06:31:01.267491+0000","last_became_peered":"2023-11-17T06:31:01.267491+0000","last_unstale":"2023-11-17T06:31:02.280385+0000","last_undegraded":"2023-11-17T06:31:02.280385+0000","last_fullsized":"2023-11-17T06:31:02.280385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.295434+0000","last_change":"2023-11-17T06:31:02.291440+0000","last_active":"2023-11-17T06:31:02.295434+0000","last_peered":"2023-11-17T06:31:02.295434+0000","last_clean":"2023-11-17T06:31:02.295434+0000","last_became_active":"2023-11-17T06:31:02.290784+0000","last_became_peered":"2023-11-17T06:31:02.290784+0000","last_unstale":"2023-11-17T06:31:02.295434+0000","last_undegraded":"2023-11-17T06:31:02.295434+0000","last_fullsized":"2023-11-17T06:31:02.295434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:41:22.958691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261723+0000","last_change":"2023-11-17T06:31:01.270442+0000","last_active":"2023-11-17T06:31:02.261723+0000","last_peered":"2023-11-17T06:31:02.261723+0000","last_clean":"2023-11-17T06:31:02.261723+0000","last_became_active":"2023-11-17T06:31:01.268907+0000","last_became_peered":"2023-11-17T06:31:01.268907+0000","last_unstale":"2023-11-17T06:31:02.261723+0000","last_undegraded":"2023-11-17T06:31:02.261723+0000","last_fullsized":"2023-11-17T06:31:02.261723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:44.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298269+0000","last_change":"2023-11-17T06:31:02.288031+0000","last_active":"2023-11-17T06:31:02.298269+0000","last_peered":"2023-11-17T06:31:02.298269+0000","last_clean":"2023-11-17T06:31:02.298269+0000","last_became_active":"2023-11-17T06:31:02.285502+0000","last_became_peered":"2023-11-17T06:31:02.285502+0000","last_unstale":"2023-11-17T06:31:02.298269+0000","last_undegraded":"2023-11-17T06:31:02.298269+0000","last_fullsized":"2023-11-17T06:31:02.298269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:51:04.803116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.312234+0000","last_change":"2023-11-17T06:31:01.267069+0000","last_active":"2023-11-17T06:31:02.312234+0000","last_peered":"2023-11-17T06:31:02.312234+0000","last_clean":"2023-11-17T06:31:02.312234+0000","last_became_active":"2023-11-17T06:31:01.266766+0000","last_became_peered":"2023-11-17T06:31:01.266766+0000","last_unstale":"2023-11-17T06:31:02.312234+0000","last_undegraded":"2023-11-17T06:31:02.312234+0000","last_fullsized":"2023-11-17T06:31:02.312234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:45.067672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.299473+0000","last_change":"2023-11-17T06:31:02.294553+0000","last_active":"2023-11-17T06:31:02.299473+0000","last_peered":"2023-11-17T06:31:02.299473+0000","last_clean":"2023-11-17T06:31:02.299473+0000","last_became_active":"2023-11-17T06:31:02.293947+0000","last_became_peered":"2023-11-17T06:31:02.293947+0000","last_unstale":"2023-11-17T06:31:02.299473+0000","last_undegraded":"2023-11-17T06:31:02.299473+0000","last_fullsized":"2023-11-17T06:31:02.299473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.310184+0000","last_change":"2023-11-17T06:31:01.264987+0000","last_active":"2023-11-17T06:31:02.310184+0000","last_peered":"2023-11-17T06:31:02.310184+0000","last_clean":"2023-11-17T06:31:02.310184+0000","last_became_active":"2023-11-17T06:31:01.264494+0000","last_became_peered":"2023-11-17T06:31:01.264494+0000","last_unstale":"2023-11-17T06:31:02.310184+0000","last_undegraded":"2023-11-17T06:31:02.310184+0000","last_fullsized":"2023-11-17T06:31:02.310184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:11.410659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292025+0000","last_change":"2023-11-17T06:31:02.288021+0000","last_active":"2023-11-17T06:31:02.292025+0000","last_peered":"2023-11-17T06:31:02.292025+0000","last_clean":"2023-11-17T06:31:02.292025+0000","last_became_active":"2023-11-17T06:31:02.287727+0000","last_became_peered":"2023-11-17T06:31:02.287727+0000","last_unstale":"2023-11-17T06:31:02.292025+0000","last_undegraded":"2023-11-17T06:31:02.292025+0000","last_fullsized":"2023-11-17T06:31:02.292025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:25:33.928557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307185+0000","last_change":"2023-11-17T06:31:01.262972+0000","last_active":"2023-11-17T06:31:02.307185+0000","last_peered":"2023-11-17T06:31:02.307185+0000","last_clean":"2023-11-17T06:31:02.307185+0000","last_became_active":"2023-11-17T06:31:01.262654+0000","last_became_peered":"2023-11-17T06:31:01.262654+0000","last_unstale":"2023-11-17T06:31:02.307185+0000","last_undegraded":"2023-11-17T06:31:02.307185+0000","last_fullsized":"2023-11-17T06:31:02.307185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:01.013380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309189+0000","last_change":"2023-11-17T06:31:02.290947+0000","last_active":"2023-11-17T06:31:02.309189+0000","last_peered":"2023-11-17T06:31:02.309189+0000","last_clean":"2023-11-17T06:31:02.309189+0000","last_became_active":"2023-11-17T06:31:02.290688+0000","last_became_peered":"2023-11-17T06:31:02.290688+0000","last_unstale":"2023-11-17T06:31:02.309189+0000","last_undegraded":"2023-11-17T06:31:02.309189+0000","last_fullsized":"2023-11-17T06:31:02.309189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:25.116521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.305755+0000","last_change":"2023-11-17T06:31:01.261930+0000","last_active":"2023-11-17T06:31:02.305755+0000","last_peered":"2023-11-17T06:31:02.305755+0000","last_clean":"2023-11-17T06:31:02.305755+0000","last_became_active":"2023-11-17T06:31:01.261476+0000","last_became_peered":"2023-11-17T06:31:01.261476+0000","last_unstale":"2023-11-17T06:31:02.305755+0000","last_undegraded":"2023-11-17T06:31:02.305755+0000","last_fullsized":"2023-11-17T06:31:02.305755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:21:37.344611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.281843+0000","last_change":"2023-11-17T06:31:02.275895+0000","last_active":"2023-11-17T06:31:02.281843+0000","last_peered":"2023-11-17T06:31:02.281843+0000","last_clean":"2023-11-17T06:31:02.281843+0000","last_became_active":"2023-11-17T06:31:02.275548+0000","last_became_peered":"2023-11-17T06:31:02.275548+0000","last_unstale":"2023-11-17T06:31:02.281843+0000","last_undegraded":"2023-11-17T06:31:02.281843+0000","last_fullsized":"2023-11-17T06:31:02.281843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:02.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.278357+0000","last_change":"2023-11-17T06:31:01.272092+0000","last_active":"2023-11-17T06:31:02.278357+0000","last_peered":"2023-11-17T06:31:02.278357+0000","last_clean":"2023-11-17T06:31:02.278357+0000","last_became_active":"2023-11-17T06:31:01.271817+0000","last_became_peered":"2023-11-17T06:31:01.271817+0000","last_unstale":"2023-11-17T06:31:02.278357+0000","last_undegraded":"2023-11-17T06:31:02.278357+0000","last_fullsized":"2023-11-17T06:31:02.278357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:53:02.401247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290733+0000","last_change":"2023-11-17T06:31:02.286947+0000","last_active":"2023-11-17T06:31:02.290733+0000","last_peered":"2023-11-17T06:31:02.290733+0000","last_clean":"2023-11-17T06:31:02.290733+0000","last_became_active":"2023-11-17T06:31:02.286675+0000","last_became_peered":"2023-11-17T06:31:02.286675+0000","last_unstale":"2023-11-17T06:31:02.290733+0000","last_undegraded":"2023-11-17T06:31:02.290733+0000","last_fullsized":"2023-11-17T06:31:02.290733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:24:19.588458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309865+0000","last_change":"2023-11-17T06:31:01.259254+0000","last_active":"2023-11-17T06:31:02.309865+0000","last_peered":"2023-11-17T06:31:02.309865+0000","last_clean":"2023-11-17T06:31:02.309865+0000","last_became_active":"2023-11-17T06:31:01.258766+0000","last_became_peered":"2023-11-17T06:31:01.258766+0000","last_unstale":"2023-11-17T06:31:02.309865+0000","last_undegraded":"2023-11-17T06:31:02.309865+0000","last_fullsized":"2023-11-17T06:31:02.309865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294647+0000","last_change":"2023-11-17T06:31:02.291660+0000","last_active":"2023-11-17T06:31:02.294647+0000","last_peered":"2023-11-17T06:31:02.294647+0000","last_clean":"2023-11-17T06:31:02.294647+0000","last_became_active":"2023-11-17T06:31:02.291382+0000","last_became_peered":"2023-11-17T06:31:02.291382+0000","last_unstale":"2023-11-17T06:31:02.294647+0000","last_undegraded":"2023-11-17T06:31:02.294647+0000","last_fullsized":"2023-11-17T06:31:02.294647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:04:24.025515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.271750+0000","last_change":"2023-11-17T06:31:01.266405+0000","last_active":"2023-11-17T06:31:02.271750+0000","last_peered":"2023-11-17T06:31:02.271750+0000","last_clean":"2023-11-17T06:31:02.271750+0000","last_became_active":"2023-11-17T06:31:01.266086+0000","last_became_peered":"2023-11-17T06:31:01.266086+0000","last_unstale":"2023-11-17T06:31:02.271750+0000","last_undegraded":"2023-11-17T06:31:02.271750+0000","last_fullsized":"2023-11-17T06:31:02.271750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:12:13.541825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.290590+0000","last_change":"2023-11-17T06:31:02.285784+0000","last_active":"2023-11-17T06:31:02.290590+0000","last_peered":"2023-11-17T06:31:02.290590+0000","last_clean":"2023-11-17T06:31:02.290590+0000","last_became_active":"2023-11-17T06:31:02.285438+0000","last_became_peered":"2023-11-17T06:31:02.285438+0000","last_unstale":"2023-11-17T06:31:02.290590+0000","last_undegraded":"2023-11-17T06:31:02.290590+0000","last_fullsized":"2023-11-17T06:31:02.290590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:25:17.758145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.278985+0000","last_change":"2023-11-17T06:31:01.266442+0000","last_active":"2023-11-17T06:31:02.278985+0000","last_peered":"2023-11-17T06:31:02.278985+0000","last_clean":"2023-11-17T06:31:02.278985+0000","last_became_active":"2023-11-17T06:31:01.266065+0000","last_became_peered":"2023-11-17T06:31:01.266065+0000","last_unstale":"2023-11-17T06:31:02.278985+0000","last_undegraded":"2023-11-17T06:31:02.278985+0000","last_fullsized":"2023-11-17T06:31:02.278985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:51:03.792586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.294332+0000","last_change":"2023-11-17T06:31:02.290231+0000","last_active":"2023-11-17T06:31:02.294332+0000","last_peered":"2023-11-17T06:31:02.294332+0000","last_clean":"2023-11-17T06:31:02.294332+0000","last_became_active":"2023-11-17T06:31:02.289968+0000","last_became_peered":"2023-11-17T06:31:02.289968+0000","last_unstale":"2023-11-17T06:31:02.294332+0000","last_undegraded":"2023-11-17T06:31:02.294332+0000","last_fullsized":"2023-11-17T06:31:02.294332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:10:04.438743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.266090+0000","last_change":"2023-11-17T06:31:01.265165+0000","last_active":"2023-11-17T06:31:02.266090+0000","last_peered":"2023-11-17T06:31:02.266090+0000","last_clean":"2023-11-17T06:31:02.266090+0000","last_became_active":"2023-11-17T06:31:01.264845+0000","last_became_peered":"2023-11-17T06:31:01.264845+0000","last_unstale":"2023-11-17T06:31:02.266090+0000","last_undegraded":"2023-11-17T06:31:02.266090+0000","last_fullsized":"2023-11-17T06:31:02.266090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:22:02.460414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.285032+0000","last_change":"2023-11-17T06:31:02.280425+0000","last_active":"2023-11-17T06:31:02.285032+0000","last_peered":"2023-11-17T06:31:02.285032+0000","last_clean":"2023-11-17T06:31:02.285032+0000","last_became_active":"2023-11-17T06:31:02.280156+0000","last_became_peered":"2023-11-17T06:31:02.280156+0000","last_unstale":"2023-11-17T06:31:02.285032+0000","last_undegraded":"2023-11-17T06:31:02.285032+0000","last_fullsized":"2023-11-17T06:31:02.285032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:20:36.576718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.309533+0000","last_change":"2023-11-17T06:31:01.267850+0000","last_active":"2023-11-17T06:31:02.309533+0000","last_peered":"2023-11-17T06:31:02.309533+0000","last_clean":"2023-11-17T06:31:02.309533+0000","last_became_active":"2023-11-17T06:31:01.265863+0000","last_became_peered":"2023-11-17T06:31:01.265863+0000","last_unstale":"2023-11-17T06:31:02.309533+0000","last_undegraded":"2023-11-17T06:31:02.309533+0000","last_fullsized":"2023-11-17T06:31:02.309533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:35.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.307290+0000","last_change":"2023-11-17T06:31:02.305742+0000","last_active":"2023-11-17T06:31:02.307290+0000","last_peered":"2023-11-17T06:31:02.307290+0000","last_clean":"2023-11-17T06:31:02.307290+0000","last_became_active":"2023-11-17T06:31:02.305321+0000","last_became_peered":"2023-11-17T06:31:02.305321+0000","last_unstale":"2023-11-17T06:31:02.307290+0000","last_undegraded":"2023-11-17T06:31:02.307290+0000","last_fullsized":"2023-11-17T06:31:02.307290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:48:40.672569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.284136+0000","last_change":"2023-11-17T06:31:01.253703+0000","last_active":"2023-11-17T06:31:02.284136+0000","last_peered":"2023-11-17T06:31:02.284136+0000","last_clean":"2023-11-17T06:31:02.284136+0000","last_became_active":"2023-11-17T06:31:01.253345+0000","last_became_peered":"2023-11-17T06:31:01.253345+0000","last_unstale":"2023-11-17T06:31:02.284136+0000","last_undegraded":"2023-11-17T06:31:02.284136+0000","last_fullsized":"2023-11-17T06:31:02.284136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:35:24.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.308802+0000","last_change":"2023-11-17T06:31:02.305645+0000","last_active":"2023-11-17T06:31:02.308802+0000","last_peered":"2023-11-17T06:31:02.308802+0000","last_clean":"2023-11-17T06:31:02.308802+0000","last_became_active":"2023-11-17T06:31:02.305317+0000","last_became_peered":"2023-11-17T06:31:02.305317+0000","last_unstale":"2023-11-17T06:31:02.308802+0000","last_undegraded":"2023-11-17T06:31:02.308802+0000","last_fullsized":"2023-11-17T06:31:02.308802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:02.023910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.283995+0000","last_change":"2023-11-17T06:31:01.263146+0000","last_active":"2023-11-17T06:31:02.283995+0000","last_peered":"2023-11-17T06:31:02.283995+0000","last_clean":"2023-11-17T06:31:02.283995+0000","last_became_active":"2023-11-17T06:31:01.262869+0000","last_became_peered":"2023-11-17T06:31:01.262869+0000","last_unstale":"2023-11-17T06:31:02.283995+0000","last_undegraded":"2023-11-17T06:31:02.283995+0000","last_fullsized":"2023-11-17T06:31:02.283995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:23:00.548532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.298374+0000","last_change":"2023-11-17T06:31:02.290234+0000","last_active":"2023-11-17T06:31:02.298374+0000","last_peered":"2023-11-17T06:31:02.298374+0000","last_clean":"2023-11-17T06:31:02.298374+0000","last_became_active":"2023-11-17T06:31:02.289931+0000","last_became_peered":"2023-11-17T06:31:02.289931+0000","last_unstale":"2023-11-17T06:31:02.298374+0000","last_undegraded":"2023-11-17T06:31:02.298374+0000","last_fullsized":"2023-11-17T06:31:02.298374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:53:51.915415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.279011+0000","last_change":"2023-11-17T06:31:01.251330+0000","last_active":"2023-11-17T06:31:02.279011+0000","last_peered":"2023-11-17T06:31:02.279011+0000","last_clean":"2023-11-17T06:31:02.279011+0000","last_became_active":"2023-11-17T06:31:01.250997+0000","last_became_peered":"2023-11-17T06:31:01.250997+0000","last_unstale":"2023-11-17T06:31:02.279011+0000","last_undegraded":"2023-11-17T06:31:02.279011+0000","last_fullsized":"2023-11-17T06:31:02.279011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.303217+0000","last_change":"2023-11-17T06:31:02.300098+0000","last_active":"2023-11-17T06:31:02.303217+0000","last_peered":"2023-11-17T06:31:02.303217+0000","last_clean":"2023-11-17T06:31:02.303217+0000","last_became_active":"2023-11-17T06:31:02.298662+0000","last_became_peered":"2023-11-17T06:31:02.298662+0000","last_unstale":"2023-11-17T06:31:02.303217+0000","last_undegraded":"2023-11-17T06:31:02.303217+0000","last_fullsized":"2023-11-17T06:31:02.303217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:02.461992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.280755+0000","last_change":"2023-11-17T06:31:01.255343+0000","last_active":"2023-11-17T06:31:02.280755+0000","last_peered":"2023-11-17T06:31:02.280755+0000","last_clean":"2023-11-17T06:31:02.280755+0000","last_became_active":"2023-11-17T06:31:01.255035+0000","last_became_peered":"2023-11-17T06:31:01.255035+0000","last_unstale":"2023-11-17T06:31:02.280755+0000","last_undegraded":"2023-11-17T06:31:02.280755+0000","last_fullsized":"2023-11-17T06:31:02.280755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:25:44.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292437+0000","last_change":"2023-11-17T06:31:02.287063+0000","last_active":"2023-11-17T06:31:02.292437+0000","last_peered":"2023-11-17T06:31:02.292437+0000","last_clean":"2023-11-17T06:31:02.292437+0000","last_became_active":"2023-11-17T06:31:02.284905+0000","last_became_peered":"2023-11-17T06:31:02.284905+0000","last_unstale":"2023-11-17T06:31:02.292437+0000","last_undegraded":"2023-11-17T06:31:02.292437+0000","last_fullsized":"2023-11-17T06:31:02.292437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.279117+0000","last_change":"2023-11-17T06:31:01.264123+0000","last_active":"2023-11-17T06:31:02.279117+0000","last_peered":"2023-11-17T06:31:02.279117+0000","last_clean":"2023-11-17T06:31:02.279117+0000","last_became_active":"2023-11-17T06:31:01.263780+0000","last_became_peered":"2023-11-17T06:31:01.263780+0000","last_unstale":"2023-11-17T06:31:02.279117+0000","last_undegraded":"2023-11-17T06:31:02.279117+0000","last_fullsized":"2023-11-17T06:31:02.279117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:31:01.451463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.289326+0000","last_change":"2023-11-17T06:31:02.286550+0000","last_active":"2023-11-17T06:31:02.289326+0000","last_peered":"2023-11-17T06:31:02.289326+0000","last_clean":"2023-11-17T06:31:02.289326+0000","last_became_active":"2023-11-17T06:31:02.286166+0000","last_became_peered":"2023-11-17T06:31:02.286166+0000","last_unstale":"2023-11-17T06:31:02.289326+0000","last_undegraded":"2023-11-17T06:31:02.289326+0000","last_fullsized":"2023-11-17T06:31:02.289326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:20:36.576718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.261918+0000","last_change":"2023-11-17T06:31:01.271249+0000","last_active":"2023-11-17T06:31:02.261918+0000","last_peered":"2023-11-17T06:31:02.261918+0000","last_clean":"2023-11-17T06:31:02.261918+0000","last_became_active":"2023-11-17T06:31:01.269270+0000","last_became_peered":"2023-11-17T06:31:01.269270+0000","last_unstale":"2023-11-17T06:31:02.261918+0000","last_undegraded":"2023-11-17T06:31:02.261918+0000","last_fullsized":"2023-11-17T06:31:02.261918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:07:11.410659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.292063+0000","last_change":"2023-11-17T06:31:02.282905+0000","last_active":"2023-11-17T06:31:02.292063+0000","last_peered":"2023-11-17T06:31:02.292063+0000","last_clean":"2023-11-17T06:31:02.292063+0000","last_became_active":"2023-11-17T06:31:02.282603+0000","last_became_peered":"2023-11-17T06:31:02.282603+0000","last_unstale":"2023-11-17T06:31:02.292063+0000","last_undegraded":"2023-11-17T06:31:02.292063+0000","last_fullsized":"2023-11-17T06:31:02.292063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:01.227140+0000","last_clean_scrub_stamp":"2023-11-17T06:31:01.227140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:43:36.910896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-17T06:31:02.272836+0000","last_change":"2023-11-17T06:31:01.264661+0000","last_active":"2023-11-17T06:31:02.272836+0000","last_peered":"2023-11-17T06:31:02.272836+0000","last_clean":"2023-11-17T06:31:02.272836+0000","last_became_active":"2023-11-17T06:31:01.264324+0000","last_became_peered":"2023-11-17T06:31:01.264324+0000","last_unstale":"2023-11-17T06:31:02.272836+0000","last_undegraded":"2023-11-17T06:31:02.272836+0000","last_fullsized":"2023-11-17T06:31:02.272836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:00.216611+0000","last_clean_scrub_stamp":"2023-11-17T06:31:00.216611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:11:40.578296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-17T06:31:01.263433+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:31:01.263433+0000","last_peered":"2023-11-17T06:31:01.263433+0000","last_clean":"2023-11-17T06:31:01.263433+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:31:01.263433+0000","last_undegraded":"2023-11-17T06:31:01.263433+0000","last_fullsized":"2023-11-17T06:31:01.263433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":733941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.341,"15min":1.385},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.571,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.377,"15min":1.4239999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.556,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":1.2649999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.046},{"interface":"front","average":{"1min":1.141,"5min":1.556,"15min":1.625},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.667,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":1.105}]},{"osd":2,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.379,"15min":1.4119999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.508,"5min":1.919,"15min":1.919},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.125,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3979999999999999,"5min":1.52,"15min":1.52},"last":1.21}]},{"osd":3,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.5209999999999999,"15min":1.585},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.391,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.306},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.621,"15min":1.673},"min":{"1min":0.96699999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5900000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.387}]},{"osd":4,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.264,"15min":1.288},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4950000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.343},{"interface":"front","average":{"1min":1.226,"5min":1.421,"15min":1.4530000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6439999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.4890000000000001,"15min":1.5309999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.4550000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.411,"15min":1.4379999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.587,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.429}]},{"osd":6,"last update":"Fri Nov 17 06:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.5349999999999999,"15min":1.5700000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.556,"5min":2.375,"15min":2.375},"last":1.5},{"interface":"front","average":{"1min":1.302,"5min":1.492,"15min":1.524},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.621,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4710000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.75},{"interface":"front","average":{"1min":1.089,"5min":1.1659999999999999,"15min":1.179},"min":{"1min":0.85699999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.456,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0900000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.1619999999999999,"15min":1.1719999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.464,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.266,"15min":1.2949999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.345,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.208,"15min":1.2250000000000001},"min":{"1min":0.83199999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4259999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.319,"15min":1.337},"min":{"1min":1.002,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.3839999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.355,"15min":1.3759999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5149999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.3080000000000001,"15min":1.3400000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.444,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.175}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.3120000000000001,"15min":1.3520000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4390000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.258},{"interface":"front","average":{"1min":1.226,"5min":1.4179999999999999,"15min":1.45},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.5860000000000001,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4990000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.28,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.552,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.333},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.45,"15min":1.482},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.4790000000000001,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.518,"15min":1.548},"min":{"1min":1.0409999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5289999999999999,"5min":2.548,"15min":2.548},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4850000000000001,"15min":1.5109999999999999},"min":{"1min":0.96999999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5960000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.133,"15min":1.133},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.335},{"interface":"front","average":{"1min":1.159,"5min":1.333,"15min":1.3620000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.873,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2509999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.167},{"interface":"front","average":{"1min":1.113,"5min":1.3089999999999999,"15min":1.341},"min":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9810000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.4159999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.28,"15min":1.298},"min":{"1min":0.90100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.048,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1},{"interface":"front","average":{"1min":1.198,"5min":1.3839999999999999,"15min":1.415},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.901,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.288}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4430000000000001,"15min":1.47},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.6319999999999999,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.522,"15min":1.552},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.9930000000000001,"5min":3.48,"15min":3.48},"last":1.373}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.3819999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.3380000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.448},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.5149999999999999,"15min":1.5549999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.907,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.6359999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.464,"15min":1.492},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0960000000000001,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.554,"15min":1.5840000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0800000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.5640000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.6180000000000001,"15min":1.6459999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.833,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.647,"15min":1.675},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.1459999999999999,"5min":3.355,"15min":3.355},"last":1.595}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1639999999999999,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5509999999999999,"5min":2.286,"15min":2.286},"last":0.753},{"interface":"front","average":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7370000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2090000000000001,"15min":1.2110000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.169,"15min":1.1539999999999999},"min":{"1min":0.91100000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.615,"15min":1.6930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.498,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.087},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.534,"15min":1.5920000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.8200000000000001,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.04}]},{"osd":3,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.216,"15min":1.216},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.298}]},{"osd":5,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.1779999999999999,"15min":1.1639999999999999},"min":{"1min":0.77000000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.27,"5min":1.28,"15min":1.282},"min":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.78200000000000003,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4670000000000001,"15min":1.4870000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.4489999999999998,"5min":2.681,"15min":2.681},"last":1.129}]},{"osd":7,"last update":"Fri Nov 17 06:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.331,"15min":1.355},"min":{"1min":0.86499999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.625,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.474,"15min":1.4850000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.3799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.91400000000000003,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4319999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.034},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.075,"15min":1.103},"min":{"1min":0.66100000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.556,"15min":1.556},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0569999999999999,"15min":1.0700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.159,"15min":1.175},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.246}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0840000000000001,"15min":1.0780000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.214,"15min":1.244},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.161}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.421,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.88,"15min":0.88},"max":{"1min":1.583,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.4179999999999999,"15min":1.45},"min":{"1min":0.74199999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.837,"5min":2.359,"15min":2.359},"last":1.337}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.415,"15min":1.4450000000000001},"min":{"1min":0.95799999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.716,"5min":2.375,"15min":2.375},"last":1.786},{"interface":"front","average":{"1min":1.22,"5min":1.476,"15min":1.5189999999999999},"min":{"1min":1.0469999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.474,"5min":2.202,"15min":2.202},"last":1.216}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.488,"15min":1.5169999999999999},"min":{"1min":0.98899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.8400000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.383},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5700000000000001},"min":{"1min":0.95099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.528,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.863}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.571,"15min":1.621},"min":{"1min":0.99199999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.5169999999999999,"5min":2.431,"15min":2.431},"last":1.427},{"interface":"front","average":{"1min":1.323,"5min":1.5800000000000001,"15min":1.623},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.8759999999999999,"5min":2.427,"15min":2.427},"last":1.28}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.89900000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.745},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78700000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.276,"15min":1.276},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.276,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0840000000000001,"15min":1.0980000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.1890000000000001,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1850000000000001,"15min":1.21},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.2789999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.272}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3520000000000001,"15min":1.3720000000000001},"min":{"1min":1.022,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.4710000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.208},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.27,"15min":1.2989999999999999},"min":{"1min":0.92700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.55,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.462}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.395,"15min":1.429},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.673,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.248},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4450000000000001,"15min":1.468},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.575,"5min":1.948,"15min":1.948},"last":1.3069999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.4199999999999999,"15min":1.45},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.593,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.571},{"interface":"front","average":{"1min":1.274,"5min":1.492,"15min":1.528},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.4590000000000001,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.3680000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.466,"15min":1.492},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.601,"5min":2.194,"15min":2.194},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.5629999999999999,"15min":1.5940000000000001},"min":{"1min":1.173,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.76,"5min":2.464,"15min":2.464},"last":1.512}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":143573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.034,"15min":1.018},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.7789999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.998,"15min":0.999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2150000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.079,"15min":1.0740000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.115,"15min":1.119},"min":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1840000000000002,"5min":2.262,"15min":2.262},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.3280000000000001,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.056},{"interface":"front","average":{"1min":1.079,"5min":1.3160000000000001,"15min":1.3560000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.4710000000000001,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.89800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.169,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.4430000000000001,"15min":1.4630000000000001},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.891,"5min":3.891,"15min":3.891},"last":1.7050000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.4319999999999999,"15min":1.4450000000000001},"min":{"1min":0.89200000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.5580000000000001,"15min":1.5920000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.383,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.1879999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.5329999999999999,"15min":1.5609999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.4039999999999999,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.617,"15min":1.625},"min":{"1min":1.012,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.6699999999999999,"15min":1.712},"min":{"1min":0.94099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.5289999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.613,"15min":1.641},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.5129999999999999,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.413}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":733941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.93500000000000005,"15min":0.91900000000000004},"min":{"1min":0.68700000000000006,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.026},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.1259999999999999,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.573}]},{"osd":2,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.468}]},{"osd":3,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0860000000000001,"15min":1.0960000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.179,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.645,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.262,"15min":1.244},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.8100000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.3500000000000001,"15min":1.375},"min":{"1min":0.90200000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5920000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.528}]},{"osd":5,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.415,"15min":1.4350000000000001},"min":{"1min":1.0029999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.97,"5min":3.121,"15min":3.121},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.365,"15min":1.3720000000000001},"min":{"1min":1.1479999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.778,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.6259999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4690000000000001,"15min":1.5009999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.6619999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.6759999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.528,"15min":1.5429999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.306,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.76},{"interface":"front","average":{"1min":1.389,"5min":1.4950000000000001,"15min":1.5129999999999999},"min":{"1min":1.0820000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.0710000000000002,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:31:09.036 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-17T06:31:09.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-17T06:31:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.250+0000 7f8dc2d01700 1 Processor -- start 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.250+0000 7f8dc2d01700 1 -- start start 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2d01700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8dbc143e50 0x7f8dbc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2d01700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8dbc0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2d01700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc06a5c0 con 0x7f8dbc06e560 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2d01700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc0d0920 con 0x7f8dbc143e50 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2d01700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc06a270 con 0x7f8dbc0cff50 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc14fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8dbc06e560 0x7f8dbc0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58052/0 (socket says 172.21.15.100:58052) 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc14fe700 1 -- 172.21.15.100:0/2527349706 learned_addr learned my addr 172.21.15.100:0/2527349706 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc1cff700 1 --2- 172.21.15.100:0/2527349706 >> v2:172.21.15.119:3300/0 conn(0x7f8dbc143e50 0x7f8dbc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8dbc0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624648993 0 0) 0x7f8dbc06a5c0 con 0x7f8dbc06e560 2023-11-17T06:31:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da80035d0 con 0x7f8dbc06e560 2023-11-17T06:31:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606176331 0 0) 0x7f8da80035d0 con 0x7f8dbc06e560 2023-11-17T06:31:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 msgr2=0x7f8dbc0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8dbc0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 >> v2:172.21.15.119:3300/0 conn(0x7f8dbc143e50 msgr2=0x7f8dbc06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 --2- 172.21.15.100:0/2527349706 >> v2:172.21.15.119:3300/0 conn(0x7f8dbc143e50 0x7f8dbc06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0726c0 con 0x7f8dbc06e560 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f8dac001670 con 0x7f8dbc06e560 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 >> v1:172.21.15.100:6789/0 conn(0x7f8dbc06e560 legacy=0x7f8dbc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8da8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8003ff0 0x7f8da8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da8004db0 0x7f8da8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0d0920 con 0x7f8da8004db0 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc06a270 con 0x7f8da8003ff0 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.254+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da800bb60 con 0x7f8dbc0cff50 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da8004db0 0x7f8da8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc1cff700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8da8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc14fe700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8003ff0 0x7f8da8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 -- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 msgr2=0x7f8da8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc0cff50 0x7f8da8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 -- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8003ff0 msgr2=0x7f8da8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8003ff0 0x7f8da8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 -- 172.21.15.100:0/2527349706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da80035d0 con 0x7f8da8004db0 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da8004db0 0x7f8da8005230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009fc0 tx=0x7f8da80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4981161e4dda74c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400ec30 con 0x7f8da8004db0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400f040 con 0x7f8da8004db0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc0cfd700 1 -- 172.21.15.100:0/2527349706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4014480 con 0x7f8da8004db0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2527349706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da8004db0 msgr2=0x7f8da8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2527349706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da8004db0 0x7f8da8005230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009fc0 tx=0x7f8da80058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2500700 1 -- 172.21.15.100:0/2527349706 reap_dead start 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2527349706 shutdown_connections 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2527349706 >> 172.21.15.100:0/2527349706 conn(0x7f8dbc06b560 msgr2=0x7f8dbc06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2527349706 shutdown_connections 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.258+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2527349706 wait complete. 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 Processor -- start 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 -- start start 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8004db0 0x7f8dbc13d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc13e620 0x7f8dbc13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc13eaa0 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc142f90 con 0x7f8da8004db0 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.262+0000 7f8dc2d01700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc141ef0 con 0x7f8dbc13e620 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41016/0 (socket says 172.21.15.100:41016) 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 -- 172.21.15.100:0/2937801815 learned_addr learned my addr 172.21.15.100:0/2937801815 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc2500700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc13e620 0x7f8dbc13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc1cff700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8004db0 0x7f8dbc13d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 -- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc13e620 msgr2=0x7f8dbc13fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc13e620 0x7f8dbc13fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 -- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8004db0 msgr2=0x7f8dbc13d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8004db0 0x7f8dbc13d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 -- 172.21.15.100:0/2937801815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc1421d0 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc14fe700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0010e0 tx=0x7f8dac0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00f690 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00f830 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00fbe0 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc1424b0 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc142a70 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.266+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc072c60 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.270+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8dac00fd40 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.270+0000 7f8db27fc700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 0x7f8da00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.270+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dac083da0 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.270+0000 7f8dc1cff700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 0x7f8da00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.270+0000 7f8dc1cff700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 0x7f8da00689d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0c5390 tx=0x7f8db8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.274+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8dbc072c60 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.506+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8dbc072c60 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.510+0000 7f8db27fc700 1 -- 172.21.15.100:0/2937801815 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8dbc072c60 con 0x7f8dbc0c55d0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDiB1dlK4OcDhAAo54plW+azztfHzX/6tuPbQ== 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 msgr2=0x7f8da00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 0x7f8da00689d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0c5390 tx=0x7f8db8009240 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 msgr2=0x7f8dbc13e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0010e0 tx=0x7f8dac0075f0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 shutdown_connections 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8dbc13e620 0x7f8dbc13fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8da0066510 0x7f8da00689d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dbc0c55d0 0x7f8dbc13e0e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 --2- 172.21.15.100:0/2937801815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da8004db0 0x7f8dbc13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 >> 172.21.15.100:0/2937801815 conn(0x7f8dbc06b560 msgr2=0x7f8dbc0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 shutdown_connections 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:09.514+0000 7f8dc2d01700 1 -- 172.21.15.100:0/2937801815 wait complete. 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2023-11-17T06:31:11.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.966+0000 7f3e182a8700 1 Processor -- start 2023-11-17T06:31:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.966+0000 7f3e182a8700 1 -- start start 2023-11-17T06:31:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e182a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e182a8700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100ce940 con 0x7f3e100d1ee0 2023-11-17T06:31:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e182a8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100cdd70 con 0x7f3e100d0fd0 2023-11-17T06:31:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e182a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100d41b0 con 0x7f3e1015d590 2023-11-17T06:31:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16845700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3e100d1ee0 0x7f3e100afdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36968/0 (socket says 172.21.15.100:36968) 2023-11-17T06:31:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16845700 1 -- 172.21.15.100:0/3729663258 learned_addr learned my addr 172.21.15.100:0/3729663258 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16044700 1 --2- 172.21.15.100:0/3729663258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186381191 0 0) 0x7f3e100ce940 con 0x7f3e100d1ee0 2023-11-17T06:31:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dfc0035d0 con 0x7f3e100d1ee0 2023-11-17T06:31:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624359818 0 0) 0x7f3e100cdd70 con 0x7f3e100d0fd0 2023-11-17T06:31:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e100ce940 con 0x7f3e100d0fd0 2023-11-17T06:31:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820237288 0 0) 0x7f3dfc0035d0 con 0x7f3e100d1ee0 2023-11-17T06:31:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16044700 1 -- 172.21.15.100:0/3729663258 >> v1:172.21.15.119:6789/0 conn(0x7f3e100d0fd0 legacy=0x7f3e100d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16044700 1 -- 172.21.15.100:0/3729663258 >> v1:172.21.15.100:6789/0 conn(0x7f3e100d1ee0 legacy=0x7f3e100afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16044700 1 -- 172.21.15.100:0/3729663258 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100ce010 con 0x7f3e1015d590 2023-11-17T06:31:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.970+0000 7f3e16044700 1 --2- 172.21.15.100:0/3729663258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cedd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009870 tx=0x7f3e0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4152881c1d82f5b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080019f0 con 0x7f3e1015d590 2023-11-17T06:31:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c004030 con 0x7f3e1015d590 2023-11-17T06:31:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e15042700 1 -- 172.21.15.100:0/3729663258 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0043c0 con 0x7f3e1015d590 2023-11-17T06:31:11.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 -- 172.21.15.100:0/3729663258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 msgr2=0x7f3e100cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 --2- 172.21.15.100:0/3729663258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cedd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009870 tx=0x7f3e0c009b80 comp rx=0 tx=0).stop 2023-11-17T06:31:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 -- 172.21.15.100:0/3729663258 shutdown_connections 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 --2- 172.21.15.100:0/3729663258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cedd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 -- 172.21.15.100:0/3729663258 >> 172.21.15.100:0/3729663258 conn(0x7f3e1009c560 msgr2=0x7f3e100d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 -- 172.21.15.100:0/3729663258 shutdown_connections 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.974+0000 7f3e182a8700 1 -- 172.21.15.100:0/3729663258 wait complete. 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 Processor -- start 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 -- start start 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 0x7f3e100b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c8790 con 0x7f3e100d1ee0 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100b2ff0 con 0x7f3e100d0fd0 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e182a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c7c10 con 0x7f3e1015d590 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e15843700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e15843700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46616/0 (socket says 172.21.15.100:46616) 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e15843700 1 -- 172.21.15.100:0/968150232 learned_addr learned my addr 172.21.15.100:0/968150232 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e16044700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 0x7f3e100b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.978+0000 7f3e16845700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 -- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 msgr2=0x7f3e100cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 -- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 msgr2=0x7f3e100b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 0x7f3e100b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 -- 172.21.15.100:0/968150232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009450 con 0x7f3e100d1ee0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e16044700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 0x7f3e100b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e15843700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c730 tx=0x7f3e0000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000052d0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e00005430 con 0x7f3e100d1ee0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000055a0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100c7ef0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e100c84b0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.982+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1004eea0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.986+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e000038e0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.986+0000 7f3e06ffd700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 0x7f3df40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.986+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e00083400 con 0x7f3e100d1ee0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.986+0000 7f3e16044700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 0x7f3df40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.990+0000 7f3e16044700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 0x7f3df40689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097c0 tx=0x7f3e0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:11.994+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e00050870 con 0x7f3e100d1ee0 2023-11-17T06:31:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.266+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e100d15b0 con 0x7f3e100d1ee0 2023-11-17T06:31:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.266+0000 7f3e06ffd700 1 -- 172.21.15.100:0/968150232 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3e00053e90 con 0x7f3e100d1ee0 2023-11-17T06:31:12.342 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:12.343 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:06.955546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/1192926084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":1192926084},{"type":"v1","addr":"172.21.15.119:6835","nonce":1192926084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 msgr2=0x7f3df40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 0x7f3df40689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097c0 tx=0x7f3e0c008030 comp rx=0 tx=0).stop 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 msgr2=0x7f3e100cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c730 tx=0x7f3e0000caf0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 shutdown_connections 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3e1015d590 0x7f3e100cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3df4066510 0x7f3df40689d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e100d1ee0 0x7f3e100cbdb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 --2- 172.21.15.100:0/968150232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e100d0fd0 0x7f3e100b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 >> 172.21.15.100:0/968150232 conn(0x7f3e1009c560 msgr2=0x7f3e100cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 shutdown_connections 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.270+0000 7f3e182a8700 1 -- 172.21.15.100:0/968150232 wait complete. 2023-11-17T06:31:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2023-11-17T06:31:12.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:12.354 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:12.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:31:06.955546+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5214': {'gid': 5214, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6835/1192926084', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6833', 'nonce': 1192926084}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 1192926084}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:31:12.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:31:12.750 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-17T06:31:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.934+0000 7f577bf24700 1 Processor -- start 2023-11-17T06:31:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 -- start start 2023-11-17T06:31:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5774161670 0x7f57740cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 0x7f57740cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57740ce300 con 0x7f5774161a50 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57740cb790 con 0x7f5774161670 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.938+0000 7f577bf24700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740cdb30 con 0x7f57740b1150 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 0x7f57740cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f57794bf700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5774161a50 0x7f57740b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:33892/0 (socket says 172.21.15.100:33892) 2023-11-17T06:31:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f5779cc0700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5774161670 0x7f57740cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f57794bf700 1 -- 172.21.15.100:0/2865366931 learned_addr learned my addr 172.21.15.100:0/2865366931 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 -- 172.21.15.100:0/2865366931 >> v2:172.21.15.119:3300/0 conn(0x7f5774161670 msgr2=0x7f57740cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 --2- 172.21.15.100:0/2865366931 >> v2:172.21.15.119:3300/0 conn(0x7f5774161670 0x7f57740cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 -- 172.21.15.100:0/2865366931 >> v1:172.21.15.119:6789/0 conn(0x7f5774161a50 legacy=0x7f57740b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 -- 172.21.15.100:0/2865366931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740ce500 con 0x7f57740b1150 2023-11-17T06:31:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577a4c1700 1 --2- 172.21.15.100:0/2865366931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 0x7f57740cb250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f576c009d90 tx=0x7f576c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db53fe8ce18d2d39 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f5778cbe700 1 -- 172.21.15.100:0/2865366931 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00e070 con 0x7f57740b1150 2023-11-17T06:31:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f5778cbe700 1 -- 172.21.15.100:0/2865366931 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00bb20 con 0x7f57740b1150 2023-11-17T06:31:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f5778cbe700 1 -- 172.21.15.100:0/2865366931 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012430 con 0x7f57740b1150 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577bf24700 1 -- 172.21.15.100:0/2865366931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 msgr2=0x7f57740cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.942+0000 7f577bf24700 1 --2- 172.21.15.100:0/2865366931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 0x7f57740cb250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f576c009d90 tx=0x7f576c00b330 comp rx=0 tx=0).stop 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 -- 172.21.15.100:0/2865366931 shutdown_connections 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 --2- 172.21.15.100:0/2865366931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57740b1150 0x7f57740cb250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 --2- 172.21.15.100:0/2865366931 >> v2:172.21.15.119:3300/0 conn(0x7f5774161670 0x7f57740cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 -- 172.21.15.100:0/2865366931 >> 172.21.15.100:0/2865366931 conn(0x7f577406a270 msgr2=0x7f577406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 -- 172.21.15.100:0/2865366931 shutdown_connections 2023-11-17T06:31:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 -- 172.21.15.100:0/2865366931 wait complete. 2023-11-17T06:31:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.946+0000 7f577bf24700 1 Processor -- start 2023-11-17T06:31:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 -- start start 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57740b1150 0x7f57740c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5774161670 0x7f57741fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774164a40 con 0x7f5774161a50 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c3aa0 con 0x7f57740b1150 2023-11-17T06:31:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577bf24700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5774160170 con 0x7f5774161670 2023-11-17T06:31:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46618/0 (socket says 172.21.15.100:46618) 2023-11-17T06:31:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 -- 172.21.15.100:0/1704221543 learned_addr learned my addr 172.21.15.100:0/1704221543 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f57794bf700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5774161670 0x7f57741fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f5779cc0700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57740b1150 0x7f57740c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 -- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5774161670 msgr2=0x7f57741fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5774161670 0x7f57741fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 -- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57740b1150 msgr2=0x7f57740c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57740b1150 0x7f57740c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.950+0000 7f577a4c1700 1 -- 172.21.15.100:0/1704221543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009a70 con 0x7f5774161a50 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f576c014040 tx=0x7f576c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f576a7fc700 1 -- 172.21.15.100:0/1704221543 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012430 con 0x7f5774161a50 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57740c8ef0 con 0x7f5774161a50 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f576a7fc700 1 -- 172.21.15.100:0/1704221543 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c020070 con 0x7f5774161a50 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f576a7fc700 1 -- 172.21.15.100:0/1704221543 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c004280 con 0x7f5774161a50 2023-11-17T06:31:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.954+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5774164480 con 0x7f5774161a50 2023-11-17T06:31:12.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f576a7fc700 1 -- 172.21.15.100:0/1704221543 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f576c0043e0 con 0x7f5774161a50 2023-11-17T06:31:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f576a7fc700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 0x7f57580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f576a7fc700 1 -- 172.21.15.100:0/1704221543 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f576c022070 con 0x7f5774161a50 2023-11-17T06:31:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 Processor -- start 2023-11-17T06:31:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f5779cc0700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 0x7f57580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 -- start start 2023-11-17T06:31:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f5779cc0700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 0x7f57580689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5770009bf0 tx=0x7f5770009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd83910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd83e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xcb3620 con 0xd84390 2023-11-17T06:31:12.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xcb0d10 con 0xd83530 2023-11-17T06:31:12.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.958+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xcac600 con 0xd81750 2023-11-17T06:31:12.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46620/0 (socket says 172.21.15.100:46620) 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 -- 172.21.15.100:0/3265610940 learned_addr learned my addr 172.21.15.100:0/3265610940 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f5779cc0700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd83910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f57794bf700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd83e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 -- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 msgr2=0xd83e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd83e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 -- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 msgr2=0xd83910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd83910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 -- 172.21.15.100:0/3265610940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xcd1850 con 0xd84390 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f57794bf700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd83e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577a4c1700 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f576c05e930 tx=0x7f576c056720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84b8fab305fb86e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f57577fe700 1 -- 172.21.15.100:0/3265610940 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c057260 con 0xd84390 2023-11-17T06:31:12.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f57577fe700 1 -- 172.21.15.100:0/3265610940 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c057e90 con 0xd84390 2023-11-17T06:31:12.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f57577fe700 1 -- 172.21.15.100:0/3265610940 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c056b60 con 0xd84390 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- 172.21.15.100:0/3265610940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 msgr2=0xd84770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f576c05e930 tx=0x7f576c056720 comp rx=0 tx=0).stop 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- 172.21.15.100:0/3265610940 shutdown_connections 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xd84770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd83e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3265610940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd83910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- 172.21.15.100:0/3265610940 >> 172.21.15.100:0/3265610940 conn(0xad14d0 msgr2=0xd6c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- 172.21.15.100:0/3265610940 shutdown_connections 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- 172.21.15.100:0/3265610940 wait complete. 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.962+0000 7f577f1f0740 1 -- start start 2023-11-17T06:31:12.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 Processor -- start 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 0xd68ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd43600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xc6a6e0 con 0xd83530 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xc6a380 con 0xd81750 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xb55aa0 con 0xd84390 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577f1f0740 10 client.0 _ll_register_callbacks cb 0xc59a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46622/0 (socket says 172.21.15.100:46622) 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 -- 172.21.15.100:0/2513987761 learned_addr learned my addr 172.21.15.100:0/2513987761 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:12.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f577a4c1700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd43600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f5779cc0700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 0xd68ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 -- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 msgr2=0xd43600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd43600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 -- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 msgr2=0xd68ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 0xd68ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 -- 172.21.15.100:0/2513987761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5774164480 con 0xd83530 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f5779cc0700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 0xd68ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.966+0000 7f57794bf700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5764007660 tx=0x7f5764001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deac678296e1d35 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764001ab0 con 0xd83530 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5764001c10 con 0xd83530 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xca55e0 con 0xd83530 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5764015470 con 0xd83530 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 10 client.5388 fetch_fsmap learned FSMap version 17 2023-11-17T06:31:12.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0xb1c960 con 0xd83530 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764023020 con 0xd83530 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f57640155d0 con 0xd83530 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 10 client.5388 fetch_fsmap finished waiting for FSMap version 17 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 10 client.5388 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 20 client.5388 populate_metadata read hostname 'smithi100' 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xd85090 0xd44040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 4 client.5388 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 --> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc65470 con 0xd85090 2023-11-17T06:31:12.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5779cc0700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xd85090 0xd44040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5779cc0700 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xd85090 0xd44040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6484f15916b532 server_cookie=e7dc1a79a72f9396 in_seq=0 out_seq=0 2023-11-17T06:31:12.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.970+0000 7f5754ff9700 10 client.5388 ms_handle_connect on v2:172.21.15.119:6833/1192926084 2023-11-17T06:31:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f5754ff9700 1 -- 172.21.15.100:0/2513987761 <== mds.0 v2:172.21.15.119:6833/1192926084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0xc65470 con 0xd85090 2023-11-17T06:31:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f5754ff9700 10 client.5388 handle_command_reply: tid=0 2023-11-17T06:31:12.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 client.5388 shutdown 2023-11-17T06:31:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 msgr2=0xd430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5764007660 tx=0x7f5764001260 comp rx=0 tx=0).stop 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 shutdown_connections 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xd85090 0xd44040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd43600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd83530 0xd430c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 --2- 172.21.15.100:0/2513987761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd81750 0xd68ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f5754ff9700 0 client.5388 ms_handle_reset on v2:172.21.15.119:6833/1192926084 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 >> 172.21.15.100:0/2513987761 conn(0xad14d0 msgr2=0xd84980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 shutdown_connections 2023-11-17T06:31:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 1 -- 172.21.15.100:0/2513987761 wait complete. 2023-11-17T06:31:12.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.974+0000 7f577f1f0740 20 client.5388 trim_cache size 0 max 16384 2023-11-17T06:31:12.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 Processor -- start 2023-11-17T06:31:13.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 -- start start 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd81750 0xd41840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd8f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xc79f90 con 0xd81750 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xc70560 con 0xd83530 2023-11-17T06:31:13.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.994+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xc77d80 con 0xd84390 2023-11-17T06:31:13.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f57794bf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f57794bf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34106/0 (socket says 172.21.15.100:34106) 2023-11-17T06:31:13.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f57794bf700 1 -- 172.21.15.100:0/1885403081 learned_addr learned my addr 172.21.15.100:0/1885403081 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:13.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd8f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f5779cc0700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd81750 0xd41840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 -- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 msgr2=0xd41d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 -- 172.21.15.100:0/1885403081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd81750 msgr2=0xd41840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd81750 0xd41840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 -- 172.21.15.100:0/1885403081 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd80c60 con 0xd84390 2023-11-17T06:31:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f57794bf700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577a4c1700 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd8f6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f576c009a40 tx=0x7f576c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e566cc2dea360b18 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f5757fff700 1 -- 172.21.15.100:0/1885403081 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c052ea0 con 0xd84390 2023-11-17T06:31:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f5757fff700 1 -- 172.21.15.100:0/1885403081 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c057260 con 0xd84390 2023-11-17T06:31:13.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f5757fff700 1 -- 172.21.15.100:0/1885403081 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012e20 con 0xd84390 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 msgr2=0xd8f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd8f6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f576c009a40 tx=0x7f576c01e000 comp rx=0 tx=0).stop 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- 172.21.15.100:0/1885403081 shutdown_connections 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd84390 0xd8f6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xd41d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 --2- 172.21.15.100:0/1885403081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd81750 0xd41840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- 172.21.15.100:0/1885403081 >> 172.21.15.100:0/1885403081 conn(0xad14d0 msgr2=0xd82520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- 172.21.15.100:0/1885403081 shutdown_connections 2023-11-17T06:31:13.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- 172.21.15.100:0/1885403081 wait complete. 2023-11-17T06:31:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:12.998+0000 7f577f1f0740 1 -- start start 2023-11-17T06:31:13.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 Processor -- start 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xda2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xca9e10 con 0xd84390 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xd91840 con 0xd83530 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xd43950 con 0xd81750 2023-11-17T06:31:13.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577f1f0740 10 client.0 _ll_register_callbacks cb 0xc714b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:13.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577a4c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46636/0 (socket says 172.21.15.100:46636) 2023-11-17T06:31:13.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577a4c1700 1 -- 172.21.15.100:0/3318055385 learned_addr learned my addr 172.21.15.100:0/3318055385 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:13.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f57794bf700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xda2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 -- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 msgr2=0xda2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xda2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 -- 172.21.15.100:0/3318055385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 msgr2=0xda2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 -- 172.21.15.100:0/3318055385 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb1c960 con 0xd81750 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f577a4c1700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5779cc0700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd904f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0xd6d020 tx=0x7f5770014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=616a7e3d276360cd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.002+0000 7f5754ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3301/0 2023-11-17T06:31:13.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770029040 con 0xd81750 2023-11-17T06:31:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mon.2 v2:172.21.15.119:3301/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f577002a450 con 0xd81750 2023-11-17T06:31:13.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd693f0 con 0xd81750 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577001c040 con 0xd81750 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 10 client.5024 fetch_fsmap learned FSMap version 17 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0xcd1850 con 0xd81750 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mon.2 v2:172.21.15.119:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd693f0 con 0xd81750 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mon.2 v2:172.21.15.119:3301/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f577002a8a0 con 0xd81750 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 10 client.5024 fetch_fsmap finished waiting for FSMap version 17 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 10 client.5024 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 20 client.5024 populate_metadata read hostname 'smithi100' 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xda0b60 0xda0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 4 client.5024 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:31:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 --> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f576c057e90 con 0xda0b60 2023-11-17T06:31:13.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f57794bf700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xda0b60 0xda0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f57794bf700 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xda0b60 0xda0f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd6a32ee18c593ed server_cookie=6b5a934ae18fab0b in_seq=0 out_seq=0 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 10 client.5024 ms_handle_connect on v2:172.21.15.119:6833/1192926084 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 1 -- 172.21.15.100:0/3318055385 <== mds.0 v2:172.21.15.119:6833/1192926084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x7f576c057e90 con 0xda0b60 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f5754ff9700 10 client.5024 handle_command_reply: tid=0 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.006+0000 7f577f1f0740 1 client.5024 shutdown 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 msgr2=0xd904f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd904f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0xd6d020 tx=0x7f5770014000 comp rx=0 tx=0).stop 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 shutdown_connections 2023-11-17T06:31:13.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:6833/1192926084,v1:172.21.15.119:6835/1192926084] conn(0xda0b60 0xda0f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xd84390 0xda2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f5754ff9700 0 client.5024 ms_handle_reset on v2:172.21.15.119:6833/1192926084 2023-11-17T06:31:13.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xd83530 0xda2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 --2- 172.21.15.100:0/3318055385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xd81750 0xd904f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 >> 172.21.15.100:0/3318055385 conn(0xad14d0 msgr2=0xd82520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 shutdown_connections 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 1 -- 172.21.15.100:0/3318055385 wait complete. 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577f1f0740 20 client.5024 trim_cache size 0 max 16384 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "85721606-40d2-46b5-8d45-5c90fa8b3283", 2023-11-17T06:31:13.018 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5214, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 10.738973095, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 17, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 35, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 35, 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18.600704129 2023-11-17T06:31:13.019 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 msgr2=0x7f57580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 0x7f57580689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5770009bf0 tx=0x7f5770009240 comp rx=0 tx=0).stop 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 msgr2=0x7f57741fa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f576c014040 tx=0x7f576c004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 shutdown_connections 2023-11-17T06:31:13.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5758066510 0x7f57580689d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5774161a50 0x7f57741fa810 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5774161670 0x7f57741fa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 --2- 172.21.15.100:0/1704221543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57740b1150 0x7f57740c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 >> 172.21.15.100:0/1704221543 conn(0x7f577406a270 msgr2=0x7f57740cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 shutdown_connections 2023-11-17T06:31:13.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.010+0000 7f577bf24700 1 -- 172.21.15.100:0/1704221543 wait complete. 2023-11-17T06:31:13.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 Processor -- start 2023-11-17T06:31:13.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 -- start start 2023-11-17T06:31:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe49c15b230 0x7fe49c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0cf580 con 0x7fe49c0cb670 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0b4580 con 0x7fe49c15b230 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a4590700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cd550 con 0x7fe49c0cebf0 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a232c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe49c15b230 0x7fe49c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a232c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe49c15b230 0x7fe49c15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46640/0 (socket says 172.21.15.100:46640) 2023-11-17T06:31:13.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.222+0000 7fe4a232c700 1 -- 172.21.15.100:0/2871916999 learned_addr learned my addr 172.21.15.100:0/2871916999 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:13.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a2b2d700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a232c700 1 -- 172.21.15.100:0/2871916999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 msgr2=0x7fe49c0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a232c700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c0cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a232c700 1 -- 172.21.15.100:0/2871916999 >> v1:172.21.15.100:6789/0 conn(0x7fe49c0cb670 legacy=0x7fe49c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a232c700 1 -- 172.21.15.100:0/2871916999 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0d0810 con 0x7fe49c15b230 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a2b2d700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a232c700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c15f8b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe498009910 tx=0x7fe498009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8877e3d2cc6c0c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a132a700 1 -- 172.21.15.100:0/2871916999 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49800ba60 con 0x7fe49c15b230 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a132a700 1 -- 172.21.15.100:0/2871916999 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49800bbc0 con 0x7fe49c15b230 2023-11-17T06:31:13.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a132a700 1 -- 172.21.15.100:0/2871916999 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498009e60 con 0x7fe49c15b230 2023-11-17T06:31:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 -- 172.21.15.100:0/2871916999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 msgr2=0x7fe49c15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c15f8b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe498009910 tx=0x7fe498009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 -- 172.21.15.100:0/2871916999 shutdown_connections 2023-11-17T06:31:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 --2- 172.21.15.100:0/2871916999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c15f8b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 -- 172.21.15.100:0/2871916999 >> 172.21.15.100:0/2871916999 conn(0x7fe49c070020 msgr2=0x7fe49c070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 -- 172.21.15.100:0/2871916999 shutdown_connections 2023-11-17T06:31:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.226+0000 7fe4a4590700 1 -- 172.21.15.100:0/2871916999 wait complete. 2023-11-17T06:31:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 Processor -- start 2023-11-17T06:31:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 -- start start 2023-11-17T06:31:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49c0cb670 0x7fe49c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c1f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0c6810 con 0x7fe49c15b230 2023-11-17T06:31:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0c5980 con 0x7fe49c0cb670 2023-11-17T06:31:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a4590700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15b940 con 0x7fe49c0cebf0 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a2b2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a2b2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46646/0 (socket says 172.21.15.100:46646) 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a2b2d700 1 -- 172.21.15.100:0/27290419 learned_addr learned my addr 172.21.15.100:0/27290419 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.230+0000 7fe4a232c700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49c0cb670 0x7fe49c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a1b2b700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c1f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 -- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 msgr2=0x7fe49c1f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c1f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 -- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49c0cb670 msgr2=0x7fe49c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49c0cb670 0x7fe49c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 -- 172.21.15.100:0/27290419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498009570 con 0x7fe49c15b230 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a2b2d700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe49400ce70 tx=0x7fe49400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400ad00 con 0x7fe49c15b230 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400ae60 con 0x7fe49c15b230 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0c5b90 con 0x7fe49c15b230 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494015680 con 0x7fe49c15b230 2023-11-17T06:31:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c0c6150 con 0x7fe49c15b230 2023-11-17T06:31:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.234+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c15cf60 con 0x7fe49c15b230 2023-11-17T06:31:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.238+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe49400d430 con 0x7fe49c15b230 2023-11-17T06:31:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.238+0000 7fe492ffd700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 0x7fe4800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.238+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4940842c0 con 0x7fe49c15b230 2023-11-17T06:31:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.238+0000 7fe4a232c700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 0x7fe4800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.242+0000 7fe4a232c700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 0x7fe4800689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe498000c00 tx=0x7fe498008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.246+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe49c15cf60 con 0x7fe49c15b230 2023-11-17T06:31:13.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.454+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe49c15cf20 con 0x7fe49c15b230 2023-11-17T06:31:13.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.454+0000 7fe492ffd700 1 -- 172.21.15.100:0/27290419 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4940516b0 con 0x7fe49c15b230 2023-11-17T06:31:13.461 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:31:13.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 msgr2=0x7fe4800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 0x7fe4800689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe498000c00 tx=0x7fe498008030 comp rx=0 tx=0).stop 2023-11-17T06:31:13.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 msgr2=0x7fe49c1f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe49400ce70 tx=0x7fe49400cea0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 shutdown_connections 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe480066510 0x7fe4800689d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c15b230 0x7fe49c1f6210 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe49c0cebf0 0x7fe49c1f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 --2- 172.21.15.100:0/27290419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe49c0cb670 0x7fe49c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 >> 172.21.15.100:0/27290419 conn(0x7fe49c070020 msgr2=0x7fe49c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 shutdown_connections 2023-11-17T06:31:13.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:13.458+0000 7fe4a4590700 1 -- 172.21.15.100:0/27290419 wait complete. 2023-11-17T06:31:13.484 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:31:13.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:31:13.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:31:13.485 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:13.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.485 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-11-17T06:31:13.503 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.504 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42047sec preferred_lft 42047sec 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:56:04:b0:e5 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:31:13.505 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::500a:a9ff:fe52:b4e2/64 scope link 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c84b:a0ff:fe54:7d52/64 scope link 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ce:a0:c8:bf:81:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:13.507 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::cca0:c8ff:febf:810f/64 scope link 2023-11-17T06:31:13.507 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:13.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.508 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:31:13.588 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:31:13.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.591 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-11-17T06:31:13.656 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:31:13.657 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:31:13.658 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:31:13.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:31:13.659 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:31:13.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.799 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:31:13.815 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:31:13.816 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:31:13.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:13.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-11-17T06:31:13.896 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:31:13.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:31:13.896 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:13.954 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:13.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:31:13.955 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:14.014 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:31:14.097 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:31:14.171 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:31:14.171 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:31:14.171 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:31:14.172 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:31:14.173 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:31:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:31:14.175 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:14.175 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:14.175 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:14.175 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:14.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:14.176 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:31:14.236 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:31:14.236 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:31:14.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:31:14.316 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:31:14.384 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:14.389 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:31:14.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2023-11-17T06:31:14.422+0000 7fe18b4c1640 -1 init, newargv = 0x55fad5397a10 newargc=15 2023-11-17T06:31:14.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[46937]: starting ceph client 2023-11-17T06:31:14.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[46937]: starting fuse 2023-11-17T06:31:14.441 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:31:14.441 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:31:14.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:31:14.441 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-11-17T06:31:14.441 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-11-17T06:31:14.441 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:31:14.441 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-11-17T06:31:14.442 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:31:14.442 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2023-11-17T06:31:14.446 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:31:14.609 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.46937.asok 2023-11-17T06:31:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:31:14.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46937.asok 2023-11-17T06:31:14.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:14.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46937.asok status 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "46937", 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-11-17T06:31:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5412, 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5412 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:31:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4271123135 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4271123135 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5412 192.168.0.1:0/4271123135", 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/4271123135", 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 17, 2023-11-17T06:31:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 35, 2023-11-17T06:31:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:31:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-11-17T06:31:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-11-17T06:31:14.829 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:31:14.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:14.840 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-11-17T06:31:14.840 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:14.859 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-11-17T06:31:14.859 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:14.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:14.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:14.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:31:14.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-11-17T06:31:15.064 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:31:15.065 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:31:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:31:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-11-17T06:31:15.068 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.069 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-11-17T06:31:15.070 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-11-17T06:31:15.071 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.072 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:31:15.073 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:31:15.074 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-11-17T06:31:15.075 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-11-17T06:31:15.076 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.077 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 0 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2023-11-17T06:31:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:31:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2023-11-17T06:31:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2023-11-17T06:31:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2023-11-17T06:31:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2023-11-17T06:31:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2023-11-17T06:31:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:31:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2023-11-17T06:31:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2023-11-17T06:31:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2023-11-17T06:31:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:31:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 0 2023-11-17T06:31:15.093 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:31:15.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2023-11-17T06:31:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:31:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:31:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2023-11-17T06:31:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-11-17T06:31:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:31:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2023-11-17T06:31:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-11-17T06:31:15.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2023-11-17T06:31:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 0 2023-11-17T06:31:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split size = 10000 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.219 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:31:15.220 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:31:15.221 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.100,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-11-17T06:31:15.222 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 85721606-40d2-46b5-8d45-5c90fa8b3283 2023-11-17T06:31:15.223 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.223 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-11-17T06:31:15.223 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-11-17T06:31:15.223 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-11-17T06:31:15.224 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.225 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-11-17T06:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-11-17T06:31:15.227 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.227 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-11-17T06:31:15.227 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:31:15.228 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-11-17T06:31:15.229 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:31:15.230 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:31:15.231 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-11-17T06:31:15.232 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-11-17T06:31:15.233 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 0 2023-11-17T06:31:15.234 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split size = 10000 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> stdin-killer -- python3 -c ' 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir") 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> os.mkdir(path) 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> for n in range(0, 100): 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> open(os.path.join(path, "%s" % n), '"'"'w'"'"').write("%s" % n) 2023-11-17T06:31:15.244 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:31:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:31:15.815 DEBUG:teuthology.orchestra.run.smithi100:> stdin-killer -- python3 -c ' 2023-11-17T06:31:15.815 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:31:15.815 DEBUG:teuthology.orchestra.run.smithi100:> import stat 2023-11-17T06:31:15.815 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:31:15.815 DEBUG:teuthology.orchestra.run.smithi100:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-11-17T06:31:15.816 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:31:15.954 INFO:teuthology.orchestra.run.smithi100.stdout:1099511627776 2023-11-17T06:31:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:31:15.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 Processor -- start 2023-11-17T06:31:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 -- start start 2023-11-17T06:31:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30880cb9e0 0x7f30880cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f308815ca60 0x7f308815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880cb620 con 0x7f308806bc20 2023-11-17T06:31:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3088155e10 con 0x7f308815ca60 2023-11-17T06:31:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.178+0000 7f308759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3088070390 con 0x7f30880cb9e0 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f308815ca60 0x7f308815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f308815ca60 0x7f308815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46648/0 (socket says 172.21.15.100:46648) 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 -- 172.21.15.100:0/1357473994 learned_addr learned my addr 172.21.15.100:0/1357473994 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f308659c700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30880cb9e0 0x7f30880cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 -- 172.21.15.100:0/1357473994 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30880cb9e0 msgr2=0x7f30880cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30880cb9e0 0x7f30880cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 -- 172.21.15.100:0/1357473994 >> v1:172.21.15.119:6789/0 conn(0x7f308806bc20 legacy=0x7f308806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 -- 172.21.15.100:0/1357473994 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880cc300 con 0x7f308815ca60 2023-11-17T06:31:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3085d9b700 1 -- 172.21.15.100:0/1357473994 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557238830 0 0) 0x7f30880cb620 con 0x7f308806bc20 2023-11-17T06:31:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3086d9d700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f308815ce60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3080009e50 tx=0x7f308000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e30e0b23d360ef server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3085d9b700 1 -- 172.21.15.100:0/1357473994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000e070 con 0x7f308815ca60 2023-11-17T06:31:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3085d9b700 1 -- 172.21.15.100:0/1357473994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000b910 con 0x7f308815ca60 2023-11-17T06:31:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f3085d9b700 1 -- 172.21.15.100:0/1357473994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000bcc0 con 0x7f308815ca60 2023-11-17T06:31:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f308759e700 1 -- 172.21.15.100:0/1357473994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 msgr2=0x7f308815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.182+0000 7f308759e700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f308815ce60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3080009e50 tx=0x7f308000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 -- 172.21.15.100:0/1357473994 shutdown_connections 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f308815ce60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 --2- 172.21.15.100:0/1357473994 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30880cb9e0 0x7f30880cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 -- 172.21.15.100:0/1357473994 >> 172.21.15.100:0/1357473994 conn(0x7f308806a480 msgr2=0x7f308806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 -- 172.21.15.100:0/1357473994 shutdown_connections 2023-11-17T06:31:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.186+0000 7f308759e700 1 -- 172.21.15.100:0/1357473994 wait complete. 2023-11-17T06:31:16.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 Processor -- start 2023-11-17T06:31:16.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 -- start start 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f308806bc20 0x7f3088158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 0x7f30880b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308814ca70 con 0x7f308815ca60 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3088158f80 con 0x7f30880cb9e0 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30880b27d0 con 0x7f308806bc20 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f3086d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f3086d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46652/0 (socket says 172.21.15.100:46652) 2023-11-17T06:31:16.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f3086d9d700 1 -- 172.21.15.100:0/159164347 learned_addr learned my addr 172.21.15.100:0/159164347 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:16.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f307dd9b700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 0x7f30880b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.190+0000 7f308659c700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f308806bc20 0x7f3088158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 -- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f308806bc20 msgr2=0x7f3088158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f308806bc20 0x7f3088158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 -- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 msgr2=0x7f30880b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 0x7f30880b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 -- 172.21.15.100:0/159164347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080009b30 con 0x7f308815ca60 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f307dd9b700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 0x7f30880b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f3086d9d700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30880c9240 tx=0x7f3080004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800092e0 con 0x7f308815ca60 2023-11-17T06:31:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308001b430 con 0x7f308815ca60 2023-11-17T06:31:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880b2a20 con 0x7f308815ca60 2023-11-17T06:31:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308001b800 con 0x7f308815ca60 2023-11-17T06:31:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880b2fe0 con 0x7f308815ca60 2023-11-17T06:31:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.194+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30881f6030 con 0x7f308815ca60 2023-11-17T06:31:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.198+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f308001b960 con 0x7f308815ca60 2023-11-17T06:31:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.198+0000 7f307f7fe700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 0x7f30680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.198+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3080085730 con 0x7f308815ca60 2023-11-17T06:31:16.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.198+0000 7f308659c700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 0x7f30680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.198+0000 7f308659c700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 0x7f30680689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3078009b80 tx=0x7f3078008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.206+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30881f6030 con 0x7f308815ca60 2023-11-17T06:31:16.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.414+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30881f6030 con 0x7f308815ca60 2023-11-17T06:31:16.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.414+0000 7f307f7fe700 1 -- 172.21.15.100:0/159164347 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f30881f6030 con 0x7f308815ca60 2023-11-17T06:31:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:16.422 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:06.955546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/1192926084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":1192926084},{"type":"v1","addr":"172.21.15.119:6835","nonce":1192926084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:16.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 msgr2=0x7f30680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 0x7f30680689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3078009b80 tx=0x7f3078008040 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 msgr2=0x7f3088157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30880c9240 tx=0x7f3080004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 shutdown_connections 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3068066510 0x7f30680689d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f308815ca60 0x7f3088157930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30880cb9e0 0x7f30880b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 --2- 172.21.15.100:0/159164347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f308806bc20 0x7f3088158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 >> 172.21.15.100:0/159164347 conn(0x7f308806a480 msgr2=0x7f308806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 shutdown_connections 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.418+0000 7f308759e700 1 -- 172.21.15.100:0/159164347 wait complete. 2023-11-17T06:31:16.427 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2023-11-17T06:31:16.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:16.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.606+0000 7f17da0ba700 1 Processor -- start 2023-11-17T06:31:16.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 -- start start 2023-11-17T06:31:16.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 0x7f17d40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 0x7f17d40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d415fcc0 con 0x7f17d4158ea0 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d415edd0 con 0x7f17d40cb6e0 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17da0ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d415f0b0 con 0x7f17d40cbb70 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 0x7f17d40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17d37fe700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f17d4158ea0 0x7f17d406f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:33920/0 (socket says 172.21.15.100:33920) 2023-11-17T06:31:16.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17d2ffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 0x7f17d40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.610+0000 7f17d37fe700 1 -- 172.21.15.100:0/498027868 learned_addr learned my addr 172.21.15.100:0/498027868 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d27fc700 1 -- 172.21.15.100:0/498027868 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618528524 0 0) 0x7f17d415fcc0 con 0x7f17d4158ea0 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d27fc700 1 -- 172.21.15.100:0/498027868 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc0035d0 con 0x7f17d4158ea0 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d3fff700 1 -- 172.21.15.100:0/498027868 >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 msgr2=0x7f17d40b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d3fff700 1 --2- 172.21.15.100:0/498027868 >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 0x7f17d40b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d3fff700 1 -- 172.21.15.100:0/498027868 >> v1:172.21.15.119:6789/0 conn(0x7f17d4158ea0 legacy=0x7f17d406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d3fff700 1 -- 172.21.15.100:0/498027868 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d415f390 con 0x7f17d40cbb70 2023-11-17T06:31:16.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d2ffd700 1 --2- 172.21.15.100:0/498027868 >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 0x7f17d40b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:16.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d3fff700 1 --2- 172.21.15.100:0/498027868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 0x7f17d40b3050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009dc0 tx=0x7f17cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0d5a56af19c560 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d27fc700 1 -- 172.21.15.100:0/498027868 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00e070 con 0x7f17d40cbb70 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d27fc700 1 -- 172.21.15.100:0/498027868 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00bae0 con 0x7f17d40cbb70 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17d27fc700 1 -- 172.21.15.100:0/498027868 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00be50 con 0x7f17d40cbb70 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 -- 172.21.15.100:0/498027868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 msgr2=0x7f17d40b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 --2- 172.21.15.100:0/498027868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 0x7f17d40b3050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009dc0 tx=0x7f17cc00b330 comp rx=0 tx=0).stop 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 -- 172.21.15.100:0/498027868 shutdown_connections 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 --2- 172.21.15.100:0/498027868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cbb70 0x7f17d40b3050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 --2- 172.21.15.100:0/498027868 >> v2:172.21.15.119:3300/0 conn(0x7f17d40cb6e0 0x7f17d40b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 -- 172.21.15.100:0/498027868 >> 172.21.15.100:0/498027868 conn(0x7f17d40cdb10 msgr2=0x7f17d40cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 -- 172.21.15.100:0/498027868 shutdown_connections 2023-11-17T06:31:16.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.614+0000 7f17da0ba700 1 -- 172.21.15.100:0/498027868 wait complete. 2023-11-17T06:31:16.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.618+0000 7f17da0ba700 1 Processor -- start 2023-11-17T06:31:16.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.618+0000 7f17da0ba700 1 -- start start 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cb6e0 0x7f17d40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17d40cbb70 0x7f17d40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40b15d0 con 0x7f17d4158ea0 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40b18b0 con 0x7f17d40cbb70 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40b1b90 con 0x7f17d40cb6e0 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46656/0 (socket says 172.21.15.100:46656) 2023-11-17T06:31:16.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 -- 172.21.15.100:0/228046135 learned_addr learned my addr 172.21.15.100:0/228046135 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:16.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d2ffd700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17d40cbb70 0x7f17d40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d37fe700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cb6e0 0x7f17d40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 -- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cb6e0 msgr2=0x7f17d40ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cb6e0 0x7f17d40ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 -- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17d40cbb70 msgr2=0x7f17d40b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17d40cbb70 0x7f17d40b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 -- 172.21.15.100:0/228046135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80094b0 con 0x7f17d4158ea0 2023-11-17T06:31:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17d3fff700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00d010 tx=0x7f17cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc004930 con 0x7f17d4158ea0 2023-11-17T06:31:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc009a70 con 0x7f17d4158ea0 2023-11-17T06:31:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc020070 con 0x7f17d4158ea0 2023-11-17T06:31:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc027680 con 0x7f17d4158ea0 2023-11-17T06:31:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.622+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40b2150 con 0x7f17d4158ea0 2023-11-17T06:31:16.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.626+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d404eea0 con 0x7f17d4158ea0 2023-11-17T06:31:16.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.626+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17cc0277e0 con 0x7f17d4158ea0 2023-11-17T06:31:16.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.630+0000 7f17bbfff700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 0x7f17c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.630+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17cc022070 con 0x7f17d4158ea0 2023-11-17T06:31:16.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.630+0000 7f17d37fe700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 0x7f17c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.630+0000 7f17d37fe700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 0x7f17c00689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c40011e0 tx=0x7f17c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.634+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17cc053270 con 0x7f17d4158ea0 2023-11-17T06:31:16.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.842+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17d40b3950 con 0x7f17d4158ea0 2023-11-17T06:31:16.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.842+0000 7f17bbfff700 1 -- 172.21.15.100:0/228046135 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f17cc056890 con 0x7f17d4158ea0 2023-11-17T06:31:16.849 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:16.849 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:06.955546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/1192926084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":1192926084},{"type":"v1","addr":"172.21.15.119:6835","nonce":1192926084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:16.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 msgr2=0x7f17c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 0x7f17c00689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c40011e0 tx=0x7f17c4009040 comp rx=0 tx=0).stop 2023-11-17T06:31:16.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 msgr2=0x7f17d4155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00d010 tx=0x7f17cc004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 shutdown_connections 2023-11-17T06:31:16.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f17c0066510 0x7f17c00689d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17d4158ea0 0x7f17d4155c90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17d40cbb70 0x7f17d40b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 --2- 172.21.15.100:0/228046135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17d40cb6e0 0x7f17d40ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 >> 172.21.15.100:0/228046135 conn(0x7f17d40cdb10 msgr2=0x7f17d415ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 shutdown_connections 2023-11-17T06:31:16.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:16.846+0000 7f17da0ba700 1 -- 172.21.15.100:0/228046135 wait complete. 2023-11-17T06:31:16.855 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2023-11-17T06:31:16.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dirfrag split /subdir 0/0 1 2023-11-17T06:31:17.066 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-11-17T06:31:17.066 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:31:17.066 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:31:17.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:17.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.286+0000 7ff6d6825700 1 Processor -- start 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.286+0000 7ff6d6825700 1 -- start start 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6825700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff6d00cd870 0x7ff6d00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6825700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d0165740 con 0x7ff6d00ce760 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6825700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d0165a20 con 0x7ff6d00ccaa0 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6825700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d00cdc50 con 0x7ff6d00cd870 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6024700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff6d00ce760 0x7ff6d0162100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36986/0 (socket says 172.21.15.100:36986) 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6024700 1 -- 172.21.15.100:0/2463827573 learned_addr learned my addr 172.21.15.100:0/2463827573 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d5823700 1 --2- 172.21.15.100:0/2463827573 >> v2:172.21.15.119:3300/0 conn(0x7ff6d00cd870 0x7ff6d00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967710429 0 0) 0x7ff6d0165740 con 0x7ff6d00ce760 2023-11-17T06:31:18.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc0035d0 con 0x7ff6d00ce760 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661039910 0 0) 0x7ff6d0165a20 con 0x7ff6d00ccaa0 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d0165740 con 0x7ff6d00ccaa0 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1984418550 0 0) 0x7ff6bc0035d0 con 0x7ff6d00ce760 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 >> v2:172.21.15.119:3300/0 conn(0x7ff6d00cd870 msgr2=0x7ff6d00cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 --2- 172.21.15.100:0/2463827573 >> v2:172.21.15.119:3300/0 conn(0x7ff6d00cd870 0x7ff6d00cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 >> v1:172.21.15.119:6789/0 conn(0x7ff6d00ccaa0 legacy=0x7ff6d00ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0165d00 con 0x7ff6d00ce760 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7ff6c80019f0 con 0x7ff6d00ce760 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 >> v1:172.21.15.100:6789/0 conn(0x7ff6d00ce760 legacy=0x7ff6d0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 0x7ff6bc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc003810 0x7ff6bc003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0041d0 0x7ff6bc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00cdc50 con 0x7ff6bc004c80 2023-11-17T06:31:18.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc00c130 con 0x7ff6bc0041d0 2023-11-17T06:31:18.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc00c2f0 con 0x7ff6bc003810 2023-11-17T06:31:18.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d5823700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 0x7ff6bc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d6024700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0041d0 0x7ff6bc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.290+0000 7ff6d5022700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc003810 0x7ff6bc003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 -- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc003810 msgr2=0x7ff6bc003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:18.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc003810 0x7ff6bc003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 -- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0041d0 msgr2=0x7ff6bc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6bc0041d0 0x7ff6bc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 -- 172.21.15.100:0/2463827573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0035d0 con 0x7ff6bc004c80 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6024700 1 -- 172.21.15.100:0/2463827573 reap_dead start 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d5823700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 0x7ff6bc005080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009b70 tx=0x7ff6bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5c030d882b98cd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00e6c0 con 0x7ff6bc004c80 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc00e820 con 0x7ff6bc004c80 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d4821700 1 -- 172.21.15.100:0/2463827573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00eb90 con 0x7ff6bc004c80 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 -- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 msgr2=0x7ff6bc005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 0x7ff6bc005080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009b70 tx=0x7ff6bc0058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 -- 172.21.15.100:0/2463827573 shutdown_connections 2023-11-17T06:31:18.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 --2- 172.21.15.100:0/2463827573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6bc004c80 0x7ff6bc005080 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 -- 172.21.15.100:0/2463827573 >> 172.21.15.100:0/2463827573 conn(0x7ff6d006a480 msgr2=0x7ff6d006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 -- 172.21.15.100:0/2463827573 shutdown_connections 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.294+0000 7ff6d6825700 1 -- 172.21.15.100:0/2463827573 wait complete. 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 Processor -- start 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 -- start start 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc004c80 0x7ff6d015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6d01f8a40 0x7ff6d00c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c43e0 con 0x7ff6d01f85c0 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c37f0 con 0x7ff6d01f8a40 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.298+0000 7ff6d6825700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c3a40 con 0x7ff6bc004c80 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46672/0 (socket says 172.21.15.100:46672) 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 -- 172.21.15.100:0/1804819336 learned_addr learned my addr 172.21.15.100:0/1804819336 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5823700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc004c80 0x7ff6d015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d6024700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6d01f8a40 0x7ff6d00c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 -- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc004c80 msgr2=0x7ff6d015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc004c80 0x7ff6d015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 -- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6d01f8a40 msgr2=0x7ff6d00c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6d01f8a40 0x7ff6d00c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 -- 172.21.15.100:0/1804819336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00c3d20 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d5022700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000f7e0 tx=0x7ff6c000faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00052e0 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0005460 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00c4000 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00038e0 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d00c8170 con 0x7ff6d01f85c0 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.302+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d00c4520 con 0x7ff6d01f85c0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.306+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6c0003a40 con 0x7ff6d01f85c0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.306+0000 7ff6c67fc700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 0x7ff6b4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.306+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c0083c10 con 0x7ff6d01f85c0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.306+0000 7ff6d5823700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 0x7ff6b4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.306+0000 7ff6d5823700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 0x7ff6b4068a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0090b0 tx=0x7ff6cc01e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.310+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6d00c4520 con 0x7ff6d01f85c0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.494+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d00c4520 con 0x7ff6d01f85c0 2023-11-17T06:31:18.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6c67fc700 1 -- 172.21.15.100:0/1804819336 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7ff6d00c4520 con 0x7ff6d01f85c0 2023-11-17T06:31:18.676 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:18.676 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:03.255881+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 msgr2=0x7ff6b4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 0x7ff6b4068a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0090b0 tx=0x7ff6cc01e040 comp rx=0 tx=0).stop 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 msgr2=0x7ff6d00c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000f7e0 tx=0x7ff6c000faf0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 shutdown_connections 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6d01f8a40 0x7ff6d00c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6b4066540 0x7ff6b4068a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d01f85c0 0x7ff6d00c4800 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 --2- 172.21.15.100:0/1804819336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6bc004c80 0x7ff6d015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.498+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 >> 172.21.15.100:0/1804819336 conn(0x7ff6d006a480 msgr2=0x7ff6d00cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:18.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.502+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 shutdown_connections 2023-11-17T06:31:18.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:17.502+0000 7ff6d6825700 1 -- 172.21.15.100:0/1804819336 wait complete. 2023-11-17T06:31:18.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:31:18.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:31:18.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.854+0000 7efcf6ca0700 1 Processor -- start 2023-11-17T06:31:18.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.854+0000 7efcf6ca0700 1 -- start start 2023-11-17T06:31:18.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf6ca0700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efcf0159990 0x7efcf00b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf6ca0700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00b1170 con 0x7efcf0070c00 2023-11-17T06:31:18.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf6ca0700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf006c680 con 0x7efcf00b0c80 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf6ca0700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf006d020 con 0x7efcf0159990 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf523d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efcf0070c00 0x7efcf0159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36988/0 (socket says 172.21.15.100:36988) 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf523d700 1 -- 172.21.15.100:0/835702350 learned_addr learned my addr 172.21.15.100:0/835702350 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcf4a3c700 1 --2- 172.21.15.100:0/835702350 >> v2:172.21.15.119:3300/0 conn(0x7efcf0159990 0x7efcf00b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.858+0000 7efcef7fe700 1 -- 172.21.15.100:0/835702350 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634975718 0 0) 0x7efcf00b1170 con 0x7efcf0070c00 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcef7fe700 1 -- 172.21.15.100:0/835702350 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce00035d0 con 0x7efcf0070c00 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf4a3c700 1 -- 172.21.15.100:0/835702350 >> v1:172.21.15.119:6789/0 conn(0x7efcf00b0c80 legacy=0x7efcf00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf4a3c700 1 -- 172.21.15.100:0/835702350 >> v1:172.21.15.100:6789/0 conn(0x7efcf0070c00 legacy=0x7efcf0159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf4a3c700 1 -- 172.21.15.100:0/835702350 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf006c960 con 0x7efcf0159990 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf4a3c700 1 --2- 172.21.15.100:0/835702350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf0159990 0x7efcf00b0740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efce4009850 tx=0x7efce4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb019180bbec93d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcef7fe700 1 -- 172.21.15.100:0/835702350 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efcf0159990 2023-11-17T06:31:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcef7fe700 1 -- 172.21.15.100:0/835702350 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efcf0159990 2023-11-17T06:31:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcef7fe700 1 -- 172.21.15.100:0/835702350 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d40 con 0x7efcf0159990 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf6ca0700 1 -- 172.21.15.100:0/835702350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf0159990 msgr2=0x7efcf00b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.862+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/835702350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf0159990 0x7efcf00b0740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efce4009850 tx=0x7efce4009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 -- 172.21.15.100:0/835702350 shutdown_connections 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/835702350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf0159990 0x7efcf00b0740 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 -- 172.21.15.100:0/835702350 >> 172.21.15.100:0/835702350 conn(0x7efcf00cc270 msgr2=0x7efcf00cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 -- 172.21.15.100:0/835702350 shutdown_connections 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 -- 172.21.15.100:0/835702350 wait complete. 2023-11-17T06:31:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 Processor -- start 2023-11-17T06:31:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 -- start start 2023-11-17T06:31:18.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.866+0000 7efcf6ca0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 0x7efcf0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 0x7efcf015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015c2c0 con 0x7efcf0070c00 2023-11-17T06:31:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015b740 con 0x7efcf00b0c80 2023-11-17T06:31:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015ba20 con 0x7efcf0159990 2023-11-17T06:31:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46684/0 (socket says 172.21.15.100:46684) 2023-11-17T06:31:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 -- 172.21.15.100:0/961896850 learned_addr learned my addr 172.21.15.100:0/961896850 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efceffff700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 0x7efcf0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf523d700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 0x7efcf015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 -- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 msgr2=0x7efcf015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 0x7efcf015b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 -- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 msgr2=0x7efcf0144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 0x7efcf0144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 -- 172.21.15.100:0/961896850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40094b0 con 0x7efcf0070c00 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efceffff700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 0x7efcf0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf523d700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 0x7efcf015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf4a3c700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efce4014040 tx=0x7efce4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4019ab0 con 0x7efcf0070c00 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce401e070 con 0x7efcf0070c00 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf015bd00 con 0x7efcf0070c00 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4019e50 con 0x7efcf0070c00 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf00c91c0 con 0x7efcf0070c00 2023-11-17T06:31:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.870+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf004eea0 con 0x7efcf0070c00 2023-11-17T06:31:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.874+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efce402d450 con 0x7efcf0070c00 2023-11-17T06:31:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.874+0000 7efced7fa700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 0x7efcd40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.874+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efce4084f00 con 0x7efcf0070c00 2023-11-17T06:31:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.874+0000 7efceffff700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 0x7efcd40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.878+0000 7efceffff700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 0x7efcd40689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efcf00b4730 tx=0x7efcdc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:18.882+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efce4052370 con 0x7efcf0070c00 2023-11-17T06:31:19.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.054+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcf014c6b0 con 0x7efcf0070c00 2023-11-17T06:31:19.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.058+0000 7efced7fa700 1 -- 172.21.15.100:0/961896850 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7efce40150a0 con 0x7efcf0070c00 2023-11-17T06:31:19.063 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:31:19.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 msgr2=0x7efcd40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 0x7efcd40689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efcf00b4730 tx=0x7efcdc009040 comp rx=0 tx=0).stop 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 msgr2=0x7efcf0149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efce4014040 tx=0x7efce4004770 comp rx=0 tx=0).stop 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 shutdown_connections 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcf0159990 0x7efcf015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcf00b0c80 0x7efcf0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7efcd4066510 0x7efcd40689d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 --2- 172.21.15.100:0/961896850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf0070c00 0x7efcf0149b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 >> 172.21.15.100:0/961896850 conn(0x7efcf00cc270 msgr2=0x7efcf0152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 shutdown_connections 2023-11-17T06:31:19.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.062+0000 7efcf6ca0700 1 -- 172.21.15.100:0/961896850 wait complete. 2023-11-17T06:31:19.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:31:19.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.258+0000 7f15bf59e700 1 Processor -- start 2023-11-17T06:31:19.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.258+0000 7f15bf59e700 1 -- start start 2023-11-17T06:31:19.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bf59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15c00d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bf59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c015d980 con 0x7f15c00cfc00 2023-11-17T06:31:19.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bf59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c0161ae0 con 0x7f15c015d5a0 2023-11-17T06:31:19.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bf59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00d18d0 con 0x7f15c00d0090 2023-11-17T06:31:19.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bdd9b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f15c00cfc00 0x7f15c00d1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36992/0 (socket says 172.21.15.100:36992) 2023-11-17T06:31:19.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bdd9b700 1 -- 172.21.15.100:0/76044150 learned_addr learned my addr 172.21.15.100:0/76044150 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:19.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bed9d700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15c00d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956649816 0 0) 0x7f15c015d980 con 0x7f15c00cfc00 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a80035d0 con 0x7f15c00cfc00 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991439494 0 0) 0x7f15c0161ae0 con 0x7f15c015d5a0 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c015d980 con 0x7f15c015d5a0 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2973321121 0 0) 0x7f15a80035d0 con 0x7f15c00cfc00 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 msgr2=0x7f15c00d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15c00d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 >> v1:172.21.15.119:6789/0 conn(0x7f15c015d5a0 legacy=0x7f15c01610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0161dc0 con 0x7f15c00cfc00 2023-11-17T06:31:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f15b4001670 con 0x7f15c00cfc00 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bed9d700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15c00d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 >> v1:172.21.15.100:6789/0 conn(0x7f15c00cfc00 legacy=0x7f15c00d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15a8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a8004870 0x7f15a8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15a8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00d18d0 con 0x7f15a8004870 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a800bae0 con 0x7f15a8003be0 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a800bc70 con 0x7f15c00d0090 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bdd9b700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a8004870 0x7f15a8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15be59c700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15a8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15bed9d700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15a8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.262+0000 7f15be59c700 1 -- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 msgr2=0x7f15a8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15be59c700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00d0090 0x7f15a8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15be59c700 1 -- 172.21.15.100:0/76044150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a8004870 msgr2=0x7f15a8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15be59c700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a8004870 0x7f15a8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15be59c700 1 -- 172.21.15.100:0/76044150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009a70 con 0x7f15a8003be0 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15be59c700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15a8003fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15b0007fd0 tx=0x7f15a80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eea4858aabe84075 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0001450 con 0x7f15a8003be0 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b00052f0 con 0x7f15a8003be0 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bd59a700 1 -- 172.21.15.100:0/76044150 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0001d60 con 0x7f15a8003be0 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 -- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 msgr2=0x7f15a8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 --2- 172.21.15.100:0/76044150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15a8003fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15b0007fd0 tx=0x7f15a80058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bed9d700 1 -- 172.21.15.100:0/76044150 reap_dead start 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 -- 172.21.15.100:0/76044150 shutdown_connections 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 -- 172.21.15.100:0/76044150 >> 172.21.15.100:0/76044150 conn(0x7f15c006ad10 msgr2=0x7f15c006b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 -- 172.21.15.100:0/76044150 shutdown_connections 2023-11-17T06:31:19.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.266+0000 7f15bf59e700 1 -- 172.21.15.100:0/76044150 wait complete. 2023-11-17T06:31:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 Processor -- start 2023-11-17T06:31:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 -- start start 2023-11-17T06:31:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15c015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00c7930 0x7f15c01f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00c7e80 con 0x7f15c00b3ee0 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00c8160 con 0x7f15a8003be0 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bf59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01f2910 con 0x7f15c00c7930 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46692/0 (socket says 172.21.15.100:46692) 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.270+0000 7f15bed9d700 1 -- 172.21.15.100:0/1979875718 learned_addr learned my addr 172.21.15.100:0/1979875718 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15be59c700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15c015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bdd9b700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00c7930 0x7f15c01f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 -- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00c7930 msgr2=0x7f15c01f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00c7930 0x7f15c01f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 -- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 msgr2=0x7f15c015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15c015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 -- 172.21.15.100:0/1979875718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c01f2bf0 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bed9d700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15c006a870 tx=0x7f15b800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b801c070 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800f040 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800e040 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c00c8440 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01f3650 con 0x7f15c00b3ee0 2023-11-17T06:31:19.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.274+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c0067990 con 0x7f15c00b3ee0 2023-11-17T06:31:19.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.278+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15b800fd90 con 0x7f15c00b3ee0 2023-11-17T06:31:19.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.278+0000 7f15aeffd700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 0x7f15a0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.278+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b8083d30 con 0x7f15c00b3ee0 2023-11-17T06:31:19.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.278+0000 7f15be59c700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 0x7f15a0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.282+0000 7f15be59c700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 0x7f15a0068a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15c00ccf90 tx=0x7f15b000a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.286+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15b8051090 con 0x7f15c00b3ee0 2023-11-17T06:31:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.458+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15c00d0e10 con 0x7f15c00b3ee0 2023-11-17T06:31:19.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.458+0000 7f15aeffd700 1 -- 172.21.15.100:0/1979875718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15b80546b0 con 0x7f15c00b3ee0 2023-11-17T06:31:19.464 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:31:19.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 msgr2=0x7f15a0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 0x7f15a0068a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15c00ccf90 tx=0x7f15b000a000 comp rx=0 tx=0).stop 2023-11-17T06:31:19.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 msgr2=0x7f15c00cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15c006a870 tx=0x7f15b800f490 comp rx=0 tx=0).stop 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 shutdown_connections 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f15a0066540 0x7f15a0068a00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15c00b3ee0 0x7f15c00cb900 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c00c7930 0x7f15c01f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 --2- 172.21.15.100:0/1979875718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15a8003be0 0x7f15c015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 >> 172.21.15.100:0/1979875718 conn(0x7f15c006ad10 msgr2=0x7f15c015db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 shutdown_connections 2023-11-17T06:31:19.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.462+0000 7f15bf59e700 1 -- 172.21.15.100:0/1979875718 wait complete. 2023-11-17T06:31:19.492 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:31:19.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 Processor -- start 2023-11-17T06:31:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 -- start start 2023-11-17T06:31:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f075c0ce1e0 0x7f075c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c06d7b0 con 0x7f075c0ceb20 2023-11-17T06:31:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c06da90 con 0x7f075c0ca460 2023-11-17T06:31:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f07620c4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c15de80 con 0x7f075c0ce1e0 2023-11-17T06:31:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f075affd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f075c0ceb20 0x7f075c071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37002/0 (socket says 172.21.15.100:37002) 2023-11-17T06:31:19.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f075affd700 1 -- 172.21.15.100:0/1342606028 learned_addr learned my addr 172.21.15.100:0/1342606028 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:19.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.666+0000 7f075b7fe700 1 --2- 172.21.15.100:0/1342606028 >> v2:172.21.15.100:3300/0 conn(0x7f075c0ce1e0 0x7f075c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075b7fe700 1 -- 172.21.15.100:0/1342606028 >> v1:172.21.15.119:6789/0 conn(0x7f075c0ca460 legacy=0x7f075c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075b7fe700 1 -- 172.21.15.100:0/1342606028 >> v1:172.21.15.100:6789/0 conn(0x7f075c0ceb20 legacy=0x7f075c071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075b7fe700 1 -- 172.21.15.100:0/1342606028 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c06bfb0 con 0x7f075c0ce1e0 2023-11-17T06:31:19.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075a7fc700 1 -- 172.21.15.100:0/1342606028 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552335820 0 0) 0x7f075c06da90 con 0x7f075c0ca460 2023-11-17T06:31:19.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075b7fe700 1 --2- 172.21.15.100:0/1342606028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ce1e0 0x7f075c0c9950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f074c009850 tx=0x7f074c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88daf7c11c15b8b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075a7fc700 1 -- 172.21.15.100:0/1342606028 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c004230 con 0x7f075c0ce1e0 2023-11-17T06:31:19.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075a7fc700 1 -- 172.21.15.100:0/1342606028 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c004390 con 0x7f075c0ce1e0 2023-11-17T06:31:19.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f075a7fc700 1 -- 172.21.15.100:0/1342606028 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0036c0 con 0x7f075c0ce1e0 2023-11-17T06:31:19.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 -- 172.21.15.100:0/1342606028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ce1e0 msgr2=0x7f075c0c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 --2- 172.21.15.100:0/1342606028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ce1e0 0x7f075c0c9950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f074c009850 tx=0x7f074c009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:19.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 -- 172.21.15.100:0/1342606028 shutdown_connections 2023-11-17T06:31:19.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 --2- 172.21.15.100:0/1342606028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ce1e0 0x7f075c0c9950 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 -- 172.21.15.100:0/1342606028 >> 172.21.15.100:0/1342606028 conn(0x7f075c0cf050 msgr2=0x7f075c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 -- 172.21.15.100:0/1342606028 shutdown_connections 2023-11-17T06:31:19.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.670+0000 7f07620c4700 1 -- 172.21.15.100:0/1342606028 wait complete. 2023-11-17T06:31:19.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.674+0000 7f07620c4700 1 Processor -- start 2023-11-17T06:31:19.681 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.674+0000 7f07620c4700 1 -- start start 2023-11-17T06:31:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f075c0ce1e0 0x7f075c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 0x7f075c1f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c8fb0 con 0x7f075c0ca460 2023-11-17T06:31:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c8910 con 0x7f075c0ce1e0 2023-11-17T06:31:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c6500 con 0x7f075c0ceb20 2023-11-17T06:31:19.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46720/0 (socket says 172.21.15.100:46720) 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 -- 172.21.15.100:0/3842834582 learned_addr learned my addr 172.21.15.100:0/3842834582 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075bfff700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 0x7f075c1f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075affd700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f075c0ce1e0 0x7f075c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 -- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 msgr2=0x7f075c1f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 0x7f075c1f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 -- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f075c0ce1e0 msgr2=0x7f075c14de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f075c0ce1e0 0x7f075c14de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 -- 172.21.15.100:0/3842834582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0094b0 con 0x7f075c0ca460 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075bfff700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 0x7f075c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f075b7fe700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f074c0090b0 tx=0x7f074c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c011830 con 0x7f075c0ca460 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c011990 con 0x7f075c0ca460 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c011d40 con 0x7f075c0ca460 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c0c67e0 con 0x7f075c0ca460 2023-11-17T06:31:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.678+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c14e3a0 con 0x7f075c0ca460 2023-11-17T06:31:19.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.682+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c0c69a0 con 0x7f075c0ca460 2023-11-17T06:31:19.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.682+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f074c018040 con 0x7f075c0ca460 2023-11-17T06:31:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.686+0000 7f0743fff700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.686+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f074c084ff0 con 0x7f075c0ca460 2023-11-17T06:31:19.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.686+0000 7f075affd700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.686+0000 7f075affd700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 0x7f07480689d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0750007c40 tx=0x7f0750007d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.690+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f074c0b6090 con 0x7f075c0ca460 2023-11-17T06:31:19.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.870+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f075c04eea0 con 0x7f075c0ca460 2023-11-17T06:31:19.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f0743fff700 1 -- 172.21.15.100:0/3842834582 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f074c016020 con 0x7f075c0ca460 2023-11-17T06:31:19.878 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:31:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 msgr2=0x7f07480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 0x7f07480689d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0750007c40 tx=0x7f0750007d90 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 msgr2=0x7f075c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f074c0090b0 tx=0x7f074c004770 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 shutdown_connections 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f075c0ceb20 0x7f075c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f075c0ce1e0 0x7f075c14de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 --2- 172.21.15.100:0/3842834582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075c0ca460 0x7f075c0b21b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 >> 172.21.15.100:0/3842834582 conn(0x7f075c0cf050 msgr2=0x7f075c15dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 shutdown_connections 2023-11-17T06:31:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:19.874+0000 7f07620c4700 1 -- 172.21.15.100:0/3842834582 wait complete. 2023-11-17T06:31:19.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:31:20.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.074+0000 7fc743414700 1 Processor -- start 2023-11-17T06:31:20.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.074+0000 7fc743414700 1 -- start start 2023-11-17T06:31:20.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c0cb9e0 0x7fc73c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc73c15ca60 0x7fc73c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73c0cb620 con 0x7fc73c06bc20 2023-11-17T06:31:20.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73c155e10 con 0x7fc73c15ca60 2023-11-17T06:31:20.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c070390 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc73c15ca60 0x7fc73c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc73c15ca60 0x7fc73c15ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46726/0 (socket says 172.21.15.100:46726) 2023-11-17T06:31:20.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 -- 172.21.15.100:0/1269847629 learned_addr learned my addr 172.21.15.100:0/1269847629 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:20.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc741c11700 1 --1- 172.21.15.100:0/1269847629 >> v1:172.21.15.100:6789/0 conn(0x7fc73c06bc20 0x7fc73c06fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37012/0 (socket says 172.21.15.100:37012) 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742412700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c0cb9e0 0x7fc73c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 -- 172.21.15.100:0/1269847629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c0cb9e0 msgr2=0x7fc73c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c0cb9e0 0x7fc73c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 -- 172.21.15.100:0/1269847629 >> v1:172.21.15.100:6789/0 conn(0x7fc73c06bc20 legacy=0x7fc73c06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 -- 172.21.15.100:0/1269847629 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0cc300 con 0x7fc73c15ca60 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc742c13700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c15ca60 0x7fc73c15ce60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc734009e50 tx=0x7fc73400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc97b56d65deb9a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc741410700 1 -- 172.21.15.100:0/1269847629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400e070 con 0x7fc73c15ca60 2023-11-17T06:31:20.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc741410700 1 -- 172.21.15.100:0/1269847629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400b9c0 con 0x7fc73c15ca60 2023-11-17T06:31:20.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc741410700 1 -- 172.21.15.100:0/1269847629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400bd70 con 0x7fc73c15ca60 2023-11-17T06:31:20.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 -- 172.21.15.100:0/1269847629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c15ca60 msgr2=0x7fc73c15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.078+0000 7fc743414700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c15ca60 0x7fc73c15ce60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc734009e50 tx=0x7fc73400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 -- 172.21.15.100:0/1269847629 shutdown_connections 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c15ca60 0x7fc73c15ce60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 --2- 172.21.15.100:0/1269847629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c0cb9e0 0x7fc73c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 -- 172.21.15.100:0/1269847629 >> 172.21.15.100:0/1269847629 conn(0x7fc73c06a480 msgr2=0x7fc73c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 -- 172.21.15.100:0/1269847629 shutdown_connections 2023-11-17T06:31:20.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 -- 172.21.15.100:0/1269847629 wait complete. 2023-11-17T06:31:20.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 Processor -- start 2023-11-17T06:31:20.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.082+0000 7fc743414700 1 -- start start 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c06bc20 0x7fc73c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc73c15ca60 0x7fc73c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c0c3f30 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c1f7550 con 0x7fc73c15ca60 2023-11-17T06:31:20.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c0ce630 con 0x7fc73c06bc20 2023-11-17T06:31:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc742412700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c06bc20 0x7fc73c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46734/0 (socket says 172.21.15.100:46734) 2023-11-17T06:31:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 -- 172.21.15.100:0/2825040699 learned_addr learned my addr 172.21.15.100:0/2825040699 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:20.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc742c13700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc73c15ca60 0x7fc73c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 -- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c06bc20 msgr2=0x7fc73c0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c06bc20 0x7fc73c0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 -- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc73c15ca60 msgr2=0x7fc73c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc73c15ca60 0x7fc73c154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 -- 172.21.15.100:0/2825040699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734009b30 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc741c11700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c460 tx=0x7fc72c00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c005cd0 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c005e30 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0072d0 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.086+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c0cd850 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.090+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73c0cd570 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.090+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c067990 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.090+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc72c007430 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.094+0000 7fc732ffd700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 0x7fc7200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.094+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc72c082ff0 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.094+0000 7fc742412700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 0x7fc7200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.094+0000 7fc742412700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 0x7fc7200689d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc738007a60 tx=0x7fc738008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.098+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc72c0b4090 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.286+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc73c0c25d0 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.286+0000 7fc732ffd700 1 -- 172.21.15.100:0/2825040699 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc72c017020 con 0x7fc73c0cb9e0 2023-11-17T06:31:20.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 msgr2=0x7fc7200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 0x7fc7200689d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc738007a60 tx=0x7fc738008040 comp rx=0 tx=0).stop 2023-11-17T06:31:20.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 msgr2=0x7fc73c1f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c460 tx=0x7fc72c00c770 comp rx=0 tx=0).stop 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 shutdown_connections 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc73c15ca60 0x7fc73c154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc720066510 0x7fc7200689d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c0cb9e0 0x7fc73c1f7010 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 --2- 172.21.15.100:0/2825040699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc73c06bc20 0x7fc73c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 >> 172.21.15.100:0/2825040699 conn(0x7fc73c06a480 msgr2=0x7fc73c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 shutdown_connections 2023-11-17T06:31:20.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.290+0000 7fc743414700 1 -- 172.21.15.100:0/2825040699 wait complete. 2023-11-17T06:31:20.298 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:31:20.317 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:31:20.318 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:31:20.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:20.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 Processor -- start 2023-11-17T06:31:20.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 -- start start 2023-11-17T06:31:20.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f151415d510 0x7f15140d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15140d0260 0x7f15140d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151415d8f0 con 0x7f15140d15f0 2023-11-17T06:31:20.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140d2750 con 0x7f151415d510 2023-11-17T06:31:20.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1519087700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b92c0 con 0x7f15140d0260 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f150bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f15140d15f0 0x7f15140b8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37020/0 (socket says 172.21.15.100:37020) 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f150bfff700 1 -- 172.21.15.100:0/2132356737 learned_addr learned my addr 172.21.15.100:0/2132356737 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f1512d9d700 1 --2- 172.21.15.100:0/2132356737 >> v2:172.21.15.119:3300/0 conn(0x7f151415d510 0x7f15140d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.562+0000 7f151359e700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15140d0260 0x7f15140d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1512d9d700 1 -- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15140d0260 msgr2=0x7f15140d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1512d9d700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15140d0260 0x7f15140d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1512d9d700 1 -- 172.21.15.100:0/2132356737 >> v1:172.21.15.100:6789/0 conn(0x7f15140d15f0 legacy=0x7f15140b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f151259c700 1 -- 172.21.15.100:0/2132356737 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240358640 0 0) 0x7f151415d8f0 con 0x7f15140d15f0 2023-11-17T06:31:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1512d9d700 1 -- 172.21.15.100:0/2132356737 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140d1ad0 con 0x7f151415d510 2023-11-17T06:31:20.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1512d9d700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151415d510 0x7f15140d2b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1504009850 tx=0x7f1504009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8ee15e3ea1944c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f151259c700 1 -- 172.21.15.100:0/2132356737 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504011830 con 0x7f151415d510 2023-11-17T06:31:20.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f151259c700 1 -- 172.21.15.100:0/2132356737 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504011990 con 0x7f151415d510 2023-11-17T06:31:20.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f151259c700 1 -- 172.21.15.100:0/2132356737 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504011d20 con 0x7f151415d510 2023-11-17T06:31:20.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 -- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151415d510 msgr2=0x7f15140d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151415d510 0x7f15140d2b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1504009850 tx=0x7f1504009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 -- 172.21.15.100:0/2132356737 shutdown_connections 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15140d0260 0x7f15140d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 --2- 172.21.15.100:0/2132356737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151415d510 0x7f15140d2b70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 -- 172.21.15.100:0/2132356737 >> 172.21.15.100:0/2132356737 conn(0x7f1514073680 msgr2=0x7f1514073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 -- 172.21.15.100:0/2132356737 shutdown_connections 2023-11-17T06:31:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.566+0000 7f1519087700 1 -- 172.21.15.100:0/2132356737 wait complete. 2023-11-17T06:31:20.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.570+0000 7f1519087700 1 Processor -- start 2023-11-17T06:31:20.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.570+0000 7f1519087700 1 -- start start 2023-11-17T06:31:20.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15140d0260 0x7f1514152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151415d510 0x7f1514154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514152cd0 con 0x7f15140d15f0 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151415f500 con 0x7f15140d0260 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140cbe00 con 0x7f151415d510 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46744/0 (socket says 172.21.15.100:46744) 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 -- 172.21.15.100:0/3687573502 learned_addr learned my addr 172.21.15.100:0/3687573502 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1512d9d700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15140d0260 0x7f1514152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f151359e700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151415d510 0x7f1514154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 -- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151415d510 msgr2=0x7f1514154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151415d510 0x7f1514154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 -- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15140d0260 msgr2=0x7f1514152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15140d0260 0x7f1514152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 -- 172.21.15.100:0/3687573502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040094b0 con 0x7f15140d15f0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150bfff700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0011e0 tx=0x7f14fc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc005d90 con 0x7f15140d15f0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0070d0 con 0x7f15140d15f0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc007460 con 0x7f15140d15f0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151415ebd0 con 0x7f15140d15f0 2023-11-17T06:31:20.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.574+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151415f190 con 0x7f15140d15f0 2023-11-17T06:31:20.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.578+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151404eea0 con 0x7f15140d15f0 2023-11-17T06:31:20.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.578+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14fc0075c0 con 0x7f15140d15f0 2023-11-17T06:31:20.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.582+0000 7f150b7fe700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 0x7f14f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.582+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14fc083240 con 0x7f15140d15f0 2023-11-17T06:31:20.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.582+0000 7f1512d9d700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 0x7f14f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.582+0000 7f1512d9d700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 0x7f14f40689d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1504000c00 tx=0x7f1504008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.586+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14fc0506c0 con 0x7f15140d15f0 2023-11-17T06:31:20.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.762+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f151415f350 con 0x7f15140d15f0 2023-11-17T06:31:20.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f150b7fe700 1 -- 172.21.15.100:0/3687573502 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f14fc053ce0 con 0x7f15140d15f0 2023-11-17T06:31:20.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:20.771 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:03.255881+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 msgr2=0x7f14f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 0x7f14f40689d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1504000c00 tx=0x7f1504008030 comp rx=0 tx=0).stop 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 msgr2=0x7f15140cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0011e0 tx=0x7f14fc00ca30 comp rx=0 tx=0).stop 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 shutdown_connections 2023-11-17T06:31:20.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151415d510 0x7f1514154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f14f4066510 0x7f14f40689d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15140d15f0 0x7f15140cb530 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 --2- 172.21.15.100:0/3687573502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15140d0260 0x7f1514152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.766+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 >> 172.21.15.100:0/3687573502 conn(0x7f1514073680 msgr2=0x7f15140b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.770+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 shutdown_connections 2023-11-17T06:31:20.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.770+0000 7f1519087700 1 -- 172.21.15.100:0/3687573502 wait complete. 2023-11-17T06:31:20.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:31:20.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:31:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.970+0000 7face6bd0700 1 Processor -- start 2023-11-17T06:31:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.970+0000 7face6bd0700 1 -- start start 2023-11-17T06:31:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face0070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face0153d90 0x7face015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7face015d6d0 0x7face0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face015db80 con 0x7face0153d90 2023-11-17T06:31:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face006ffe0 con 0x7face015d6d0 2023-11-17T06:31:20.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face6bd0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face00c9400 con 0x7face01539b0 2023-11-17T06:31:20.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face0153d90 0x7face015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face5bce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face0070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face63cf700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7face015d6d0 0x7face0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7face0153d90 0x7face015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46760/0 (socket says 172.21.15.100:46760) 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 -- 172.21.15.100:0/1590821354 learned_addr learned my addr 172.21.15.100:0/1590821354 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 -- 172.21.15.100:0/1590821354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 msgr2=0x7face0070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 --2- 172.21.15.100:0/1590821354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face0070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 -- 172.21.15.100:0/1590821354 >> v2:172.21.15.119:3300/0 conn(0x7face015d6d0 msgr2=0x7face0159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 --2- 172.21.15.100:0/1590821354 >> v2:172.21.15.119:3300/0 conn(0x7face015d6d0 0x7face0159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 -- 172.21.15.100:0/1590821354 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00c96e0 con 0x7face0153d90 2023-11-17T06:31:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face53cd700 1 --2- 172.21.15.100:0/1590821354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face015d190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7face0071b60 tx=0x7facd000ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed00eff37d12bc21 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face4bcc700 1 -- 172.21.15.100:0/1590821354 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000cb70 con 0x7face0153d90 2023-11-17T06:31:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face4bcc700 1 -- 172.21.15.100:0/1590821354 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000ccd0 con 0x7face0153d90 2023-11-17T06:31:20.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.974+0000 7face4bcc700 1 -- 172.21.15.100:0/1590821354 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0018600 con 0x7face0153d90 2023-11-17T06:31:20.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 -- 172.21.15.100:0/1590821354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 msgr2=0x7face015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 --2- 172.21.15.100:0/1590821354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face015d190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7face0071b60 tx=0x7facd000ad90 comp rx=0 tx=0).stop 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 -- 172.21.15.100:0/1590821354 shutdown_connections 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 --2- 172.21.15.100:0/1590821354 >> v2:172.21.15.119:3300/0 conn(0x7face015d6d0 0x7face0159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 --2- 172.21.15.100:0/1590821354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face015d190 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 --2- 172.21.15.100:0/1590821354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face0070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 -- 172.21.15.100:0/1590821354 >> 172.21.15.100:0/1590821354 conn(0x7face00cba10 msgr2=0x7face00cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 -- 172.21.15.100:0/1590821354 shutdown_connections 2023-11-17T06:31:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.978+0000 7face6bd0700 1 -- 172.21.15.100:0/1590821354 wait complete. 2023-11-17T06:31:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 Processor -- start 2023-11-17T06:31:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 -- start start 2023-11-17T06:31:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7face015d6d0 0x7face013f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00b3d70 con 0x7face0153d90 2023-11-17T06:31:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00c6c40 con 0x7face015d6d0 2023-11-17T06:31:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face6bd0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face015be50 con 0x7face01539b0 2023-11-17T06:31:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46772/0 (socket says 172.21.15.100:46772) 2023-11-17T06:31:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 -- 172.21.15.100:0/3281623833 learned_addr learned my addr 172.21.15.100:0/3281623833 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face63cf700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7face015d6d0 0x7face013f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face5bce700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 -- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 msgr2=0x7face00b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face00b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 -- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7face015d6d0 msgr2=0x7face013f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7face015d6d0 0x7face013f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.982+0000 7face53cd700 1 -- 172.21.15.100:0/3281623833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd000a710 con 0x7face0153d90 2023-11-17T06:31:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7face53cd700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facd0000c00 tx=0x7facd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0003ad0 con 0x7face0153d90 2023-11-17T06:31:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd0003c50 con 0x7face0153d90 2023-11-17T06:31:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0022450 con 0x7face0153d90 2023-11-17T06:31:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00b3fa0 con 0x7face0153d90 2023-11-17T06:31:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face00b4560 con 0x7face0153d90 2023-11-17T06:31:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face0067990 con 0x7face0153d90 2023-11-17T06:31:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.986+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7facd00225b0 con 0x7face0153d90 2023-11-17T06:31:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.990+0000 7facd67fc700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 0x7facc40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.990+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facd0085490 con 0x7face0153d90 2023-11-17T06:31:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.990+0000 7face5bce700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 0x7facc40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.990+0000 7face5bce700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 0x7facc40689d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facdc009ad0 tx=0x7facdc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:20.994+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7facd0052af0 con 0x7face0153d90 2023-11-17T06:31:21.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.170+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7face00b3d70 con 0x7face0153d90 2023-11-17T06:31:21.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.170+0000 7facd67fc700 1 -- 172.21.15.100:0/3281623833 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7facd0056110 con 0x7face0153d90 2023-11-17T06:31:21.177 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:31:21.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 msgr2=0x7facc40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 0x7facc40689d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facdc009ad0 tx=0x7facdc009240 comp rx=0 tx=0).stop 2023-11-17T06:31:21.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 msgr2=0x7face00c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facd0000c00 tx=0x7facd0004770 comp rx=0 tx=0).stop 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 shutdown_connections 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7face015d6d0 0x7face013f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7facc4066510 0x7facc40689d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7face0153d90 0x7face00c6700 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 --2- 172.21.15.100:0/3281623833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7face01539b0 0x7face00b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 >> 172.21.15.100:0/3281623833 conn(0x7face00cba10 msgr2=0x7face0153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 shutdown_connections 2023-11-17T06:31:21.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.174+0000 7face6bd0700 1 -- 172.21.15.100:0/3281623833 wait complete. 2023-11-17T06:31:21.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:31:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.382+0000 7f9f9b33c700 1 Processor -- start 2023-11-17T06:31:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.382+0000 7f9f9b33c700 1 -- start start 2023-11-17T06:31:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9b33c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f9415d5a0 0x7f9f941610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9b33c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f941615f0 0x7f9f940cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9b33c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9415d980 con 0x7f9f940d0140 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9b33c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940d18d0 con 0x7f9f941615f0 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9b33c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b6370 con 0x7f9f9415d5a0 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9ab3b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9f940d0140 0x7f9f940b4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37032/0 (socket says 172.21.15.100:37032) 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9ab3b700 1 -- 172.21.15.100:0/2998071329 learned_addr learned my addr 172.21.15.100:0/2998071329 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99b39700 1 --2- 172.21.15.100:0/2998071329 >> v2:172.21.15.100:3300/0 conn(0x7f9f941615f0 0x7f9f940cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f9a33a700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f9415d5a0 0x7f9f941610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99b39700 1 -- 172.21.15.100:0/2998071329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f9415d5a0 msgr2=0x7f9f941610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99338700 1 -- 172.21.15.100:0/2998071329 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573096141 0 0) 0x7f9f9415d980 con 0x7f9f940d0140 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99b39700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f9415d5a0 0x7f9f941610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99b39700 1 -- 172.21.15.100:0/2998071329 >> v1:172.21.15.100:6789/0 conn(0x7f9f940d0140 legacy=0x7f9f940b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.386+0000 7f9f99b39700 1 -- 172.21.15.100:0/2998071329 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94161ae0 con 0x7f9f941615f0 2023-11-17T06:31:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f99b39700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f940cfc00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009850 tx=0x7f9f84009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bb0e26f650c5a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f99338700 1 -- 172.21.15.100:0/2998071329 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011830 con 0x7f9f941615f0 2023-11-17T06:31:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f99338700 1 -- 172.21.15.100:0/2998071329 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011990 con 0x7f9f941615f0 2023-11-17T06:31:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f99338700 1 -- 172.21.15.100:0/2998071329 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011d40 con 0x7f9f941615f0 2023-11-17T06:31:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 -- 172.21.15.100:0/2998071329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 msgr2=0x7f9f940cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f940cfc00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009850 tx=0x7f9f84009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 -- 172.21.15.100:0/2998071329 shutdown_connections 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f940cfc00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/2998071329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f9415d5a0 0x7f9f941610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 -- 172.21.15.100:0/2998071329 >> 172.21.15.100:0/2998071329 conn(0x7f9f9406ad10 msgr2=0x7f9f9406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 -- 172.21.15.100:0/2998071329 shutdown_connections 2023-11-17T06:31:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.390+0000 7f9f9b33c700 1 -- 172.21.15.100:0/2998071329 wait complete. 2023-11-17T06:31:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 Processor -- start 2023-11-17T06:31:21.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 -- start start 2023-11-17T06:31:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f940d0140 0x7f9f94150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f9415d5a0 0x7f9f940b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b59d0 con 0x7f9f941615f0 2023-11-17T06:31:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940ca680 con 0x7f9f9415d5a0 2023-11-17T06:31:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940ca960 con 0x7f9f940d0140 2023-11-17T06:31:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46778/0 (socket says 172.21.15.100:46778) 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 -- 172.21.15.100:0/1970657668 learned_addr learned my addr 172.21.15.100:0/1970657668 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f99b39700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f9415d5a0 0x7f9f940b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9a33a700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f940d0140 0x7f9f94150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 -- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f940d0140 msgr2=0x7f9f94150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f940d0140 0x7f9f94150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 -- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f9415d5a0 msgr2=0x7f9f940b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f9415d5a0 0x7f9f940b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 -- 172.21.15.100:0/1970657668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840094b0 con 0x7f9f941615f0 2023-11-17T06:31:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9ab3b700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00cba0 tx=0x7f9f8c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00aaa0 con 0x7f9f941615f0 2023-11-17T06:31:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00ac20 con 0x7f9f941615f0 2023-11-17T06:31:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0070d0 con 0x7f9f941615f0 2023-11-17T06:31:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.394+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f940cac40 con 0x7f9f941615f0 2023-11-17T06:31:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.398+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940cb200 con 0x7f9f941615f0 2023-11-17T06:31:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.398+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94067990 con 0x7f9f941615f0 2023-11-17T06:31:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.398+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f8c007230 con 0x7f9f941615f0 2023-11-17T06:31:21.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.402+0000 7f9f8affd700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 0x7f9f780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.402+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f8c0838c0 con 0x7f9f941615f0 2023-11-17T06:31:21.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.402+0000 7f9f9a33a700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 0x7f9f780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.402+0000 7f9f9a33a700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 0x7f9f780689d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009bf0 tx=0x7f9f90009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.406+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f8c050d30 con 0x7f9f941615f0 2023-11-17T06:31:21.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.578+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f940cb3f0 con 0x7f9f941615f0 2023-11-17T06:31:21.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.578+0000 7f9f8affd700 1 -- 172.21.15.100:0/1970657668 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f8c018020 con 0x7f9f941615f0 2023-11-17T06:31:21.584 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 msgr2=0x7f9f780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 0x7f9f780689d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009bf0 tx=0x7f9f90009240 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 msgr2=0x7f9f9415f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00cba0 tx=0x7f9f8c00ceb0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 shutdown_connections 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f78066510 0x7f9f780689d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f941615f0 0x7f9f9415f580 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f9415d5a0 0x7f9f940b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 --2- 172.21.15.100:0/1970657668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f940d0140 0x7f9f94150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 >> 172.21.15.100:0/1970657668 conn(0x7f9f9406ad10 msgr2=0x7f9f940cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 shutdown_connections 2023-11-17T06:31:21.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.582+0000 7f9f9b33c700 1 -- 172.21.15.100:0/1970657668 wait complete. 2023-11-17T06:31:21.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:31:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.778+0000 7f3c43fff700 1 Processor -- start 2023-11-17T06:31:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.778+0000 7f3c43fff700 1 -- start start 2023-11-17T06:31:21.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c43fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c4415d5a0 0x7f3c441610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c43fff700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4415d980 con 0x7f3c440d0310 2023-11-17T06:31:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c43fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44161ae0 con 0x7f3c441615f0 2023-11-17T06:31:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c43fff700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440d18d0 con 0x7f3c4415d5a0 2023-11-17T06:31:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c42ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c4415d5a0 0x7f3c441610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c437fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3c440d0310 0x7f3c440d1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37036/0 (socket says 172.21.15.100:37036) 2023-11-17T06:31:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c437fe700 1 -- 172.21.15.100:0/3774258031 learned_addr learned my addr 172.21.15.100:0/3774258031 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.782+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104148854 0 0) 0x7f3c4415d980 con 0x7f3c440d0310 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c0035d0 con 0x7f3c440d0310 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373930477 0 0) 0x7f3c44161ae0 con 0x7f3c441615f0 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c42ffd700 1 -- 172.21.15.100:0/3774258031 >> v1:172.21.15.119:6789/0 conn(0x7f3c441615f0 legacy=0x7f3c440cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c42ffd700 1 -- 172.21.15.100:0/3774258031 >> v1:172.21.15.100:6789/0 conn(0x7f3c440d0310 legacy=0x7f3c440d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c42ffd700 1 -- 172.21.15.100:0/3774258031 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44161dc0 con 0x7f3c4415d5a0 2023-11-17T06:31:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c42ffd700 1 --2- 172.21.15.100:0/3774258031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4415d5a0 0x7f3c441610b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009850 tx=0x7f3c34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee9a28e1db9610f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011830 con 0x7f3c4415d5a0 2023-11-17T06:31:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34011990 con 0x7f3c4415d5a0 2023-11-17T06:31:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c41ffb700 1 -- 172.21.15.100:0/3774258031 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011d40 con 0x7f3c4415d5a0 2023-11-17T06:31:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 -- 172.21.15.100:0/3774258031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4415d5a0 msgr2=0x7f3c441610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3774258031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4415d5a0 0x7f3c441610b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009850 tx=0x7f3c34009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 -- 172.21.15.100:0/3774258031 shutdown_connections 2023-11-17T06:31:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3774258031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4415d5a0 0x7f3c441610b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 -- 172.21.15.100:0/3774258031 >> 172.21.15.100:0/3774258031 conn(0x7f3c4406ad10 msgr2=0x7f3c4406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 -- 172.21.15.100:0/3774258031 shutdown_connections 2023-11-17T06:31:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.786+0000 7f3c43fff700 1 -- 172.21.15.100:0/3774258031 wait complete. 2023-11-17T06:31:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.790+0000 7f3c43fff700 1 Processor -- start 2023-11-17T06:31:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.790+0000 7f3c43fff700 1 -- start start 2023-11-17T06:31:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c440d0310 0x7f3c440caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4415d5a0 0x7f3c44150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441f6e50 con 0x7f3c441615f0 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441f2900 con 0x7f3c4415d5a0 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441f62d0 con 0x7f3c440d0310 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46800/0 (socket says 172.21.15.100:46800) 2023-11-17T06:31:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 -- 172.21.15.100:0/3159510136 learned_addr learned my addr 172.21.15.100:0/3159510136 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c42ffd700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c440d0310 0x7f3c440caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c427fc700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4415d5a0 0x7f3c44150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 -- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c440d0310 msgr2=0x7f3c440caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c440d0310 0x7f3c440caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 -- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4415d5a0 msgr2=0x7f3c44150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4415d5a0 0x7f3c44150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 -- 172.21.15.100:0/3159510136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340094b0 con 0x7f3c441615f0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c437fe700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00ca70 tx=0x7f3c3c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00a770 con 0x7f3c441615f0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00a8d0 con 0x7f3c441615f0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c441f65b0 con 0x7f3c441615f0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00ac40 con 0x7f3c441615f0 2023-11-17T06:31:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c441f6b70 con 0x7f3c441615f0 2023-11-17T06:31:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.794+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c44067990 con 0x7f3c441615f0 2023-11-17T06:31:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.798+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3c3c01b3b0 con 0x7f3c441615f0 2023-11-17T06:31:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.798+0000 7f3c2b7fe700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 0x7f3c300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.798+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c3c083720 con 0x7f3c441615f0 2023-11-17T06:31:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.802+0000 7f3c42ffd700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 0x7f3c300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.802+0000 7f3c42ffd700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 0x7f3c300689d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c340090b0 tx=0x7f3c34008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.806+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c3c050c40 con 0x7f3c441615f0 2023-11-17T06:31:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.982+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c440d0e10 con 0x7f3c441615f0 2023-11-17T06:31:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.982+0000 7f3c2b7fe700 1 -- 172.21.15.100:0/3159510136 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c3c017020 con 0x7f3c441615f0 2023-11-17T06:31:21.988 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:31:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 msgr2=0x7f3c300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 0x7f3c300689d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c340090b0 tx=0x7f3c34008030 comp rx=0 tx=0).stop 2023-11-17T06:31:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 msgr2=0x7f3c440b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00ca70 tx=0x7f3c3c00cb50 comp rx=0 tx=0).stop 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 shutdown_connections 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3c30066510 0x7f3c300689d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c441615f0 0x7f3c440b52f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4415d5a0 0x7f3c44150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 --2- 172.21.15.100:0/3159510136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c440d0310 0x7f3c440caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 >> 172.21.15.100:0/3159510136 conn(0x7f3c4406ad10 msgr2=0x7f3c441605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 shutdown_connections 2023-11-17T06:31:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:21.986+0000 7f3c43fff700 1 -- 172.21.15.100:0/3159510136 wait complete. 2023-11-17T06:31:22.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:31:22.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.182+0000 7f30ecc58700 1 Processor -- start 2023-11-17T06:31:22.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.182+0000 7f30ecc58700 1 -- start start 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.182+0000 7f30ecc58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e81439c0 0x7f30e80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.182+0000 7f30ecc58700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f30e80c6030 0x7f30e80ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e80cd140 con 0x7f30e80cc780 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80ce5d0 con 0x7f30e80c6030 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8143da0 con 0x7f30e81439c0 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f30e80c6030 0x7f30e80ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e77fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e81439c0 0x7f30e80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e6ffd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f30e80cc780 0x7f30e80c5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46978/0 (socket says 172.21.15.100:46978) 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e6ffd700 1 -- 172.21.15.100:0/1150015865 learned_addr learned my addr 172.21.15.100:0/1150015865 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 -- 172.21.15.100:0/1150015865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e81439c0 msgr2=0x7f30e80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 --2- 172.21.15.100:0/1150015865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e81439c0 0x7f30e80cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 -- 172.21.15.100:0/1150015865 >> v1:172.21.15.100:6789/0 conn(0x7f30e80cc780 legacy=0x7f30e80c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 -- 172.21.15.100:0/1150015865 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80cf110 con 0x7f30e80c6030 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e67fc700 1 -- 172.21.15.100:0/1150015865 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826445798 0 0) 0x7f30e80cd140 con 0x7f30e80cc780 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e7fff700 1 --2- 172.21.15.100:0/1150015865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e80ccc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009d90 tx=0x7f30e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df904afb762e247 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e67fc700 1 -- 172.21.15.100:0/1150015865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e000e070 con 0x7f30e80c6030 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e67fc700 1 -- 172.21.15.100:0/1150015865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000bb20 con 0x7f30e80c6030 2023-11-17T06:31:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30e67fc700 1 -- 172.21.15.100:0/1150015865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0012430 con 0x7f30e80c6030 2023-11-17T06:31:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- 172.21.15.100:0/1150015865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 msgr2=0x7f30e80ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 --2- 172.21.15.100:0/1150015865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e80ccc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009d90 tx=0x7f30e000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- 172.21.15.100:0/1150015865 shutdown_connections 2023-11-17T06:31:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 --2- 172.21.15.100:0/1150015865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e80ccc00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 --2- 172.21.15.100:0/1150015865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e81439c0 0x7f30e80cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- 172.21.15.100:0/1150015865 >> 172.21.15.100:0/1150015865 conn(0x7f30e80b1a00 msgr2=0x7f30e80b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- 172.21.15.100:0/1150015865 shutdown_connections 2023-11-17T06:31:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.186+0000 7f30ecc58700 1 -- 172.21.15.100:0/1150015865 wait complete. 2023-11-17T06:31:22.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.190+0000 7f30ecc58700 1 Processor -- start 2023-11-17T06:31:22.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.190+0000 7f30ecc58700 1 -- start start 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e80cc780 0x7f30e8139a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e81439c0 0x7f30e8159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8134b80 con 0x7f30e80c6030 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8136830 con 0x7f30e81439c0 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e81660b0 con 0x7f30e80cc780 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36898/0 (socket says 172.21.15.100:36898) 2023-11-17T06:31:22.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 -- 172.21.15.100:0/3536200369 learned_addr learned my addr 172.21.15.100:0/3536200369 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e6ffd700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e80cc780 0x7f30e8139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e7fff700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e81439c0 0x7f30e8159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 -- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e80cc780 msgr2=0x7f30e8139a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e80cc780 0x7f30e8139a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 -- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e81439c0 msgr2=0x7f30e8159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e81439c0 0x7f30e8159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 -- 172.21.15.100:0/3536200369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009a70 con 0x7f30e80c6030 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30e77fe700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e9b0 tx=0x7f30d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8009670 con 0x7f30e80c6030 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800c850 con 0x7f30e80c6030 2023-11-17T06:31:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8166390 con 0x7f30e80c6030 2023-11-17T06:31:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800cbc0 con 0x7f30e80c6030 2023-11-17T06:31:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.194+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8139f50 con 0x7f30e80c6030 2023-11-17T06:31:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.198+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e8067990 con 0x7f30e80c6030 2023-11-17T06:31:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.198+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f30d800cd20 con 0x7f30e80c6030 2023-11-17T06:31:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.202+0000 7f30cffff700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 0x7f30d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.202+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d8084330 con 0x7f30e80c6030 2023-11-17T06:31:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.202+0000 7f30e6ffd700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 0x7f30d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.202+0000 7f30e6ffd700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 0x7f30d40689d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30e80cbe40 tx=0x7f30dc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.206+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30d8051720 con 0x7f30e80c6030 2023-11-17T06:31:22.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.394+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30e806d0a0 con 0x7f30e80c6030 2023-11-17T06:31:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.394+0000 7f30cffff700 1 -- 172.21.15.100:0/3536200369 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30d8054d40 con 0x7f30e80c6030 2023-11-17T06:31:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 msgr2=0x7f30d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 0x7f30d40689d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30e80cbe40 tx=0x7f30dc007c00 comp rx=0 tx=0).stop 2023-11-17T06:31:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 msgr2=0x7f30e8166b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e9b0 tx=0x7f30d800ed70 comp rx=0 tx=0).stop 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 shutdown_connections 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e81439c0 0x7f30e8159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30e80cc780 0x7f30e8139a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f30d4066510 0x7f30d40689d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 --2- 172.21.15.100:0/3536200369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e80c6030 0x7f30e8166b90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 >> 172.21.15.100:0/3536200369 conn(0x7f30e80b1a00 msgr2=0x7f30e813ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 shutdown_connections 2023-11-17T06:31:22.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:22.398+0000 7f30ecc58700 1 -- 172.21.15.100:0/3536200369 wait complete. 2023-11-17T06:31:22.406 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2023-11-17T06:31:22.426 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-11-17T06:31:22.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:22.426 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:22.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[46937]: fuse finished with error 0 and tester_r 0 2023-11-17T06:31:22.458 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:28.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:31:28.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:28.560 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:31:28.583 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-11-17T06:31:28.811 INFO:teuthology.orchestra.run.smithi119.stdout:{"message":"","return_code":0} 2023-11-17T06:31:28.812 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-17T06:31:28.812 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:31:28.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.990+0000 7f69665ad700 1 Processor -- start 2023-11-17T06:31:28.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.990+0000 7f69665ad700 1 -- start start 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 0x7f69600cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f696006bc20 0x7f696006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f696015ca60 0x7f696015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6960155e10 con 0x7f696015ca60 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600cb620 con 0x7f696006bc20 2023-11-17T06:31:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69665ad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600cc300 con 0x7f69600cb9e0 2023-11-17T06:31:29.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f696015ca60 0x7f696015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f696015ca60 0x7f696015ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36906/0 (socket says 172.21.15.100:36906) 2023-11-17T06:31:29.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 -- 172.21.15.100:0/642593251 learned_addr learned my addr 172.21.15.100:0/642593251 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69655ab700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 0x7f69600cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6964daa700 1 --2- 172.21.15.100:0/642593251 >> v2:172.21.15.119:3300/0 conn(0x7f696006bc20 0x7f696006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 -- 172.21.15.100:0/642593251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 msgr2=0x7f69600cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 0x7f69600cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 -- 172.21.15.100:0/642593251 >> v2:172.21.15.119:3300/0 conn(0x7f696006bc20 msgr2=0x7f696006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 --2- 172.21.15.100:0/642593251 >> v2:172.21.15.119:3300/0 conn(0x7f696006bc20 0x7f696006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 -- 172.21.15.100:0/642593251 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696006c150 con 0x7f696015ca60 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f69655ab700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 0x7f69600cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:29.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6965dac700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696015ca60 0x7f696015ce60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f69600ceba0 tx=0x7f695800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cbaf39df8db5dc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6957fff700 1 -- 172.21.15.100:0/642593251 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800e070 con 0x7f696015ca60 2023-11-17T06:31:29.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6957fff700 1 -- 172.21.15.100:0/642593251 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800b910 con 0x7f696015ca60 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.994+0000 7f6957fff700 1 -- 172.21.15.100:0/642593251 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800bcc0 con 0x7f696015ca60 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 -- 172.21.15.100:0/642593251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696015ca60 msgr2=0x7f696015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696015ca60 0x7f696015ce60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f69600ceba0 tx=0x7f695800b330 comp rx=0 tx=0).stop 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 -- 172.21.15.100:0/642593251 shutdown_connections 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696015ca60 0x7f696015ce60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 --2- 172.21.15.100:0/642593251 >> v2:172.21.15.119:3300/0 conn(0x7f696006bc20 0x7f696006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 --2- 172.21.15.100:0/642593251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69600cb9e0 0x7f69600cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 -- 172.21.15.100:0/642593251 >> 172.21.15.100:0/642593251 conn(0x7f696006a480 msgr2=0x7f696006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 -- 172.21.15.100:0/642593251 shutdown_connections 2023-11-17T06:31:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:28.998+0000 7f69665ad700 1 -- 172.21.15.100:0/642593251 wait complete. 2023-11-17T06:31:29.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 Processor -- start 2023-11-17T06:31:29.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 -- start start 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f696006bc20 0x7f6960154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696015ca60 0x7f69600c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600c6c10 con 0x7f69600cb9e0 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600c6ef0 con 0x7f696015ca60 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69665ad700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600c71d0 con 0x7f696006bc20 2023-11-17T06:31:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f6964daa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f6964daa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36916/0 (socket says 172.21.15.100:36916) 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f6964daa700 1 -- 172.21.15.100:0/2042253114 learned_addr learned my addr 172.21.15.100:0/2042253114 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f6965dac700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696015ca60 0x7f69600c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.002+0000 7f69655ab700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f696006bc20 0x7f6960154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 -- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f696006bc20 msgr2=0x7f6960154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f696006bc20 0x7f6960154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 -- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696015ca60 msgr2=0x7f69600c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696015ca60 0x7f69600c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 -- 172.21.15.100:0/2042253114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958009b30 con 0x7f69600cb9e0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6964daa700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f695000e790 tx=0x7f695000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950013680 con 0x7f69600cb9e0 2023-11-17T06:31:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500137e0 con 0x7f69600cb9e0 2023-11-17T06:31:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69600c74b0 con 0x7f69600cb9e0 2023-11-17T06:31:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950013b70 con 0x7f69600cb9e0 2023-11-17T06:31:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69600c7cb0 con 0x7f69600cb9e0 2023-11-17T06:31:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.006+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960067990 con 0x7f69600cb9e0 2023-11-17T06:31:29.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.010+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6950013cd0 con 0x7f69600cb9e0 2023-11-17T06:31:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.010+0000 7f6955ffb700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 0x7f69440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.010+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6950083b90 con 0x7f69600cb9e0 2023-11-17T06:31:29.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.010+0000 7f69655ab700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 0x7f69440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.010+0000 7f69655ab700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 0x7f69440689d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c960 tx=0x7f695c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.014+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69500510a0 con 0x7f69600cb9e0 2023-11-17T06:31:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.226+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f69600c8ff0 con 0x7f69600cb9e0 2023-11-17T06:31:29.231 INFO:tasks.ceph.mon.a.smithi100.stderr:2023-11-17T06:31:29.226+0000 7f0e7e1f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:31:29.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.230+0000 7f6955ffb700 1 -- 172.21.15.100:0/2042253114 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f69500546c0 con 0x7f69600cb9e0 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 msgr2=0x7f69440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 0x7f69440689d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c960 tx=0x7f695c008040 comp rx=0 tx=0).stop 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 msgr2=0x7f69600c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f695000e790 tx=0x7f695000eaa0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 shutdown_connections 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f696015ca60 0x7f69600c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6944066510 0x7f69440689d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69600cb9e0 0x7f69600c4800 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 --2- 172.21.15.100:0/2042253114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f696006bc20 0x7f6960154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 >> 172.21.15.100:0/2042253114 conn(0x7f696006a480 msgr2=0x7f696006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 shutdown_connections 2023-11-17T06:31:29.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.234+0000 7f69665ad700 1 -- 172.21.15.100:0/2042253114 wait complete. 2023-11-17T06:31:29.244 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:31:29.263 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-11-17T06:31:29.322 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-11-17T06:31:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.326+0000 7f06f512d140 1 Processor -- start 2023-11-17T06:31:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.326+0000 7f06f512d140 1 -- start start 2023-11-17T06:31:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca95f6b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca96002860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca95e7bba0 con 0x55ca96006c40 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca95e7a4e0 con 0x55ca95f279f0 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca95e4d240 con 0x55ca96007020 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:42208/0 (socket says 172.21.15.100:42208) 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 -- 172.21.15.100:0/1539999118 learned_addr learned my addr 172.21.15.100:0/1539999118 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f2466700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca96002860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f2c67700 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca95f6b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 -- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 msgr2=0x55ca95f6b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca95f6b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 -- 172.21.15.100:0/1539999118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 msgr2=0x55ca96002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca96002860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 -- 172.21.15.100:0/1539999118 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec00a1c0 con 0x55ca96007020 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f3468700 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005dc0 tx=0x7f06ec00e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5eb45bc3ab509e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f1464700 1 -- 172.21.15.100:0/1539999118 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00eaa0 con 0x55ca96007020 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f1464700 1 -- 172.21.15.100:0/1539999118 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00ec00 con 0x55ca96007020 2023-11-17T06:31:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f1464700 1 -- 172.21.15.100:0/1539999118 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec010440 con 0x55ca96007020 2023-11-17T06:31:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 msgr2=0x55ca95f561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005dc0 tx=0x7f06ec00e000 comp rx=0 tx=0).stop 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- 172.21.15.100:0/1539999118 shutdown_connections 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f561f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca96002860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 --2- 172.21.15.100:0/1539999118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca95f6b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- 172.21.15.100:0/1539999118 >> 172.21.15.100:0/1539999118 conn(0x55ca95f2da00 msgr2=0x55ca96003200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- 172.21.15.100:0/1539999118 shutdown_connections 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- 172.21.15.100:0/1539999118 wait complete. 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 Processor -- start 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.330+0000 7f06f512d140 1 -- start start 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca9609bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca95f262d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f26810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca96001a30 con 0x55ca96006c40 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca96001c90 con 0x55ca95f279f0 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca96001f30 con 0x55ca96007020 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2466700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca95f262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2466700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca95f262d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36934/0 (socket says 172.21.15.100:36934) 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2466700 1 -- 172.21.15.100:0/2631196502 learned_addr learned my addr 172.21.15.100:0/2631196502 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f3468700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f26810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca9609bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 -- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 msgr2=0x55ca95f26810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f26810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 -- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 msgr2=0x55ca95f262d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca96006c40 0x55ca95f262d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 -- 172.21.15.100:0/2631196502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca95e7f390 con 0x55ca95f279f0 2023-11-17T06:31:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f3468700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ca96007020 0x55ca95f26810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f2c67700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca9609bca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ee0 tx=0x7f06e40086e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06dbfff700 1 -- 172.21.15.100:0/2631196502 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011040 con 0x55ca95f279f0 2023-11-17T06:31:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06dbfff700 1 -- 172.21.15.100:0/2631196502 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4016680 con 0x55ca95f279f0 2023-11-17T06:31:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06dbfff700 1 -- 172.21.15.100:0/2631196502 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4016a10 con 0x55ca95f279f0 2023-11-17T06:31:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca95e653a0 con 0x55ca95f279f0 2023-11-17T06:31:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.334+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca95e58550 con 0x55ca95f279f0 2023-11-17T06:31:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.338+0000 7f06dbfff700 1 -- 172.21.15.100:0/2631196502 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06e4016b70 con 0x55ca95f279f0 2023-11-17T06:31:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06dbfff700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f06e0064e40 0x7f06e0067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06dbfff700 1 -- 172.21.15.100:0/2631196502 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f06e4082500 con 0x55ca95f279f0 2023-11-17T06:31:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f2466700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f06e0064e40 0x7f06e0067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f512d140 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ca95f171f0 0x55ca960996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55ca96099c10 con 0x55ca95f171f0 2023-11-17T06:31:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f3468700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ca95f171f0 0x55ca960996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f2466700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f06e0064e40 0x7f06e0067300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06e8003f10 tx=0x7f06e80039b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.342+0000 7f06f3468700 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ca95f171f0 0x55ca960996d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f3468700 1 -- 172.21.15.100:0/2631196502 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7f06ec02c040 con 0x55ca95f171f0 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:10_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:11_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:12_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:15_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:19_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:1_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:20_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:21_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:27_head 2023-11-17T06:31:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:28_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:2_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:31_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:34_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:36_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:38_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:39_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:3_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:42_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:43_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:46_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:4_head 2023-11-17T06:31:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:50_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:52_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:53_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:55_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:59_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:61_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:63_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:64_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:65_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:66_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:69_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:70_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:73_head 2023-11-17T06:31:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:74_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:75_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:77_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:80_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:83_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:84_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:85_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:86_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:87_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:88_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:8_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:90_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:92_head 2023-11-17T06:31:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:95_head 2023-11-17T06:31:29.358 INFO:teuthology.orchestra.run.smithi100.stdout:96_head 2023-11-17T06:31:29.358 INFO:teuthology.orchestra.run.smithi100.stdout:97_head 2023-11-17T06:31:29.358 INFO:teuthology.orchestra.run.smithi100.stdout:9_head 2023-11-17T06:31:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ca95f171f0 msgr2=0x55ca960996d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ca95f171f0 0x55ca960996d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f06e0064e40 msgr2=0x7f06e0067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f06e0064e40 0x7f06e0067300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06e8003f10 tx=0x7f06e80039b0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 msgr2=0x55ca9609bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.346+0000 7f06f512d140 1 --2- 172.21.15.100:0/2631196502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca95f279f0 0x55ca9609bca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ee0 tx=0x7f06e40086e0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.350+0000 7f06f3468700 1 -- 172.21.15.100:0/2631196502 reap_dead start 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.350+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 shutdown_connections 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.350+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 >> 172.21.15.100:0/2631196502 conn(0x55ca95f2da00 msgr2=0x55ca95f573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.350+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 shutdown_connections 2023-11-17T06:31:29.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.350+0000 7f06f512d140 1 -- 172.21.15.100:0/2631196502 wait complete. 2023-11-17T06:31:29.361 INFO:tasks.cephfs.test_data_scan:victim_key=21_head 2023-11-17T06:31:29.361 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.01000000 21_head 2023-11-17T06:31:29.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 Processor -- start 2023-11-17T06:31:29.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 -- start start 2023-11-17T06:31:29.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66ab3d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66aa94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66a9b7ba0 con 0x55b66aaaea50 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66a9b64e0 con 0x55b66aa64640 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b66a989240 con 0x55b66ab3fb60 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36960/0 (socket says 172.21.15.100:36960) 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 -- 172.21.15.100:0/2278087464 learned_addr learned my addr 172.21.15.100:0/2278087464 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36d116700 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66ab3d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36d917700 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66aa94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 -- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 msgr2=0x55b66aa94b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66aa94b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 -- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 msgr2=0x55b66ab3d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66ab3d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 -- 172.21.15.100:0/2278087464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360005d20 con 0x55b66aaaea50 2023-11-17T06:31:29.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.422+0000 7fc36c915700 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc358006f00 tx=0x7fc358001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21b6c966480d8d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc3677fe700 1 -- 172.21.15.100:0/2278087464 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358006110 con 0x55b66aaaea50 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc3677fe700 1 -- 172.21.15.100:0/2278087464 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358006270 con 0x55b66aaaea50 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc3677fe700 1 -- 172.21.15.100:0/2278087464 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358004760 con 0x55b66aaaea50 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- 172.21.15.100:0/2278087464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 msgr2=0x55b66ab3ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc358006f00 tx=0x7fc358001930 comp rx=0 tx=0).stop 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- 172.21.15.100:0/2278087464 shutdown_connections 2023-11-17T06:31:29.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66aa94b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66ab3ded0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/2278087464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66ab3d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- 172.21.15.100:0/2278087464 >> 172.21.15.100:0/2278087464 conn(0x55b66aa93280 msgr2=0x55b66ab427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- 172.21.15.100:0/2278087464 shutdown_connections 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- 172.21.15.100:0/2278087464 wait complete. 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 Processor -- start 2023-11-17T06:31:29.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.426+0000 7fc36f5dc140 1 -- start start 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66abd4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66aaa6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66ab3d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66aaa5270 con 0x55b66aaaea50 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66aaa5510 con 0x55b66aa64640 2023-11-17T06:31:29.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b66abd52a0 con 0x55b66ab3fb60 2023-11-17T06:31:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66aaa6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66aaa6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36966/0 (socket says 172.21.15.100:36966) 2023-11-17T06:31:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 -- 172.21.15.100:0/4203420484 learned_addr learned my addr 172.21.15.100:0/4203420484 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36d116700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66abd4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36d917700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66ab3d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 -- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 msgr2=0x55b66ab3d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66ab3d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 -- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 msgr2=0x55b66abd4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b66aa64640 0x55b66abd4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 -- 172.21.15.100:0/4203420484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c001e10 con 0x55b66aaaea50 2023-11-17T06:31:29.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36d917700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55b66ab3fb60 0x55b66ab3d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36c915700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66aaa6d40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc358001970 tx=0x7fc358000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc3667fc700 1 -- 172.21.15.100:0/4203420484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358013420 con 0x55b66aaaea50 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc3667fc700 1 -- 172.21.15.100:0/4203420484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358013580 con 0x55b66aaaea50 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b66a9a13a0 con 0x55b66aaaea50 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc3667fc700 1 -- 172.21.15.100:0/4203420484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358013930 con 0x55b66aaaea50 2023-11-17T06:31:29.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.430+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b66a994550 con 0x55b66aaaea50 2023-11-17T06:31:29.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc3667fc700 1 -- 172.21.15.100:0/4203420484 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc358013a90 con 0x55b66aaaea50 2023-11-17T06:31:29.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc3667fc700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc350064e40 0x7fc350067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc3667fc700 1 -- 172.21.15.100:0/4203420484 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3580845d0 con 0x55b66aaaea50 2023-11-17T06:31:29.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc36d116700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc350064e40 0x7fc350067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55b66aaa7280 0x55b66aaa5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.434+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-rm-keys in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x55b66ab3de50 con 0x55b66aaa7280 2023-11-17T06:31:29.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.438+0000 7fc36d917700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55b66aaa7280 0x55b66aaa5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.438+0000 7fc36d116700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc350064e40 0x7fc350067300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc36000f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.438+0000 7fc36d917700 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55b66aaa7280 0x55b66aaa5c50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36d917700 1 -- 172.21.15.100:0/4203420484 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(1 10000000000.01000000 [omap-rm-keys] v36'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc368009920 con 0x55b66aaa7280 2023-11-17T06:31:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55b66aaa7280 msgr2=0x55b66aaa5c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55b66aaa7280 0x55b66aaa5c50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc350064e40 msgr2=0x7fc350067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc350064e40 0x7fc350067300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc36000f000 comp rx=0 tx=0).stop 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 msgr2=0x55b66aaa6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 --2- 172.21.15.100:0/4203420484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b66aaaea50 0x55b66aaa6d40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc358001970 tx=0x7fc358000f40 comp rx=0 tx=0).stop 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36d917700 1 -- 172.21.15.100:0/4203420484 reap_dead start 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 shutdown_connections 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 >> 172.21.15.100:0/4203420484 conn(0x55b66aa93280 msgr2=0x55b66ab401f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 shutdown_connections 2023-11-17T06:31:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.442+0000 7fc36f5dc140 1 -- 172.21.15.100:0/4203420484 wait complete. 2023-11-17T06:31:29.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-17T06:31:29.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.622+0000 7fa934439700 1 Processor -- start 2023-11-17T06:31:29.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 -- start start 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c96a0 0x7fa92c15c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c0719f0 0x7fa92c06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c0ca460 con 0x7fa92c0cfc00 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06fdb0 con 0x7fa92c0719f0 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa934439700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c06ffc0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa9329d6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c0719f0 0x7fa92c06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa9329d6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa92c0719f0 0x7fa92c06be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36980/0 (socket says 172.21.15.100:36980) 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa9329d6700 1 -- 172.21.15.100:0/4271412755 learned_addr learned my addr 172.21.15.100:0/4271412755 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.626+0000 7fa9321d5700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c96a0 0x7fa92c15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9329d6700 1 -- 172.21.15.100:0/4271412755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c96a0 msgr2=0x7fa92c15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9329d6700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c96a0 0x7fa92c15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9329d6700 1 -- 172.21.15.100:0/4271412755 >> v1:172.21.15.100:6789/0 conn(0x7fa92c0cfc00 legacy=0x7fa92c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9329d6700 1 -- 172.21.15.100:0/4271412755 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0cb300 con 0x7fa92c0719f0 2023-11-17T06:31:29.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9329d6700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0719f0 0x7fa92c06be10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa924009e50 tx=0x7fa92400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b84e6b7567cf233 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9311d3700 1 -- 172.21.15.100:0/4271412755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400e070 con 0x7fa92c0719f0 2023-11-17T06:31:29.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9311d3700 1 -- 172.21.15.100:0/4271412755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92400b910 con 0x7fa92c0719f0 2023-11-17T06:31:29.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa9311d3700 1 -- 172.21.15.100:0/4271412755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400bcc0 con 0x7fa92c0719f0 2023-11-17T06:31:29.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 -- 172.21.15.100:0/4271412755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0719f0 msgr2=0x7fa92c06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0719f0 0x7fa92c06be10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa924009e50 tx=0x7fa92400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 -- 172.21.15.100:0/4271412755 shutdown_connections 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0719f0 0x7fa92c06be10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 --2- 172.21.15.100:0/4271412755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0c96a0 0x7fa92c15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 -- 172.21.15.100:0/4271412755 >> 172.21.15.100:0/4271412755 conn(0x7fa92c0cf050 msgr2=0x7fa92c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 -- 172.21.15.100:0/4271412755 shutdown_connections 2023-11-17T06:31:29.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.630+0000 7fa934439700 1 -- 172.21.15.100:0/4271412755 wait complete. 2023-11-17T06:31:29.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 Processor -- start 2023-11-17T06:31:29.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 -- start start 2023-11-17T06:31:29.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 0x7fa92c146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 0x7fa92c09bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c73d0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1471c0 con 0x7fa92c0719f0 2023-11-17T06:31:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.634+0000 7fa934439700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c7600 con 0x7fa92c0cfc00 2023-11-17T06:31:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36988/0 (socket says 172.21.15.100:36988) 2023-11-17T06:31:29.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 -- 172.21.15.100:0/4037407491 learned_addr learned my addr 172.21.15.100:0/4037407491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:29.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9321d5700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 0x7fa92c146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9329d6700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 0x7fa92c09bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 -- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 msgr2=0x7fa92c09bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 0x7fa92c09bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 -- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 msgr2=0x7fa92c146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 0x7fa92c146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 -- 172.21.15.100:0/4037407491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009b30 con 0x7fa92c0c96a0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9321d5700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 0x7fa92c146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9329d6700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 0x7fa92c09bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa9319d4700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c440 tx=0x7fa91c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0052d0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c005430 con 0x7fa92c0c96a0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0c78e0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0055a0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c0c7ea0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.638+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c04eea0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.642+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa91c0036a0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.642+0000 7fa922ffd700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 0x7fa9100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.642+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa91c0831e0 con 0x7fa92c0c96a0 2023-11-17T06:31:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.642+0000 7fa9321d5700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 0x7fa9100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.646+0000 7fa9321d5700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 0x7fa9100689d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa928009c40 tx=0x7fa928008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.646+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa91c050560 con 0x7fa92c0c96a0 2023-11-17T06:31:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:29.862+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa92c06db30 con 0x7fa92c0c96a0 2023-11-17T06:31:30.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.246+0000 7fa922ffd700 1 -- 172.21.15.100:0/4037407491 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v19) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa91c053b80 con 0x7fa92c0c96a0 2023-11-17T06:31:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 msgr2=0x7fa9100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 0x7fa9100689d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa928009c40 tx=0x7fa928008040 comp rx=0 tx=0).stop 2023-11-17T06:31:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 msgr2=0x7fa92c0c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c440 tx=0x7fa91c00c800 comp rx=0 tx=0).stop 2023-11-17T06:31:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 shutdown_connections 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa92c0cfc00 0x7fa92c09bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa910066510 0x7fa9100689d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa92c0c96a0 0x7fa92c0c41d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 --2- 172.21.15.100:0/4037407491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa92c0719f0 0x7fa92c146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 >> 172.21.15.100:0/4037407491 conn(0x7fa92c0cf050 msgr2=0x7fa92c0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 shutdown_connections 2023-11-17T06:31:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.250+0000 7fa934439700 1 -- 172.21.15.100:0/4037407491 wait complete. 2023-11-17T06:31:30.257 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-17T06:31:30.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:30.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 Processor -- start 2023-11-17T06:31:30.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 -- start start 2023-11-17T06:31:30.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe9080c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe90806bf20 0x7fe90806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080c9c90 con 0x7fe90815e760 2023-11-17T06:31:30.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe908071dc0 con 0x7fe90806bf20 2023-11-17T06:31:30.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe90cf2e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe908070250 con 0x7fe9080c92f0 2023-11-17T06:31:30.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe9077fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe90815e760 0x7fe9080716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46998/0 (socket says 172.21.15.100:46998) 2023-11-17T06:31:30.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe9077fe700 1 -- 172.21.15.100:0/2858264479 learned_addr learned my addr 172.21.15.100:0/2858264479 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:30.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe906ffd700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe9080c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe907fff700 1 --2- 172.21.15.100:0/2858264479 >> v2:172.21.15.119:3300/0 conn(0x7fe90806bf20 0x7fe90806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe9067fc700 1 -- 172.21.15.100:0/2858264479 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607069588 0 0) 0x7fe9080c9c90 con 0x7fe90815e760 2023-11-17T06:31:30.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe9067fc700 1 -- 172.21.15.100:0/2858264479 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f00035d0 con 0x7fe90815e760 2023-11-17T06:31:30.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe907fff700 1 -- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 msgr2=0x7fe9080c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:30.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe907fff700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe9080c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe907fff700 1 -- 172.21.15.100:0/2858264479 >> v1:172.21.15.100:6789/0 conn(0x7fe90815e760 legacy=0x7fe9080716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.442+0000 7fe907fff700 1 -- 172.21.15.100:0/2858264479 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90806fa40 con 0x7fe90806bf20 2023-11-17T06:31:30.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe907fff700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90806bf20 0x7fe90806c3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58aac46203dc4be0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe9067fc700 1 -- 172.21.15.100:0/2858264479 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000e070 con 0x7fe90806bf20 2023-11-17T06:31:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe9067fc700 1 -- 172.21.15.100:0/2858264479 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000bb20 con 0x7fe90806bf20 2023-11-17T06:31:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe9067fc700 1 -- 172.21.15.100:0/2858264479 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900012430 con 0x7fe90806bf20 2023-11-17T06:31:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 -- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90806bf20 msgr2=0x7fe90806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90806bf20 0x7fe90806c3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 -- 172.21.15.100:0/2858264479 shutdown_connections 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90806bf20 0x7fe90806c3b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/2858264479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe9080c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 -- 172.21.15.100:0/2858264479 >> 172.21.15.100:0/2858264479 conn(0x7fe9080ceca0 msgr2=0x7fe9080cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 -- 172.21.15.100:0/2858264479 shutdown_connections 2023-11-17T06:31:30.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.446+0000 7fe90cf2e700 1 -- 172.21.15.100:0/2858264479 wait complete. 2023-11-17T06:31:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 Processor -- start 2023-11-17T06:31:30.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 -- start start 2023-11-17T06:31:30.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe90814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90815e760 0x7fe9080b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080ac970 con 0x7fe90806bf20 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080acc50 con 0x7fe90815e760 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.450+0000 7fe90cf2e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080acf30 con 0x7fe9080c92f0 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37004/0 (socket says 172.21.15.100:37004) 2023-11-17T06:31:30.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 -- 172.21.15.100:0/3027358285 learned_addr learned my addr 172.21.15.100:0/3027358285 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe906ffd700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe90814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe907fff700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90815e760 0x7fe9080b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 -- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 msgr2=0x7fe90814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe90814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 -- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90815e760 msgr2=0x7fe9080b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90815e760 0x7fe9080b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 -- 172.21.15.100:0/3027358285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009a70 con 0x7fe90806bf20 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe906ffd700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe90814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe9077fe700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c4f0 tx=0x7fe8f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8005d90 con 0x7fe90806bf20 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80070d0 con 0x7fe90806bf20 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080ad210 con 0x7fe90806bf20 2023-11-17T06:31:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8007440 con 0x7fe90806bf20 2023-11-17T06:31:30.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9080ce7c0 con 0x7fe90806bf20 2023-11-17T06:31:30.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.454+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9080ad450 con 0x7fe90806bf20 2023-11-17T06:31:30.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.458+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8f80075a0 con 0x7fe90806bf20 2023-11-17T06:31:30.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.458+0000 7fe8effff700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 0x7fe8f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.462+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe8f8083170 con 0x7fe90806bf20 2023-11-17T06:31:30.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.462+0000 7fe906ffd700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 0x7fe8f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.462+0000 7fe906ffd700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 0x7fe8f40689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ca5a0 tx=0x7fe8fc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.462+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9080ad450 con 0x7fe90806bf20 2023-11-17T06:31:30.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.678+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9080acab0 con 0x7fe90806bf20 2023-11-17T06:31:30.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.678+0000 7fe8effff700 1 -- 172.21.15.100:0/3027358285 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fe9080acab0 con 0x7fe90806bf20 2023-11-17T06:31:30.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:30.685 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:30.254322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"a","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:30.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 msgr2=0x7fe8f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 0x7fe8f40689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ca5a0 tx=0x7fe8fc009240 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 msgr2=0x7fe90815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c4f0 tx=0x7fe8f800c800 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 shutdown_connections 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90815e760 0x7fe9080b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080c92f0 0x7fe90814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8f4066510 0x7fe8f40689d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 --2- 172.21.15.100:0/3027358285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90806bf20 0x7fe90815da00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 >> 172.21.15.100:0/3027358285 conn(0x7fe9080ceca0 msgr2=0x7fe9080b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 shutdown_connections 2023-11-17T06:31:30.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:30.682+0000 7fe90cf2e700 1 -- 172.21.15.100:0/3027358285 wait complete. 2023-11-17T06:31:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2023-11-17T06:31:31.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:31:30.254322+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5208': {'gid': 5208, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.100:6837/3740073099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3740073099}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3740073099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:31:35.252 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5208:up:replay 2023-11-17T06:31:36.211 INFO:tasks.ceph.mds.a.smithi100.stderr:2023-11-17T06:31:36.205+0000 7fbdfcd51700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:31:36.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:36.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.429+0000 7f08fc687700 1 Processor -- start 2023-11-17T06:31:36.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.429+0000 7f08fc687700 1 -- start start 2023-11-17T06:31:36.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fc687700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08f415edd0 0x7f08f40cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fc687700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f08f413e930 0x7f08f40cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fc687700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f415f300 con 0x7f08f413e1c0 2023-11-17T06:31:36.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fc687700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f406a650 con 0x7f08f415edd0 2023-11-17T06:31:36.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fc687700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f415f5e0 con 0x7f08f413e930 2023-11-17T06:31:36.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fa423700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f08f413e1c0 0x7f08f4141390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49624/0 (socket says 172.21.15.100:49624) 2023-11-17T06:31:36.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fa423700 1 -- 172.21.15.100:0/3711483371 learned_addr learned my addr 172.21.15.100:0/3711483371 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:36.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 --2- 172.21.15.100:0/3711483371 >> v2:172.21.15.100:3300/0 conn(0x7f08f415edd0 0x7f08f40cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08fac24700 1 --2- 172.21.15.100:0/3711483371 >> v2:172.21.15.119:3300/0 conn(0x7f08f413e930 0x7f08f40cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9421700 1 -- 172.21.15.100:0/3711483371 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780157623 0 0) 0x7f08f415f300 con 0x7f08f413e1c0 2023-11-17T06:31:36.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9421700 1 -- 172.21.15.100:0/3711483371 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e00035d0 con 0x7f08f413e1c0 2023-11-17T06:31:36.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 -- 172.21.15.100:0/3711483371 >> v2:172.21.15.119:3300/0 conn(0x7f08f413e930 msgr2=0x7f08f40cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:36.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 --2- 172.21.15.100:0/3711483371 >> v2:172.21.15.119:3300/0 conn(0x7f08f413e930 0x7f08f40cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 -- 172.21.15.100:0/3711483371 >> v1:172.21.15.100:6789/0 conn(0x7f08f413e1c0 legacy=0x7f08f4141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 -- 172.21.15.100:0/3711483371 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f415f8c0 con 0x7f08f415edd0 2023-11-17T06:31:36.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9c22700 1 --2- 172.21.15.100:0/3711483371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f40cb8e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f08f415fe80 tx=0x7f08e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3ac8adfbb0642a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9421700 1 -- 172.21.15.100:0/3711483371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4011830 con 0x7f08f415edd0 2023-11-17T06:31:36.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.433+0000 7f08f9421700 1 -- 172.21.15.100:0/3711483371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4011990 con 0x7f08f415edd0 2023-11-17T06:31:36.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08f9421700 1 -- 172.21.15.100:0/3711483371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4011d00 con 0x7f08f415edd0 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- 172.21.15.100:0/3711483371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 msgr2=0x7f08f40cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 --2- 172.21.15.100:0/3711483371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f40cb8e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f08f415fe80 tx=0x7f08e4009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- 172.21.15.100:0/3711483371 shutdown_connections 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 --2- 172.21.15.100:0/3711483371 >> v2:172.21.15.119:3300/0 conn(0x7f08f413e930 0x7f08f40cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 --2- 172.21.15.100:0/3711483371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f40cb8e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- 172.21.15.100:0/3711483371 >> 172.21.15.100:0/3711483371 conn(0x7f08f406d3e0 msgr2=0x7f08f406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- 172.21.15.100:0/3711483371 shutdown_connections 2023-11-17T06:31:36.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- 172.21.15.100:0/3711483371 wait complete. 2023-11-17T06:31:36.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 Processor -- start 2023-11-17T06:31:36.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.437+0000 7f08fc687700 1 -- start start 2023-11-17T06:31:36.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 0x7f08f413c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08f413e930 0x7f08f41f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40accd0 con 0x7f08f415edd0 2023-11-17T06:31:36.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4137570 con 0x7f08f413e930 2023-11-17T06:31:36.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4137850 con 0x7f08f413e1c0 2023-11-17T06:31:36.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45522/0 (socket says 172.21.15.100:45522) 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 -- 172.21.15.100:0/116618030 learned_addr learned my addr 172.21.15.100:0/116618030 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08f9c22700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08f413e930 0x7f08f41f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fa423700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 0x7f08f413c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 -- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 msgr2=0x7f08f413c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 0x7f08f413c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 -- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08f413e930 msgr2=0x7f08f41f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08f413e930 0x7f08f41f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 -- 172.21.15.100:0/116618030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40094b0 con 0x7f08f415edd0 2023-11-17T06:31:36.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fa423700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 0x7f08f413c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:36.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fac24700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00efc0 tx=0x7f08ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec009ea0 con 0x7f08f415edd0 2023-11-17T06:31:36.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00f040 con 0x7f08f415edd0 2023-11-17T06:31:36.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f4137b30 con 0x7f08f415edd0 2023-11-17T06:31:36.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec014480 con 0x7f08f415edd0 2023-11-17T06:31:36.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.441+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f41f2a00 con 0x7f08f415edd0 2023-11-17T06:31:36.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.445+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f404eea0 con 0x7f08f415edd0 2023-11-17T06:31:36.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.445+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f08ec0145e0 con 0x7f08f415edd0 2023-11-17T06:31:36.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.445+0000 7f08eaffd700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 0x7f08d8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.445+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f08ec0846b0 con 0x7f08f415edd0 2023-11-17T06:31:36.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.445+0000 7f08fa423700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 0x7f08d8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.449+0000 7f08fa423700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 0x7f08d8068a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08f0005930 tx=0x7f08f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.453+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08ec051ac0 con 0x7f08f415edd0 2023-11-17T06:31:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.665+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f406c9e0 con 0x7f08f415edd0 2023-11-17T06:31:37.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08eaffd700 1 -- 172.21.15.100:0/116618030 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f08ec0550e0 con 0x7f08f415edd0 2023-11-17T06:31:37.216 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:31:37.216 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:31:32.277084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5208":{"gid":5208,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6837/3740073099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3740073099},{"type":"v1","addr":"172.21.15.100:6837","nonce":3740073099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 msgr2=0x7f08d8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 0x7f08d8068a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08f0005930 tx=0x7f08f0009040 comp rx=0 tx=0).stop 2023-11-17T06:31:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 msgr2=0x7f08f413fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00efc0 tx=0x7f08ec00c3a0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 shutdown_connections 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f08d8066540 0x7f08d8068a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f415edd0 0x7f08f413fe90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08f413e930 0x7f08f41f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 --2- 172.21.15.100:0/116618030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08f413e1c0 0x7f08f413c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 >> 172.21.15.100:0/116618030 conn(0x7f08f406d3e0 msgr2=0x7f08f40af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 shutdown_connections 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:36.669+0000 7f08fc687700 1 -- 172.21.15.100:0/116618030 wait complete. 2023-11-17T06:31:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2023-11-17T06:31:37.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:31:32.277084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5208': {'gid': 5208, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.100:6837/3740073099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3740073099}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3740073099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:31:37.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:31:37.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-17T06:31:37.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 Processor -- start 2023-11-17T06:31:37.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 -- start start 2023-11-17T06:31:37.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2f580cd870 0x7f2f580cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 0x7f2f580cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f58165740 con 0x7f2f580ccaa0 2023-11-17T06:31:37.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f580cdc50 con 0x7f2f580cd870 2023-11-17T06:31:37.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5ef05700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58165a20 con 0x7f2f580ce760 2023-11-17T06:31:37.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5d702700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2f580ccaa0 0x7f2f580ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:53320/0 (socket says 172.21.15.100:53320) 2023-11-17T06:31:37.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5d702700 1 -- 172.21.15.100:0/3776752468 learned_addr learned my addr 172.21.15.100:0/3776752468 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:37.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3776752468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 0x7f2f580cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.805+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3776752468 >> v2:172.21.15.119:3300/0 conn(0x7f2f580cd870 0x7f2f580cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5cf01700 1 -- 172.21.15.100:0/3776752468 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840234521 0 0) 0x7f2f58165740 con 0x7f2f580ccaa0 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5cf01700 1 -- 172.21.15.100:0/3776752468 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f440035d0 con 0x7f2f580ccaa0 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5e704700 1 -- 172.21.15.100:0/3776752468 >> v2:172.21.15.119:3300/0 conn(0x7f2f580cd870 msgr2=0x7f2f580cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3776752468 >> v2:172.21.15.119:3300/0 conn(0x7f2f580cd870 0x7f2f580cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5e704700 1 -- 172.21.15.100:0/3776752468 >> v1:172.21.15.119:6789/0 conn(0x7f2f580ccaa0 legacy=0x7f2f580ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5e704700 1 -- 172.21.15.100:0/3776752468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58165d00 con 0x7f2f580ce760 2023-11-17T06:31:37.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3776752468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 0x7f2f580cbf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009d90 tx=0x7f2f5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd73b5fb79951cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5cf01700 1 -- 172.21.15.100:0/3776752468 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000e070 con 0x7f2f580ce760 2023-11-17T06:31:37.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5cf01700 1 -- 172.21.15.100:0/3776752468 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000bb20 con 0x7f2f580ce760 2023-11-17T06:31:37.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5cf01700 1 -- 172.21.15.100:0/3776752468 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50012430 con 0x7f2f580ce760 2023-11-17T06:31:37.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3776752468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 msgr2=0x7f2f580cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3776752468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 0x7f2f580cbf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009d90 tx=0x7f2f5000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3776752468 shutdown_connections 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3776752468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580ce760 0x7f2f580cbf20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3776752468 >> v2:172.21.15.119:3300/0 conn(0x7f2f580cd870 0x7f2f580cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3776752468 >> 172.21.15.100:0/3776752468 conn(0x7f2f5806a480 msgr2=0x7f2f5806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3776752468 shutdown_connections 2023-11-17T06:31:37.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.809+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3776752468 wait complete. 2023-11-17T06:31:37.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.813+0000 7f2f5ef05700 1 Processor -- start 2023-11-17T06:31:37.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.813+0000 7f2f5ef05700 1 -- start start 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f580ccaa0 0x7f2f5815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580cd870 0x7f2f580c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58071c40 con 0x7f2f580ce760 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580701d0 con 0x7f2f580ccaa0 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5806fba0 con 0x7f2f580cd870 2023-11-17T06:31:37.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45526/0 (socket says 172.21.15.100:45526) 2023-11-17T06:31:37.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 -- 172.21.15.100:0/3031400021 learned_addr learned my addr 172.21.15.100:0/3031400021 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f580ccaa0 0x7f2f5815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5d702700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580cd870 0x7f2f580c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 -- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580cd870 msgr2=0x7f2f580c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580cd870 0x7f2f580c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 -- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f580ccaa0 msgr2=0x7f2f5815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f580ccaa0 0x7f2f5815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 -- 172.21.15.100:0/3031400021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50009a70 con 0x7f2f580ce760 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2f50014040 tx=0x7f2f50004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f4e7fc700 1 -- 172.21.15.100:0/3031400021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50012430 con 0x7f2f580ce760 2023-11-17T06:31:37.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f4e7fc700 1 -- 172.21.15.100:0/3031400021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50020070 con 0x7f2f580ce760 2023-11-17T06:31:37.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f580c2b80 con 0x7f2f580ce760 2023-11-17T06:31:37.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f4e7fc700 1 -- 172.21.15.100:0/3031400021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50004280 con 0x7f2f580ce760 2023-11-17T06:31:37.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.817+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5806fe60 con 0x7f2f580ce760 2023-11-17T06:31:37.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.821+0000 7f2f4e7fc700 1 -- 172.21.15.100:0/3031400021 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f500043e0 con 0x7f2f580ce760 2023-11-17T06:31:37.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.821+0000 7f2f4e7fc700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 0x7f2f3c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.821+0000 7f2f4e7fc700 1 -- 172.21.15.100:0/3031400021 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2f50022070 con 0x7f2f580ce760 2023-11-17T06:31:37.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.821+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 0x7f2f3c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.821+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 0x7f2f3c068a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009b80 tx=0x7f2f54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 Processor -- start 2023-11-17T06:31:37.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 -- start start 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e56f0 0x12e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12e6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1215620 con 0x12e6550 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1212d10 con 0x12e56f0 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x120e600 con 0x12e39a0 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45534/0 (socket says 172.21.15.100:45534) 2023-11-17T06:31:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 -- 172.21.15.100:0/349950369 learned_addr learned my addr 172.21.15.100:0/349950369 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 -- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 msgr2=0x12e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 -- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e56f0 msgr2=0x12e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e56f0 0x12e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 -- 172.21.15.100:0/349950369 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1233850 con 0x12e6550 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f5e704700 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f50084370 tx=0x7f2f50056c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaeab83f04254250 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f3b7fe700 1 -- 172.21.15.100:0/349950369 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5006e070 con 0x12e6550 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f3b7fe700 1 -- 172.21.15.100:0/349950369 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5005b190 con 0x12e6550 2023-11-17T06:31:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.825+0000 7f2f3b7fe700 1 -- 172.21.15.100:0/349950369 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5005f340 con 0x12e6550 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- 172.21.15.100:0/349950369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 msgr2=0x12e6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f50084370 tx=0x7f2f50056c80 comp rx=0 tx=0).stop 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- 172.21.15.100:0/349950369 shutdown_connections 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e6550 0x12e6930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 --2- 172.21.15.100:0/349950369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e56f0 0x12e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- 172.21.15.100:0/349950369 >> 172.21.15.100:0/349950369 conn(0x10334d0 msgr2=0x12ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- 172.21.15.100:0/349950369 shutdown_connections 2023-11-17T06:31:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- 172.21.15.100:0/349950369 wait complete. 2023-11-17T06:31:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 -- start start 2023-11-17T06:31:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.829+0000 7f2f63431740 1 Processor -- start 2023-11-17T06:31:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x11cc6e0 con 0x12e56f0 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x11cc380 con 0x12e6550 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x10b7aa0 con 0x12e39a0 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 10 client.0 _ll_register_callbacks cb 0x11bba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45546/0 (socket says 172.21.15.100:45546) 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 -- 172.21.15.100:0/3216171550 learned_addr learned my addr 172.21.15.100:0/3216171550 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5e704700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 -- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 msgr2=0x12a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 -- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 msgr2=0x12cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 -- 172.21.15.100:0/3216171550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5806fe60 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5d702700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001e80 tx=0x7f2f4800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d67b991b3f1ca6e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800ec80 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2f4800ede0 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12075e0 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f48005900 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 10 client.5556 fetch_fsmap learned FSMap version 23 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x107e960 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12075e0 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f48005a60 con 0x12e56f0 2023-11-17T06:31:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 10 client.5556 fetch_fsmap finished waiting for FSMap version 23 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 10 client.5556 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 20 client.5556 populate_metadata read hostname 'smithi100' 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x12e8030 0x12e8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 4 client.5556 mds_command: new command op to 5208 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 --> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11c7470 con 0x12e8030 2023-11-17T06:31:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.833+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x12e8030 0x12e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f5df03700 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x12e8030 0x12e8410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c29b0d019894351 server_cookie=6eb80d53b0074e73 in_seq=0 out_seq=0 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f38ff9700 10 client.5556 ms_handle_connect on v2:172.21.15.100:6835/3740073099 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f38ff9700 1 -- 172.21.15.100:0/3216171550 <== mds.0 v2:172.21.15.100:6835/3740073099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x11c7470 con 0x12e8030 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f38ff9700 10 client.5556 handle_command_reply: tid=0 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 client.5556 shutdown 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 msgr2=0x12cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001e80 tx=0x7f2f4800e440 comp rx=0 tx=0).stop 2023-11-17T06:31:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 shutdown_connections 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x12e8030 0x12e8410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x12cb270 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f38ff9700 0 client.5556 ms_handle_reset on v2:172.21.15.100:6835/3740073099 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 --2- 172.21.15.100:0/3216171550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e39a0 0x12a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 >> 172.21.15.100:0/3216171550 conn(0x10334d0 msgr2=0x12e46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 shutdown_connections 2023-11-17T06:31:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 1 -- 172.21.15.100:0/3216171550 wait complete. 2023-11-17T06:31:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.837+0000 7f2f63431740 20 client.5556 trim_cache size 0 max 16384 2023-11-17T06:31:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.857+0000 7f2f63431740 1 Processor -- start 2023-11-17T06:31:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.857+0000 7f2f63431740 1 -- start start 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e56f0 0x12ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x1208900 con 0x12e39a0 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x120ba00 con 0x12e6550 2023-11-17T06:31:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x120d490 con 0x12e56f0 2023-11-17T06:31:37.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45556/0 (socket says 172.21.15.100:45556) 2023-11-17T06:31:37.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 -- 172.21.15.100:0/440203123 learned_addr learned my addr 172.21.15.100:0/440203123 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5e704700 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5d702700 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e56f0 0x12ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 -- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e56f0 msgr2=0x12ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e56f0 0x12ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 -- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 msgr2=0x12ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 -- 172.21.15.100:0/440203123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11d14f0 con 0x12e39a0 2023-11-17T06:31:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f5df03700 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x12a78f0 tx=0x7f2f540047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354ee52f48164836 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f3bfff700 1 -- 172.21.15.100:0/440203123 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54028070 con 0x12e39a0 2023-11-17T06:31:37.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f3bfff700 1 -- 172.21.15.100:0/440203123 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54011e30 con 0x12e39a0 2023-11-17T06:31:37.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f3bfff700 1 -- 172.21.15.100:0/440203123 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54015c80 con 0x12e39a0 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- 172.21.15.100:0/440203123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 msgr2=0x12e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x12a78f0 tx=0x7f2f540047e0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- 172.21.15.100:0/440203123 shutdown_connections 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e6550 0x12ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e56f0 0x12ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 --2- 172.21.15.100:0/440203123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e39a0 0x12e6b20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- 172.21.15.100:0/440203123 >> 172.21.15.100:0/440203123 conn(0x10334d0 msgr2=0x12fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- 172.21.15.100:0/440203123 shutdown_connections 2023-11-17T06:31:37.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.861+0000 7f2f63431740 1 -- 172.21.15.100:0/440203123 wait complete. 2023-11-17T06:31:37.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 -- start start 2023-11-17T06:31:37.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 Processor -- start 2023-11-17T06:31:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e39a0 0x134bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 0x134cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d9d80 con 0x12e56f0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1212600 con 0x12e39a0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x11d94f0 con 0x12e6550 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f63431740 10 client.0 _ll_register_callbacks cb 0x11d34b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f5d702700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f5d702700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45558/0 (socket says 172.21.15.100:45558) 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.865+0000 7f2f5d702700 1 -- 172.21.15.100:0/1493973321 learned_addr learned my addr 172.21.15.100:0/1493973321 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5df03700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e39a0 0x134bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5e704700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 0x134cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 -- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 msgr2=0x134cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 0x134cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 -- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e39a0 msgr2=0x134bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e39a0 0x134bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 -- 172.21.15.100:0/1493973321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f54011b60 con 0x12e56f0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5e704700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 0x134cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5d702700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009000 tx=0x7f2f48011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da45e3f45bdd728f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48005900 con 0x12e56f0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2f48005a60 con 0x12e56f0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f5005b190 con 0x12e56f0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f48005c20 con 0x12e56f0 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 10 client.5562 fetch_fsmap learned FSMap version 23 2023-11-17T06:31:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x11b78d0 con 0x12e56f0 2023-11-17T06:31:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5005b190 con 0x12e56f0 2023-11-17T06:31:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f48007070 con 0x12e56f0 2023-11-17T06:31:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 10 client.5562 fetch_fsmap finished waiting for FSMap version 23 2023-11-17T06:31:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 10 client.5562 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-17T06:31:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 20 client.5562 populate_metadata read hostname 'smithi100' 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x134d810 0x1301fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 4 client.5562 mds_command: new command op to 5208 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 --> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x108a460 con 0x134d810 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5df03700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x134d810 0x1301fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 10 client.5562 ms_handle_connect on v2:172.21.15.100:6835/3740073099 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f5df03700 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x134d810 0x1301fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54952c80c8e63da6 server_cookie=1f1c008c52606fad in_seq=0 out_seq=0 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 1 -- 172.21.15.100:0/1493973321 <== mds.0 v2:172.21.15.100:6835/3740073099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x108a460 con 0x134d810 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f38ff9700 10 client.5562 handle_command_reply: tid=0 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 client.5562 shutdown 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 msgr2=0x134c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.869+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009000 tx=0x7f2f48011000 comp rx=0 tx=0).stop 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 shutdown_connections 2023-11-17T06:31:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:6835/3740073099,v1:172.21.15.100:6837/3740073099] conn(0x134d810 0x1301fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x12e6550 0x134cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x12e56f0 0x134c8a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f38ff9700 0 client.5562 ms_handle_reset on v2:172.21.15.100:6835/3740073099 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 --2- 172.21.15.100:0/1493973321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x12e39a0 0x134bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 >> 172.21.15.100:0/1493973321 conn(0x10334d0 msgr2=0x12fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 shutdown_connections 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 1 -- 172.21.15.100:0/1493973321 wait complete. 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f63431740 20 client.5562 trim_cache size 0 max 16384 2023-11-17T06:31:37.880 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "85721606-40d2-46b5-8d45-5c90fa8b3283", 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5208, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 7.6184663280000002, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 36, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 36, 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 43.468912715999998 2023-11-17T06:31:37.881 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 msgr2=0x7f2f3c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 0x7f2f3c068a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009b80 tx=0x7f2f54008040 comp rx=0 tx=0).stop 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 msgr2=0x7f2f58070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2f50014040 tx=0x7f2f50004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 shutdown_connections 2023-11-17T06:31:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2f3c066540 0x7f2f3c068a00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f580ce760 0x7f2f58070660 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f580cd870 0x7f2f580c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 --2- 172.21.15.100:0/3031400021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f580ccaa0 0x7f2f5815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 >> 172.21.15.100:0/3031400021 conn(0x7f2f5806a480 msgr2=0x7f2f5806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 shutdown_connections 2023-11-17T06:31:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:37.873+0000 7f2f5ef05700 1 -- 172.21.15.100:0/3031400021 wait complete. 2023-11-17T06:31:37.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:31:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 Processor -- start 2023-11-17T06:31:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 -- start start 2023-11-17T06:31:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8b415d460 0x7fa8b40ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b4161e70 con 0x7fa8b40cc0f0 2023-11-17T06:31:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b4161260 con 0x7fa8b40c94f0 2023-11-17T06:31:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8ba1e1700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40ae610 con 0x7fa8b415d460 2023-11-17T06:31:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b99e0700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa8b40cc0f0 0x7fa8b40ac9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49630/0 (socket says 172.21.15.100:49630) 2023-11-17T06:31:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b99e0700 1 -- 172.21.15.100:0/3846094016 learned_addr learned my addr 172.21.15.100:0/3846094016 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:31:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b91df700 1 --2- 172.21.15.100:0/3846094016 >> v2:172.21.15.100:3300/0 conn(0x7fa8b415d460 0x7fa8b40ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493686115 0 0) 0x7fa8b4161e70 con 0x7fa8b40cc0f0 2023-11-17T06:31:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a00035d0 con 0x7fa8b40cc0f0 2023-11-17T06:31:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084723334 0 0) 0x7fa8b4161260 con 0x7fa8b40c94f0 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b91df700 1 -- 172.21.15.100:0/3846094016 >> v1:172.21.15.119:6789/0 conn(0x7fa8b40c94f0 legacy=0x7fa8b40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b91df700 1 -- 172.21.15.100:0/3846094016 >> v1:172.21.15.100:6789/0 conn(0x7fa8b40cc0f0 legacy=0x7fa8b40ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.073+0000 7fa8b91df700 1 -- 172.21.15.100:0/3846094016 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4161540 con 0x7fa8b415d460 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8b91df700 1 --2- 172.21.15.100:0/3846094016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ae0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009850 tx=0x7fa8b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddfc844c62caa3f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011830 con 0x7fa8b415d460 2023-11-17T06:31:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0011990 con 0x7fa8b415d460 2023-11-17T06:31:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8abfff700 1 -- 172.21.15.100:0/3846094016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0011d40 con 0x7fa8b415d460 2023-11-17T06:31:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/3846094016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 msgr2=0x7fa8b40ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/3846094016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ae0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009850 tx=0x7fa8b0009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/3846094016 shutdown_connections 2023-11-17T06:31:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/3846094016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ae0d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/3846094016 >> 172.21.15.100:0/3846094016 conn(0x7fa8b406a480 msgr2=0x7fa8b406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/3846094016 shutdown_connections 2023-11-17T06:31:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.077+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/3846094016 wait complete. 2023-11-17T06:31:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 Processor -- start 2023-11-17T06:31:38.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 -- start start 2023-11-17T06:31:38.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 0x7fa8b40c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8b40cc0f0 0x7fa8b415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41f2d30 con 0x7fa8b415d460 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41590d0 con 0x7fa8b40c94f0 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8ba1e1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41593b0 con 0x7fa8b40cc0f0 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8b99e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8b99e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45582/0 (socket says 172.21.15.100:45582) 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.081+0000 7fa8b91df700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 0x7fa8b40c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 -- 172.21.15.100:0/2434159091 learned_addr learned my addr 172.21.15.100:0/2434159091 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:31:38.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b89de700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8b40cc0f0 0x7fa8b415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 -- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8b40cc0f0 msgr2=0x7fa8b415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8b40cc0f0 0x7fa8b415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 -- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 msgr2=0x7fa8b40c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 0x7fa8b40c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 -- 172.21.15.100:0/2434159091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00094b0 con 0x7fa8b415d460 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b91df700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 0x7fa8b40c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8b99e0700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00cae0 tx=0x7fa8ac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac007480 con 0x7fa8b415d460 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac007600 con 0x7fa8b415d460 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b4159690 con 0x7fa8b415d460 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0079b0 con 0x7fa8b415d460 2023-11-17T06:31:38.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.085+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4159c50 con 0x7fa8b415d460 2023-11-17T06:31:38.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.089+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4159e70 con 0x7fa8b415d460 2023-11-17T06:31:38.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.089+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8ac01b3b0 con 0x7fa8b415d460 2023-11-17T06:31:38.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.089+0000 7fa8a9ffb700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 0x7fa8980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:38.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.089+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa8ac083780 con 0x7fa8b415d460 2023-11-17T06:31:38.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.089+0000 7fa8b91df700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 0x7fa8980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:38.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.093+0000 7fa8b91df700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 0x7fa8980689d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00090b0 tx=0x7fa8b001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:38.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.097+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8ac050b90 con 0x7fa8b415d460 2023-11-17T06:31:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.305+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8b4067990 con 0x7fa8b415d460 2023-11-17T06:31:44.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:44.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.305+0000 7fa8a9ffb700 1 -- 172.21.15.100:0/2434159091 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa8ac017070 con 0x7fa8b415d460 2023-11-17T06:31:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:31:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 msgr2=0x7fa8980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 0x7fa8980689d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00090b0 tx=0x7fa8b001c040 comp rx=0 tx=0).stop 2023-11-17T06:31:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 msgr2=0x7fa8b40ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:44.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00cae0 tx=0x7fa8ac00cb10 comp rx=0 tx=0).stop 2023-11-17T06:31:44.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 shutdown_connections 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa898066510 0x7fa8980689d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b415d460 0x7fa8b40ced50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8b40cc0f0 0x7fa8b415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 --2- 172.21.15.100:0/2434159091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8b40c94f0 0x7fa8b40c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 >> 172.21.15.100:0/2434159091 conn(0x7fa8b406a480 msgr2=0x7fa8b40ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:44.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 shutdown_connections 2023-11-17T06:31:44.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:31:38.309+0000 7fa8ba1e1700 1 -- 172.21.15.100:0/2434159091 wait complete. 2023-11-17T06:31:44.856 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:31:44.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:31:44.857 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:31:44.858 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:44.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:44.858 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-11-17T06:31:44.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:44.893 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42016sec preferred_lft 42016sec 2023-11-17T06:31:44.894 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:56:04:b0:e5 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::500a:a9ff:fe52:b4e2/64 scope link 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:44.895 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c84b:a0ff:fe54:7d52/64 scope link 2023-11-17T06:31:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.896 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ce:a0:c8:bf:81:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::cca0:c8ff:febf:810f/64 scope link 2023-11-17T06:31:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:44.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:44.897 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:31:45.019 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:31:45.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:45.022 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-11-17T06:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:32:57.786 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:32:57.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:32:57.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:57.789 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:32:57.789 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:32:57.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:32:57.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:32:57.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:32:57.790 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:32:57.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:57.917 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:32:57.988 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:32:57.988 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:32:57.989 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:32:57.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:57.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-11-17T06:32:58.069 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:32:58.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:32:58.069 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:58.129 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:32:58.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:32:58.130 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:58.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:32:58.275 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:32:58.343 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:32:58.344 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:32:58.345 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:32:58.346 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:32:58.347 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:32:58.347 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:32:58.347 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:32:58.347 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:32:58.347 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:32:58.348 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.350 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:32:58.412 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:32:58.412 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:32:58.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:32:58.494 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:32:58.562 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:32:58.563 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:32:58.564 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.566 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:32:58.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2023-11-17T06:32:58.596+0000 7f482cf5a640 -1 init, newargv = 0x557a78d4df30 newargc=15 2023-11-17T06:32:58.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[47618]: starting ceph client 2023-11-17T06:32:58.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[47618]: starting fuse 2023-11-17T06:32:58.615 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:32:58.615 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:32:58.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:32:58.615 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:32:58.616 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2023-11-17T06:32:58.617 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:32:58.785 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.47618.asok 2023-11-17T06:32:58.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:32:58.805 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47618.asok 2023-11-17T06:32:58.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47618.asok status 2023-11-17T06:32:59.000 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:32:59.000 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "47618", 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5577, 2023-11-17T06:32:59.001 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5577 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 19198366 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:32:59.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 19198366 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5577 192.168.0.1:0/19198366", 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/19198366", 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 23, 2023-11-17T06:32:59.003 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 36, 2023-11-17T06:32:59.004 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:32:59.004 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-11-17T06:32:59.004 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-11-17T06:32:59.004 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:32:59.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:59.015 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-11-17T06:32:59.015 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:59.036 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-11-17T06:32:59.036 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:59.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:59.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:59.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:59.122 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:0 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:10 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:11 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:12 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:13 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:14 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:15 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:16 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:17 2023-11-17T06:32:59.216 INFO:teuthology.orchestra.run.smithi100.stdout:18 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:19 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:2 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:20 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:22 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:23 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:24 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:25 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:26 2023-11-17T06:32:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:27 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:28 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:29 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:3 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:30 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:31 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:32 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:33 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:34 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:35 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:36 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:37 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:38 2023-11-17T06:32:59.218 INFO:teuthology.orchestra.run.smithi100.stdout:39 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:4 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:40 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:41 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:42 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:43 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:44 2023-11-17T06:32:59.219 INFO:teuthology.orchestra.run.smithi100.stdout:45 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:46 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:47 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:48 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:5 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:50 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:51 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:52 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:53 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:54 2023-11-17T06:32:59.220 INFO:teuthology.orchestra.run.smithi100.stdout:55 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:56 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:57 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:58 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:59 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:6 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:60 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:61 2023-11-17T06:32:59.221 INFO:teuthology.orchestra.run.smithi100.stdout:62 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:63 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:64 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:65 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:66 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:67 2023-11-17T06:32:59.222 INFO:teuthology.orchestra.run.smithi100.stdout:68 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:69 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:7 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:70 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:71 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:72 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:73 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:74 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:75 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:76 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:77 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:78 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:79 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:8 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:80 2023-11-17T06:32:59.223 INFO:teuthology.orchestra.run.smithi100.stdout:81 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:82 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:83 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:84 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:85 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:86 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:87 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:88 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:89 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:9 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:90 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:91 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:92 2023-11-17T06:32:59.224 INFO:teuthology.orchestra.run.smithi100.stdout:93 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:94 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:95 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:96 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:97 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:98 2023-11-17T06:32:59.225 INFO:teuthology.orchestra.run.smithi100.stdout:99 2023-11-17T06:32:59.226 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:32:59.226 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:32:59.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:32:59.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 Processor -- start 2023-11-17T06:32:59.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 -- start start 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58fc160b60 0x7f58fc0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc160f40 0x7f58fc0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58fc0d10d0 0x7f58fc0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0d1ac0 con 0x7f58fc160b60 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0d21b0 con 0x7f58fc0d10d0 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5902305700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0b04d0 con 0x7f58fc160f40 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5901303700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58fc160b60 0x7f58fc0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5901303700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58fc160b60 0x7f58fc0d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39234/0 (socket says 172.21.15.100:39234) 2023-11-17T06:32:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5901303700 1 -- 172.21.15.100:0/3460144604 learned_addr learned my addr 172.21.15.100:0/3460144604 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:32:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5901b04700 1 --2- 172.21.15.100:0/3460144604 >> v2:172.21.15.119:3300/0 conn(0x7f58fc0d10d0 0x7f58fc0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.511+0000 7f5900b02700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc160f40 0x7f58fc0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 -- 172.21.15.100:0/3460144604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc160f40 msgr2=0x7f58fc0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc160f40 0x7f58fc0d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 -- 172.21.15.100:0/3460144604 >> v2:172.21.15.119:3300/0 conn(0x7f58fc0d10d0 msgr2=0x7f58fc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 --2- 172.21.15.100:0/3460144604 >> v2:172.21.15.119:3300/0 conn(0x7f58fc0d10d0 0x7f58fc0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 -- 172.21.15.100:0/3460144604 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0d0710 con 0x7f58fc160b60 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5901303700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc160b60 0x7f58fc0d0080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0c67e0 tx=0x7f58f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9325735432d9b4c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f58f3fff700 1 -- 172.21.15.100:0/3460144604 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8011830 con 0x7f58fc160b60 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f58f3fff700 1 -- 172.21.15.100:0/3460144604 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8011990 con 0x7f58fc160b60 2023-11-17T06:32:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f58f3fff700 1 -- 172.21.15.100:0/3460144604 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8011d20 con 0x7f58fc160b60 2023-11-17T06:32:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 -- 172.21.15.100:0/3460144604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc160b60 msgr2=0x7f58fc0d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc160b60 0x7f58fc0d0080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0c67e0 tx=0x7f58f8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 -- 172.21.15.100:0/3460144604 shutdown_connections 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 --2- 172.21.15.100:0/3460144604 >> v2:172.21.15.119:3300/0 conn(0x7f58fc0d10d0 0x7f58fc0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc160f40 0x7f58fc0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 --2- 172.21.15.100:0/3460144604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc160b60 0x7f58fc0d0080 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 -- 172.21.15.100:0/3460144604 >> 172.21.15.100:0/3460144604 conn(0x7f58fc0d31d0 msgr2=0x7f58fc0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 -- 172.21.15.100:0/3460144604 shutdown_connections 2023-11-17T06:32:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.515+0000 7f5902305700 1 -- 172.21.15.100:0/3460144604 wait complete. 2023-11-17T06:32:59.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 Processor -- start 2023-11-17T06:32:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 -- start start 2023-11-17T06:32:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 0x7f58fc0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc160b60 0x7f58fc15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c91a0 con 0x7f58fc151440 2023-11-17T06:32:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c9480 con 0x7f58fc160b60 2023-11-17T06:32:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5902305700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c9760 con 0x7f58fc0d10d0 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5901b04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5901b04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39244/0 (socket says 172.21.15.100:39244) 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5901b04700 1 -- 172.21.15.100:0/3462801840 learned_addr learned my addr 172.21.15.100:0/3462801840 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5901303700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 0x7f58fc0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.519+0000 7f5900b02700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc160b60 0x7f58fc15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 -- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 msgr2=0x7f58fc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 0x7f58fc0c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 -- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc160b60 msgr2=0x7f58fc15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc160b60 0x7f58fc15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 -- 172.21.15.100:0/3462801840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8009570 con 0x7f58fc151440 2023-11-17T06:32:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901303700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 0x7f58fc0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:32:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5901b04700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f58f400eed0 tx=0x7f58f400b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4010040 con 0x7f58fc151440 2023-11-17T06:32:59.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400bb70 con 0x7f58fc151440 2023-11-17T06:32:59.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0c9a40 con 0x7f58fc151440 2023-11-17T06:32:59.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4014400 con 0x7f58fc151440 2023-11-17T06:32:59.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc15b370 con 0x7f58fc151440 2023-11-17T06:32:59.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.523+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc0ca4e0 con 0x7f58fc151440 2023-11-17T06:32:59.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.527+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58f4014560 con 0x7f58fc151440 2023-11-17T06:32:59.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.527+0000 7f58f1ffb700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 0x7f58e00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.527+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f58f4084630 con 0x7f58fc151440 2023-11-17T06:32:59.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.527+0000 7f5901303700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 0x7f58e00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.531+0000 7f5901303700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 0x7f58e00689d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009c30 tx=0x7f58f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.535+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58fc0ca4e0 con 0x7f58fc151440 2023-11-17T06:32:59.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.711+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58fc0ca4e0 con 0x7f58fc151440 2023-11-17T06:32:59.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f58f1ffb700 1 -- 172.21.15.100:0/3462801840 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16724 (secure 0 0 0) 0x7f58fc0ca4e0 con 0x7f58fc151440 2023-11-17T06:32:59.719 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:32:59.719 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":36,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:29.231239+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:32:59.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 msgr2=0x7f58e00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 0x7f58e00689d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009c30 tx=0x7f58f8008030 comp rx=0 tx=0).stop 2023-11-17T06:32:59.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 msgr2=0x7f58fc1518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f58f400eed0 tx=0x7f58f400b0b0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 shutdown_connections 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.715+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f58e0066510 0x7f58e00689d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58fc151440 0x7f58fc1518d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58fc160b60 0x7f58fc15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 --2- 172.21.15.100:0/3462801840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58fc0d10d0 0x7f58fc0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 >> 172.21.15.100:0/3462801840 conn(0x7f58fc0d31d0 msgr2=0x7f58fc15d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:32:59.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 shutdown_connections 2023-11-17T06:32:59.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.719+0000 7f5902305700 1 -- 172.21.15.100:0/3462801840 wait complete. 2023-11-17T06:32:59.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:32:59.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:32:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.923+0000 7feced276700 1 Processor -- start 2023-11-17T06:32:59.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.923+0000 7feced276700 1 -- start start 2023-11-17T06:32:59.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7feced276700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 0x7fece81610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7feced276700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fece81615f0 0x7fece80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7feced276700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece815d980 con 0x7fece80d0140 2023-11-17T06:32:59.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7feced276700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80d18d0 con 0x7fece81615f0 2023-11-17T06:32:59.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7feced276700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80b6370 con 0x7fece815d5a0 2023-11-17T06:32:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fece81615f0 0x7fece80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fece81615f0 0x7fece80cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39258/0 (socket says 172.21.15.100:39258) 2023-11-17T06:32:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 -- 172.21.15.100:0/2368225637 learned_addr learned my addr 172.21.15.100:0/2368225637 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:32:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece6ffd700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 0x7fece81610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 -- 172.21.15.100:0/2368225637 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 msgr2=0x7fece81610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 0x7fece81610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 -- 172.21.15.100:0/2368225637 >> v1:172.21.15.119:6789/0 conn(0x7fece80d0140 legacy=0x7fece80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 -- 172.21.15.100:0/2368225637 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8161ae0 con 0x7fece81615f0 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece6ffd700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 0x7fece81610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece67fc700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece81615f0 0x7fece80cfc00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009910 tx=0x7fecdc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fd83b06daeca68 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece5ffb700 1 -- 172.21.15.100:0/2368225637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00ba60 con 0x7fece81615f0 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece5ffb700 1 -- 172.21.15.100:0/2368225637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00bbc0 con 0x7fece81615f0 2023-11-17T06:32:59.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.927+0000 7fece5ffb700 1 -- 172.21.15.100:0/2368225637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc009e60 con 0x7fece81615f0 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- 172.21.15.100:0/2368225637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece81615f0 msgr2=0x7fece80cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece81615f0 0x7fece80cfc00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009910 tx=0x7fecdc009c20 comp rx=0 tx=0).stop 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- 172.21.15.100:0/2368225637 shutdown_connections 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece81615f0 0x7fece80cfc00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 --2- 172.21.15.100:0/2368225637 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece815d5a0 0x7fece81610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- 172.21.15.100:0/2368225637 >> 172.21.15.100:0/2368225637 conn(0x7fece806ad10 msgr2=0x7fece806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:32:59.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- 172.21.15.100:0/2368225637 shutdown_connections 2023-11-17T06:32:59.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- 172.21.15.100:0/2368225637 wait complete. 2023-11-17T06:32:59.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 Processor -- start 2023-11-17T06:32:59.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.931+0000 7feced276700 1 -- start start 2023-11-17T06:32:59.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fece815d5a0 0x7fece80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece81615f0 0x7fece80cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80cb470 con 0x7fece80d0140 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80b4360 con 0x7fece815d5a0 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80b3a70 con 0x7fece81615f0 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39264/0 (socket says 172.21.15.100:39264) 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece67fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fece815d5a0 0x7fece80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 -- 172.21.15.100:0/449053524 learned_addr learned my addr 172.21.15.100:0/449053524 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:32:59.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece77fe700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece81615f0 0x7fece80cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 -- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece81615f0 msgr2=0x7fece80cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece81615f0 0x7fece80cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 -- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fece815d5a0 msgr2=0x7fece80b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fece815d5a0 0x7fece80b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 -- 172.21.15.100:0/449053524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009570 con 0x7fece80d0140 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7fece6ffd700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e790 tx=0x7fecd800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800c070 con 0x7fece80d0140 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8004230 con 0x7fece80d0140 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80045c0 con 0x7fece80d0140 2023-11-17T06:32:59.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 -- 172.21.15.100:0/449053524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece80cb190 con 0x7fece80d0140 2023-11-17T06:32:59.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.935+0000 7feced276700 1 -- 172.21.15.100:0/449053524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece80b3ff0 con 0x7fece80d0140 2023-11-17T06:32:59.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.939+0000 7feced276700 1 -- 172.21.15.100:0/449053524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece8067990 con 0x7fece80d0140 2023-11-17T06:32:59.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.939+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fecd80036c0 con 0x7fece80d0140 2023-11-17T06:32:59.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.943+0000 7feccf7fe700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 0x7fecd40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.943+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fecd8083b50 con 0x7fece80d0140 2023-11-17T06:32:59.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.943+0000 7fece67fc700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 0x7fecd40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.943+0000 7fece67fc700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 0x7fecd40689d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fece8161a10 tx=0x7fecdc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:32:59.947+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fecd8050f60 con 0x7fece80d0140 2023-11-17T06:33:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.119+0000 7feced276700 1 -- 172.21.15.100:0/449053524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fece80d0e10 con 0x7fece80d0140 2023-11-17T06:33:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.119+0000 7feccf7fe700 1 -- 172.21.15.100:0/449053524 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecd80094e0 con 0x7fece80d0140 2023-11-17T06:33:00.123 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 msgr2=0x7fecd40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 0x7fecd40689d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fece8161a10 tx=0x7fecdc008030 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 msgr2=0x7fece81f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e790 tx=0x7fecd800eaa0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 shutdown_connections 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fece81615f0 0x7fece80cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fece815d5a0 0x7fece80b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fecd4066510 0x7fecd40689d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 --2- 172.21.15.100:0/449053524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece80d0140 0x7fece81f2490 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 >> 172.21.15.100:0/449053524 conn(0x7fece806ad10 msgr2=0x7fece815dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 shutdown_connections 2023-11-17T06:33:00.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.123+0000 7feced276700 1 -- 172.21.15.100:0/449053524 wait complete. 2023-11-17T06:33:00.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.323+0000 7f4aaa848700 1 Processor -- start 2023-11-17T06:33:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.323+0000 7f4aaa848700 1 -- start start 2023-11-17T06:33:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aaa848700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4aa415d2c0 0x7f4aa40ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aaa848700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40cd920 con 0x7f4aa406f310 2023-11-17T06:33:00.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aaa848700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa4070f80 con 0x7f4aa406a9b0 2023-11-17T06:33:00.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aaa848700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40cd080 con 0x7f4aa415d2c0 2023-11-17T06:33:00.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aa37fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4aa406f310 0x7f4aa406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53566/0 (socket says 172.21.15.100:53566) 2023-11-17T06:33:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aa37fe700 1 -- 172.21.15.100:0/2885994540 learned_addr learned my addr 172.21.15.100:0/2885994540 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.327+0000 7f4aa3fff700 1 --2- 172.21.15.100:0/2885994540 >> v2:172.21.15.119:3300/0 conn(0x7f4aa415d2c0 0x7f4aa40ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa3fff700 1 -- 172.21.15.100:0/2885994540 >> v1:172.21.15.119:6789/0 conn(0x7f4aa406a9b0 legacy=0x7f4aa4071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa3fff700 1 -- 172.21.15.100:0/2885994540 >> v1:172.21.15.100:6789/0 conn(0x7f4aa406f310 legacy=0x7f4aa406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa3fff700 1 -- 172.21.15.100:0/2885994540 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40cd360 con 0x7f4aa415d2c0 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa3fff700 1 --2- 172.21.15.100:0/2885994540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa415d2c0 0x7f4aa40ca6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009850 tx=0x7f4a94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1bf5a2d2c77cb1c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa2ffd700 1 -- 172.21.15.100:0/2885994540 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94011830 con 0x7f4aa415d2c0 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa2ffd700 1 -- 172.21.15.100:0/2885994540 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94011990 con 0x7f4aa415d2c0 2023-11-17T06:33:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aa2ffd700 1 -- 172.21.15.100:0/2885994540 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94011d20 con 0x7f4aa415d2c0 2023-11-17T06:33:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 -- 172.21.15.100:0/2885994540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa415d2c0 msgr2=0x7f4aa40ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2885994540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa415d2c0 0x7f4aa40ca6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009850 tx=0x7f4a94009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 -- 172.21.15.100:0/2885994540 shutdown_connections 2023-11-17T06:33:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2885994540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa415d2c0 0x7f4aa40ca6d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 -- 172.21.15.100:0/2885994540 >> 172.21.15.100:0/2885994540 conn(0x7f4aa40b1c50 msgr2=0x7f4aa40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 -- 172.21.15.100:0/2885994540 shutdown_connections 2023-11-17T06:33:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.331+0000 7f4aaa848700 1 -- 172.21.15.100:0/2885994540 wait complete. 2023-11-17T06:33:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 Processor -- start 2023-11-17T06:33:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 -- start start 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4aa406a9b0 0x7f4aa40b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aa415d2c0 0x7f4aa4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40b4130 con 0x7f4aa415d2c0 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40b4410 con 0x7f4aa406f310 2023-11-17T06:33:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40b46f0 con 0x7f4aa406a9b0 2023-11-17T06:33:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:48162/0 (socket says 172.21.15.100:48162) 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 -- 172.21.15.100:0/2062807208 learned_addr learned my addr 172.21.15.100:0/2062807208 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa3fff700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4aa406a9b0 0x7f4aa40b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa8de5700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aa415d2c0 0x7f4aa4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 -- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4aa406a9b0 msgr2=0x7f4aa40b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4aa406a9b0 0x7f4aa40b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 -- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aa415d2c0 msgr2=0x7f4aa4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aa415d2c0 0x7f4aa4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 -- 172.21.15.100:0/2062807208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940094b0 con 0x7f4aa406f310 2023-11-17T06:33:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa37fe700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c700 tx=0x7f4a9800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98005d90 con 0x7f4aa406f310 2023-11-17T06:33:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980070d0 con 0x7f4aa406f310 2023-11-17T06:33:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98007440 con 0x7f4aa406f310 2023-11-17T06:33:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.335+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa415e4c0 con 0x7f4aa406f310 2023-11-17T06:33:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.339+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa40b5b70 con 0x7f4aa406f310 2023-11-17T06:33:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.339+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa404eea0 con 0x7f4aa406f310 2023-11-17T06:33:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.339+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4a980075a0 con 0x7f4aa406f310 2023-11-17T06:33:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.343+0000 7f4aa0ff9700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 0x7f4a900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.343+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a98083200 con 0x7f4aa406f310 2023-11-17T06:33:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.343+0000 7f4aa3fff700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 0x7f4a900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.343+0000 7f4aa3fff700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 0x7f4a900689d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a94014040 tx=0x7f4a9401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.351+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a98050630 con 0x7f4aa406f310 2023-11-17T06:33:00.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.523+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4aa40b4550 con 0x7f4aa406f310 2023-11-17T06:33:00.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.523+0000 7f4aa0ff9700 1 -- 172.21.15.100:0/2062807208 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4aa40b4550 con 0x7f4aa406f310 2023-11-17T06:33:00.528 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:33:00.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 msgr2=0x7f4a900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 0x7f4a900689d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a94014040 tx=0x7f4a9401c040 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 msgr2=0x7f4aa40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c700 tx=0x7f4a9800ca10 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 shutdown_connections 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4a90066510 0x7f4a900689d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4aa415d2c0 0x7f4aa4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aa406f310 0x7f4aa40b3750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 --2- 172.21.15.100:0/2062807208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4aa406a9b0 0x7f4aa40b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 >> 172.21.15.100:0/2062807208 conn(0x7f4aa40b1c50 msgr2=0x7f4aa40ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 shutdown_connections 2023-11-17T06:33:00.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.527+0000 7f4aaa848700 1 -- 172.21.15.100:0/2062807208 wait complete. 2023-11-17T06:33:00.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 Processor -- start 2023-11-17T06:33:00.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 -- start start 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f75700adab0 0x7f75700ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 0x7f75700abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757006bf40 con 0x7f7570165f00 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757006c220 con 0x7f75700adab0 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f757520f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757006c500 con 0x7f75700c2730 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f756e59c700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7570165f00 0x7f75700c2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53582/0 (socket says 172.21.15.100:53582) 2023-11-17T06:33:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f756e59c700 1 -- 172.21.15.100:0/749301287 learned_addr learned my addr 172.21.15.100:0/749301287 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.727+0000 7f756ed9d700 1 --2- 172.21.15.100:0/749301287 >> v2:172.21.15.100:3300/0 conn(0x7f75700adab0 0x7f75700ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756f59e700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 0x7f75700abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756dd9b700 1 -- 172.21.15.100:0/749301287 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409138339 0 0) 0x7f757006bf40 con 0x7f7570165f00 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756dd9b700 1 -- 172.21.15.100:0/749301287 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75580035d0 con 0x7f7570165f00 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756ed9d700 1 -- 172.21.15.100:0/749301287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 msgr2=0x7f75700abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756ed9d700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 0x7f75700abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756ed9d700 1 -- 172.21.15.100:0/749301287 >> v1:172.21.15.100:6789/0 conn(0x7f7570165f00 legacy=0x7f75700c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756ed9d700 1 -- 172.21.15.100:0/749301287 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757006c7e0 con 0x7f75700adab0 2023-11-17T06:33:00.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756f59e700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 0x7f75700abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756ed9d700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700adab0 0x7f75700ae530 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7560009850 tx=0x7f7560009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80602080cc6d75de server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756dd9b700 1 -- 172.21.15.100:0/749301287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560011830 con 0x7f75700adab0 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756dd9b700 1 -- 172.21.15.100:0/749301287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560011990 con 0x7f75700adab0 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f756dd9b700 1 -- 172.21.15.100:0/749301287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560011d40 con 0x7f75700adab0 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 -- 172.21.15.100:0/749301287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700adab0 msgr2=0x7f75700ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700adab0 0x7f75700ae530 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7560009850 tx=0x7f7560009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:00.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 -- 172.21.15.100:0/749301287 shutdown_connections 2023-11-17T06:33:00.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75700c2730 0x7f75700abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 --2- 172.21.15.100:0/749301287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700adab0 0x7f75700ae530 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 -- 172.21.15.100:0/749301287 >> 172.21.15.100:0/749301287 conn(0x7f75700cf050 msgr2=0x7f75700cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 -- 172.21.15.100:0/749301287 shutdown_connections 2023-11-17T06:33:00.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.731+0000 7f757520f700 1 -- 172.21.15.100:0/749301287 wait complete. 2023-11-17T06:33:00.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 Processor -- start 2023-11-17T06:33:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- start start 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75700adab0 0x7f75700c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 0x7f75700b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700b0540 con 0x7f75700c2730 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700af930 con 0x7f75700adab0 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700afc10 con 0x7f7570165f00 2023-11-17T06:33:00.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39300/0 (socket says 172.21.15.100:39300) 2023-11-17T06:33:00.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 -- 172.21.15.100:0/108895103 learned_addr learned my addr 172.21.15.100:0/108895103 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:00.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756ed9d700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75700adab0 0x7f75700c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756f59e700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 0x7f75700b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 -- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 msgr2=0x7f75700b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 0x7f75700b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 -- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75700adab0 msgr2=0x7f75700c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75700adab0 0x7f75700c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 -- 172.21.15.100:0/108895103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009a70 con 0x7f75700c2730 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756f59e700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 0x7f75700b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f756e59c700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f756400c4d0 tx=0x7f756400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564005d90 con 0x7f75700c2730 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640070d0 con 0x7f75700c2730 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564007480 con 0x7f75700c2730 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75600094b0 con 0x7f75700c2730 2023-11-17T06:33:00.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.739+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75700b01d0 con 0x7f75700c2730 2023-11-17T06:33:00.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.743+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757004eea0 con 0x7f75700c2730 2023-11-17T06:33:00.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.743+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75640075e0 con 0x7f75700c2730 2023-11-17T06:33:00.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.747+0000 7f75577fe700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 0x7f755c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.747+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f75640834b0 con 0x7f75700c2730 2023-11-17T06:33:00.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.747+0000 7f756ed9d700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 0x7f755c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.747+0000 7f756ed9d700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 0x7f755c0689d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f75600090b0 tx=0x7f7560008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.751+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7564050850 con 0x7f75700c2730 2023-11-17T06:33:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.927+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75700cfef0 con 0x7f75700c2730 2023-11-17T06:33:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.927+0000 7f75577fe700 1 -- 172.21.15.100:0/108895103 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7564053e70 con 0x7f75700c2730 2023-11-17T06:33:00.932 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:33:00.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 msgr2=0x7f755c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 0x7f755c0689d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f75600090b0 tx=0x7f7560008030 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 msgr2=0x7f75700b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f756400c4d0 tx=0x7f756400c890 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 shutdown_connections 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7570165f00 0x7f75700b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f755c066510 0x7f755c0689d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75700c2730 0x7f75700b0c90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 --2- 172.21.15.100:0/108895103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75700adab0 0x7f75700c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 >> 172.21.15.100:0/108895103 conn(0x7f75700cf050 msgr2=0x7f757006fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 shutdown_connections 2023-11-17T06:33:00.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:00.931+0000 7f757520f700 1 -- 172.21.15.100:0/108895103 wait complete. 2023-11-17T06:33:00.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 Processor -- start 2023-11-17T06:33:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 -- start start 2023-11-17T06:33:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 0x7f35a40d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40b04d0 con 0x7f35a40d17e0 2023-11-17T06:33:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40d0710 con 0x7f35a4160b60 2023-11-17T06:33:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35aa7f4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40d09f0 con 0x7f35a4160f40 2023-11-17T06:33:01.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35a9ff3700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f35a40d17e0 0x7f35a40b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53592/0 (socket says 172.21.15.100:53592) 2023-11-17T06:33:01.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35a9ff3700 1 -- 172.21.15.100:0/2269766609 learned_addr learned my addr 172.21.15.100:0/2269766609 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:01.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.135+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/2269766609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 0x7f35a40d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896423693 0 0) 0x7f35a40b04d0 con 0x7f35a40d17e0 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35900035d0 con 0x7f35a40d17e0 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35a8ff1700 1 -- 172.21.15.100:0/2269766609 >> v1:172.21.15.119:6789/0 conn(0x7f35a4160b60 legacy=0x7f35a40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478048143 0 0) 0x7f35a40d0710 con 0x7f35a4160b60 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35a8ff1700 1 -- 172.21.15.100:0/2269766609 >> v1:172.21.15.100:6789/0 conn(0x7f35a40d17e0 legacy=0x7f35a40b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35a8ff1700 1 -- 172.21.15.100:0/2269766609 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40afe80 con 0x7f35a4160f40 2023-11-17T06:33:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/2269766609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 0x7f35a40d0080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3594009880 tx=0x7f3594009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b802b1669568f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0019f0 con 0x7f35a4160f40 2023-11-17T06:33:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594010590 con 0x7f35a4160f40 2023-11-17T06:33:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f359bfff700 1 -- 172.21.15.100:0/2269766609 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594010940 con 0x7f35a4160f40 2023-11-17T06:33:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 -- 172.21.15.100:0/2269766609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 msgr2=0x7f35a40d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/2269766609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 0x7f35a40d0080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3594009880 tx=0x7f3594009b90 comp rx=0 tx=0).stop 2023-11-17T06:33:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 -- 172.21.15.100:0/2269766609 shutdown_connections 2023-11-17T06:33:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/2269766609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160f40 0x7f35a40d0080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 -- 172.21.15.100:0/2269766609 >> 172.21.15.100:0/2269766609 conn(0x7f35a40d31d0 msgr2=0x7f35a40d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 -- 172.21.15.100:0/2269766609 shutdown_connections 2023-11-17T06:33:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.139+0000 7f35aa7f4700 1 -- 172.21.15.100:0/2269766609 wait complete. 2023-11-17T06:33:01.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.143+0000 7f35aa7f4700 1 Processor -- start 2023-11-17T06:33:01.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.143+0000 7f35aa7f4700 1 -- start start 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 0x7f35a40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40d0030 0x7f35a415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40caf20 con 0x7f35a40d17e0 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40d04e0 con 0x7f35a40d0030 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cd0b0 con 0x7f35a4160b60 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39314/0 (socket says 172.21.15.100:39314) 2023-11-17T06:33:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 -- 172.21.15.100:0/534756846 learned_addr learned my addr 172.21.15.100:0/534756846 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a9ff3700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40d0030 0x7f35a415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 0x7f35a40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 -- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 msgr2=0x7f35a40cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 0x7f35a40cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 -- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40d0030 msgr2=0x7f35a415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40d0030 0x7f35a415a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 -- 172.21.15.100:0/534756846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940094b0 con 0x7f35a40d17e0 2023-11-17T06:33:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 0x7f35a40cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35a97f2700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f35a00011e0 tx=0x7f35a000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a00054e0 con 0x7f35a40d17e0 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00036a0 con 0x7f35a40d17e0 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0003a50 con 0x7f35a40d17e0 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40ca2a0 con 0x7f35a40d17e0 2023-11-17T06:33:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.147+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40ca860 con 0x7f35a40d17e0 2023-11-17T06:33:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.151+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4067990 con 0x7f35a40d17e0 2023-11-17T06:33:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.151+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35a0003bb0 con 0x7f35a40d17e0 2023-11-17T06:33:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.155+0000 7f3599ffb700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 0x7f3588068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.155+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f35a00833e0 con 0x7f35a40d17e0 2023-11-17T06:33:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.155+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 0x7f3588068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.155+0000 7f35a8ff1700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 0x7f3588068a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f35940097d0 tx=0x7f3594010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.159+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35a0050760 con 0x7f35a40d17e0 2023-11-17T06:33:01.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.347+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35a41e6ca0 con 0x7f35a40d17e0 2023-11-17T06:33:01.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.347+0000 7f3599ffb700 1 -- 172.21.15.100:0/534756846 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+124 (secure 0 0 0) 0x7f35a0017090 con 0x7f35a40d17e0 2023-11-17T06:33:01.352 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6835/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:01.352 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6833/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 msgr2=0x7f3588068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 0x7f3588068a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f35940097d0 tx=0x7f3594010000 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 msgr2=0x7f35a4156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f35a00011e0 tx=0x7f35a000ca30 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 shutdown_connections 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40d0030 0x7f35a415a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35a4160b60 0x7f35a40cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3588066540 0x7f3588068a00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 --2- 172.21.15.100:0/534756846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a40d17e0 0x7f35a4156250 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 >> 172.21.15.100:0/534756846 conn(0x7f35a40d31d0 msgr2=0x7f35a41e60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 shutdown_connections 2023-11-17T06:33:01.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.351+0000 7f35aa7f4700 1 -- 172.21.15.100:0/534756846 wait complete. 2023-11-17T06:33:01.358 INFO:teuthology.orchestra.run.smithi100.stderr:listed 2 entries 2023-11-17T06:33:01.376 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:33:01.376 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:01.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:01.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 Processor -- start 2023-11-17T06:33:01.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 -- start start 2023-11-17T06:33:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 0x7ff5080cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50806bc20 0x7ff50806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5080cb620 con 0x7ff50815ca60 2023-11-17T06:33:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff508155e10 con 0x7ff50806bc20 2023-11-17T06:33:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50f49d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5080cc300 con 0x7ff5080cb9e0 2023-11-17T06:33:01.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50806bc20 0x7ff50806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50806bc20 0x7ff50806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39324/0 (socket says 172.21.15.100:39324) 2023-11-17T06:33:01.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 -- 172.21.15.100:0/800777068 learned_addr learned my addr 172.21.15.100:0/800777068 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:01.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50e49b700 1 --2- 172.21.15.100:0/800777068 >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 0x7ff5080cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 -- 172.21.15.100:0/800777068 >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 msgr2=0x7ff5080cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 --2- 172.21.15.100:0/800777068 >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 0x7ff5080cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 -- 172.21.15.100:0/800777068 >> v1:172.21.15.119:6789/0 conn(0x7ff50815ca60 legacy=0x7ff50815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50dc9a700 1 -- 172.21.15.100:0/800777068 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50806c150 con 0x7ff50806bc20 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.611+0000 7ff50e49b700 1 --2- 172.21.15.100:0/800777068 >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 0x7ff5080cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:01.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50dc9a700 1 --2- 172.21.15.100:0/800777068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50806bc20 0x7ff50806fc80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff50806dff0 tx=0x7ff4f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ab731c7f77339e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50d499700 1 -- 172.21.15.100:0/800777068 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800b8a0 con 0x7ff50806bc20 2023-11-17T06:33:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50d499700 1 -- 172.21.15.100:0/800777068 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800ba00 con 0x7ff50806bc20 2023-11-17T06:33:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50d499700 1 -- 172.21.15.100:0/800777068 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800bd90 con 0x7ff50806bc20 2023-11-17T06:33:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 -- 172.21.15.100:0/800777068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50806bc20 msgr2=0x7ff50806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 --2- 172.21.15.100:0/800777068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50806bc20 0x7ff50806fc80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff50806dff0 tx=0x7ff4f8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 -- 172.21.15.100:0/800777068 shutdown_connections 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 --2- 172.21.15.100:0/800777068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50806bc20 0x7ff50806fc80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 --2- 172.21.15.100:0/800777068 >> v2:172.21.15.119:3300/0 conn(0x7ff5080cb9e0 0x7ff5080cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 -- 172.21.15.100:0/800777068 >> 172.21.15.100:0/800777068 conn(0x7ff50806a480 msgr2=0x7ff50806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 -- 172.21.15.100:0/800777068 shutdown_connections 2023-11-17T06:33:01.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.615+0000 7ff50f49d700 1 -- 172.21.15.100:0/800777068 wait complete. 2023-11-17T06:33:01.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.619+0000 7ff50f49d700 1 Processor -- start 2023-11-17T06:33:01.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.619+0000 7ff50f49d700 1 -- start start 2023-11-17T06:33:01.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.619+0000 7ff50f49d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff50806bc20 0x7ff5081f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 0x7ff5080c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f7090 con 0x7ff50815ca60 2023-11-17T06:33:01.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f3b00 con 0x7ff5080cb9e0 2023-11-17T06:33:01.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5081f6510 con 0x7ff50806bc20 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50ec9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 0x7ff5080c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50ec9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39330/0 (socket says 172.21.15.100:39330) 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50e49b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff50806bc20 0x7ff5081f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50ec9c700 1 -- 172.21.15.100:0/3590777640 learned_addr learned my addr 172.21.15.100:0/3590777640 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:01.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 -- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff50806bc20 msgr2=0x7ff5081f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff50806bc20 0x7ff5081f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 -- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 msgr2=0x7ff5080c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 -- 172.21.15.100:0/3590777640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8009570 con 0x7ff5080cb9e0 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50ec9c700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:01.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50dc9a700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 0x7ff5080c92f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8016000 tx=0x7ff4f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80038c0 con 0x7ff5080cb9e0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f801e070 con 0x7ff5080cb9e0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5081f67f0 con 0x7ff5080cb9e0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8003c60 con 0x7ff5080cb9e0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.623+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5081f6db0 con 0x7ff5080cb9e0 2023-11-17T06:33:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.627+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5080cc920 con 0x7ff5080cb9e0 2023-11-17T06:33:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.627+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4f8025480 con 0x7ff5080cb9e0 2023-11-17T06:33:01.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.627+0000 7ff4feffd700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 0x7ff4ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.627+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff4f8020070 con 0x7ff5080cb9e0 2023-11-17T06:33:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.627+0000 7ff50e49b700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 0x7ff4ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.631+0000 7ff50e49b700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 0x7ff4ec0689d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff504006fd0 tx=0x7ff504008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.635+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5080cc920 con 0x7ff5080cb9e0 2023-11-17T06:33:01.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.811+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5080cc920 con 0x7ff5080cb9e0 2023-11-17T06:33:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.811+0000 7ff4feffd700 1 -- 172.21.15.100:0/3590777640 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16724 (secure 0 0 0) 0x7ff5080cc920 con 0x7ff5080cb9e0 2023-11-17T06:33:01.817 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:01.818 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":36,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:31:29.231239+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 msgr2=0x7ff4ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 0x7ff4ec0689d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff504006fd0 tx=0x7ff504008040 comp rx=0 tx=0).stop 2023-11-17T06:33:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 msgr2=0x7ff5080c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 0x7ff5080c92f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8016000 tx=0x7ff4f8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 shutdown_connections 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4ec066510 0x7ff4ec0689d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ca60 0x7ff5080c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080cb9e0 0x7ff5080c92f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 --2- 172.21.15.100:0/3590777640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff50806bc20 0x7ff5081f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 >> 172.21.15.100:0/3590777640 conn(0x7ff50806a480 msgr2=0x7ff50815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 shutdown_connections 2023-11-17T06:33:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:01.815+0000 7ff50f49d700 1 -- 172.21.15.100:0/3590777640 wait complete. 2023-11-17T06:33:01.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:01.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.079+0000 7fb95df7c700 1 Processor -- start 2023-11-17T06:33:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.079+0000 7fb95df7c700 1 -- start start 2023-11-17T06:33:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95df7c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9580cfc00 0x7fb9580d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95df7c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9580d1cf0 0x7fb9580d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95df7c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580d05a0 con 0x7fb95815d5a0 2023-11-17T06:33:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95df7c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580d18d0 con 0x7fb9580d1cf0 2023-11-17T06:33:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95df7c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580b6370 con 0x7fb9580cfc00 2023-11-17T06:33:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9580d1cf0 0x7fb9580d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9580d1cf0 0x7fb9580d2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35186/0 (socket says 172.21.15.100:35186) 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 -- 172.21.15.100:0/994300735 learned_addr learned my addr 172.21.15.100:0/994300735 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb957fff700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9580cfc00 0x7fb9580d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 -- 172.21.15.100:0/994300735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9580cfc00 msgr2=0x7fb9580d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9580cfc00 0x7fb9580d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 -- 172.21.15.100:0/994300735 >> v1:172.21.15.119:6789/0 conn(0x7fb95815d5a0 legacy=0x7fb9581610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 -- 172.21.15.100:0/994300735 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95815d980 con 0x7fb9580d1cf0 2023-11-17T06:33:02.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb95d77b700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d2160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e50 tx=0x7fb95000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcee1e1af67b98 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb9577fe700 1 -- 172.21.15.100:0/994300735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95000e070 con 0x7fb9580d1cf0 2023-11-17T06:33:02.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb9577fe700 1 -- 172.21.15.100:0/994300735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95000b910 con 0x7fb9580d1cf0 2023-11-17T06:33:02.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.083+0000 7fb9577fe700 1 -- 172.21.15.100:0/994300735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95000bcc0 con 0x7fb9580d1cf0 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- 172.21.15.100:0/994300735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 msgr2=0x7fb9580d2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d2160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e50 tx=0x7fb95000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- 172.21.15.100:0/994300735 shutdown_connections 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d2160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 --2- 172.21.15.100:0/994300735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9580cfc00 0x7fb9580d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- 172.21.15.100:0/994300735 >> 172.21.15.100:0/994300735 conn(0x7fb95806ad10 msgr2=0x7fb95806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- 172.21.15.100:0/994300735 shutdown_connections 2023-11-17T06:33:02.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- 172.21.15.100:0/994300735 wait complete. 2023-11-17T06:33:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 Processor -- start 2023-11-17T06:33:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.087+0000 7fb95df7c700 1 -- start start 2023-11-17T06:33:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9580cfc00 0x7fb95814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95815d5a0 0x7fb9580d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580cc460 con 0x7fb9580d1cf0 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95814edf0 con 0x7fb9580cfc00 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580b43a0 con 0x7fb95815d5a0 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35192/0 (socket says 172.21.15.100:35192) 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 -- 172.21.15.100:0/3901688454 learned_addr learned my addr 172.21.15.100:0/3901688454 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95cf7a700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9580cfc00 0x7fb95814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95d77b700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95815d5a0 0x7fb9580d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 -- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95815d5a0 msgr2=0x7fb9580d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95815d5a0 0x7fb9580d2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 -- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9580cfc00 msgr2=0x7fb95814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9580cfc00 0x7fb95814e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 -- 172.21.15.100:0/3901688454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009b30 con 0x7fb9580d1cf0 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb957fff700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e9d0 tx=0x7fb94400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944009720 con 0x7fb9580d1cf0 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94400ee70 con 0x7fb9580d1cf0 2023-11-17T06:33:02.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400ca50 con 0x7fb9580d1cf0 2023-11-17T06:33:02.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9580cc640 con 0x7fb9580d1cf0 2023-11-17T06:33:02.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.091+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9580ccc00 con 0x7fb9580d1cf0 2023-11-17T06:33:02.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.095+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb958067990 con 0x7fb9580d1cf0 2023-11-17T06:33:02.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.095+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb94400cbb0 con 0x7fb9580d1cf0 2023-11-17T06:33:02.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.095+0000 7fb9557fa700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.099+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb944083ea0 con 0x7fb9580d1cf0 2023-11-17T06:33:02.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.099+0000 7fb95cf7a700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.099+0000 7fb95cf7a700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f60 tx=0x7fb94c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.103+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb944051240 con 0x7fb9580d1cf0 2023-11-17T06:33:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.283+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9580d0e10 con 0x7fb9580d1cf0 2023-11-17T06:33:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb9557fa700 1 -- 172.21.15.100:0/3901688454 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb94400ce60 con 0x7fb9580d1cf0 2023-11-17T06:33:02.290 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:33:02.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 msgr2=0x7fb93c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f60 tx=0x7fb94c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:02.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 msgr2=0x7fb9580d29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e9d0 tx=0x7fb94400ece0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 shutdown_connections 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb95815d5a0 0x7fb9580d2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb93c066510 0x7fb93c0689d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9580d1cf0 0x7fb9580d29a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 --2- 172.21.15.100:0/3901688454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9580cfc00 0x7fb95814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 >> 172.21.15.100:0/3901688454 conn(0x7fb95806ad10 msgr2=0x7fb95815dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.287+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 shutdown_connections 2023-11-17T06:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.291+0000 7fb95df7c700 1 -- 172.21.15.100:0/3901688454 wait complete. 2023-11-17T06:33:02.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:02.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.487+0000 7fb42aee2700 1 Processor -- start 2023-11-17T06:33:02.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.487+0000 7fb42aee2700 1 -- start start 2023-11-17T06:33:02.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4240cfc00 0x7fb4240d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42415d980 con 0x7fb4240d1cf0 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb424161ae0 con 0x7fb42415d5a0 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240d18d0 con 0x7fb4240cfc00 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb4296df700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4240cfc00 0x7fb4240d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42a6e1700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb4240d1cf0 0x7fb4240d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45492/0 (socket says 172.21.15.100:45492) 2023-11-17T06:33:02.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42a6e1700 1 -- 172.21.15.100:0/569149148 learned_addr learned my addr 172.21.15.100:0/569149148 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb428ede700 1 -- 172.21.15.100:0/569149148 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569096324 0 0) 0x7fb424161ae0 con 0x7fb42415d5a0 2023-11-17T06:33:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb4296df700 1 -- 172.21.15.100:0/569149148 >> v1:172.21.15.119:6789/0 conn(0x7fb42415d5a0 legacy=0x7fb4241610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb4296df700 1 -- 172.21.15.100:0/569149148 >> v1:172.21.15.100:6789/0 conn(0x7fb4240d1cf0 legacy=0x7fb4240d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb4296df700 1 -- 172.21.15.100:0/569149148 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424161dc0 con 0x7fb4240cfc00 2023-11-17T06:33:02.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb4296df700 1 --2- 172.21.15.100:0/569149148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240cfc00 0x7fb4240d0090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb414009850 tx=0x7fb414009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74851b0fcb7f95b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb428ede700 1 -- 172.21.15.100:0/569149148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414004230 con 0x7fb4240cfc00 2023-11-17T06:33:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb428ede700 1 -- 172.21.15.100:0/569149148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414004390 con 0x7fb4240cfc00 2023-11-17T06:33:02.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb428ede700 1 -- 172.21.15.100:0/569149148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140036c0 con 0x7fb4240cfc00 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- 172.21.15.100:0/569149148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240cfc00 msgr2=0x7fb4240d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 --2- 172.21.15.100:0/569149148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240cfc00 0x7fb4240d0090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb414009850 tx=0x7fb414009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- 172.21.15.100:0/569149148 shutdown_connections 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 --2- 172.21.15.100:0/569149148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240cfc00 0x7fb4240d0090 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.491+0000 7fb42aee2700 1 -- 172.21.15.100:0/569149148 >> 172.21.15.100:0/569149148 conn(0x7fb42406ad10 msgr2=0x7fb42406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- 172.21.15.100:0/569149148 shutdown_connections 2023-11-17T06:33:02.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- 172.21.15.100:0/569149148 wait complete. 2023-11-17T06:33:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 Processor -- start 2023-11-17T06:33:02.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- start start 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4240cfc00 0x7fb4240ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 0x7fb4241f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240cb3c0 con 0x7fb4240d1cf0 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240ca850 con 0x7fb42415d5a0 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42aee2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240cab20 con 0x7fb4240cfc00 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb4296df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb4296df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35214/0 (socket says 172.21.15.100:35214) 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb4296df700 1 -- 172.21.15.100:0/1804655083 learned_addr learned my addr 172.21.15.100:0/1804655083 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb42a6e1700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 0x7fb4241f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.495+0000 7fb429ee0700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4240cfc00 0x7fb4240ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 -- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4240cfc00 msgr2=0x7fb4240ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4240cfc00 0x7fb4240ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 -- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 msgr2=0x7fb4241f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 0x7fb4241f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 -- 172.21.15.100:0/1804655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140094b0 con 0x7fb4240d1cf0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb42a6e1700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 0x7fb4241f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb4296df700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb4140090b0 tx=0x7fb414004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414004500 con 0x7fb4240d1cf0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4240cae00 con 0x7fb4240d1cf0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414011630 con 0x7fb4240d1cf0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140119e0 con 0x7fb4240d1cf0 2023-11-17T06:33:02.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb424155500 con 0x7fb4240d1cf0 2023-11-17T06:33:02.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.499+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424155360 con 0x7fb4240d1cf0 2023-11-17T06:33:02.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.503+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb414011b40 con 0x7fb4240d1cf0 2023-11-17T06:33:02.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.503+0000 7fb41a7fc700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 0x7fb4080689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.503+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb414084ea0 con 0x7fb4240d1cf0 2023-11-17T06:33:02.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.503+0000 7fb429ee0700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 0x7fb4080689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.503+0000 7fb429ee0700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 0x7fb4080689d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb420000f60 tx=0x7fb420009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.507+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb424155360 con 0x7fb4240d1cf0 2023-11-17T06:33:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.683+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb424155360 con 0x7fb4240d1cf0 2023-11-17T06:33:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.683+0000 7fb41a7fc700 1 -- 172.21.15.100:0/1804655083 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb424155360 con 0x7fb4240d1cf0 2023-11-17T06:33:02.687 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:33:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 msgr2=0x7fb4080689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 0x7fb4080689d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb420000f60 tx=0x7fb420009040 comp rx=0 tx=0).stop 2023-11-17T06:33:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 msgr2=0x7fb4240d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb4140090b0 tx=0x7fb414004770 comp rx=0 tx=0).stop 2023-11-17T06:33:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 shutdown_connections 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb42415d5a0 0x7fb4241f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb408066510 0x7fb4080689d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4240d1cf0 0x7fb4240d3040 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 --2- 172.21.15.100:0/1804655083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4240cfc00 0x7fb4240ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 >> 172.21.15.100:0/1804655083 conn(0x7fb42406ad10 msgr2=0x7fb42415c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 shutdown_connections 2023-11-17T06:33:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.687+0000 7fb42aee2700 1 -- 172.21.15.100:0/1804655083 wait complete. 2023-11-17T06:33:02.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:02.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.891+0000 7fb8db1fe700 1 Processor -- start 2023-11-17T06:33:02.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.891+0000 7fb8db1fe700 1 -- start start 2023-11-17T06:33:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8db1fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb8d40adab0 0x7fb8d40ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8db1fe700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d406bf40 con 0x7fb8d40c2730 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8db1fe700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d406c220 con 0x7fb8d4165f00 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8db1fe700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d406c500 con 0x7fb8d40adab0 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d979b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8d40c2730 0x7fb8d40abd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45502/0 (socket says 172.21.15.100:45502) 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d979b700 1 -- 172.21.15.100:0/3740074240 learned_addr learned my addr 172.21.15.100:0/3740074240 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d8f9a700 1 --2- 172.21.15.100:0/3740074240 >> v2:172.21.15.119:3300/0 conn(0x7fb8d40adab0 0x7fb8d40ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679836235 0 0) 0x7fb8d406bf40 con 0x7fb8d40c2730 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c40035d0 con 0x7fb8d40c2730 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314398967 0 0) 0x7fb8d406c220 con 0x7fb8d4165f00 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d406bf40 con 0x7fb8d4165f00 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2966910654 0 0) 0x7fb8c40035d0 con 0x7fb8d40c2730 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3740074240 >> v1:172.21.15.119:6789/0 conn(0x7fb8d4165f00 legacy=0x7fb8d40c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3740074240 >> v1:172.21.15.100:6789/0 conn(0x7fb8d40c2730 legacy=0x7fb8d40abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.895+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3740074240 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d406c7e0 con 0x7fb8d40adab0 2023-11-17T06:33:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8d8f9a700 1 --2- 172.21.15.100:0/3740074240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d40adab0 0x7fb8d40ae530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009850 tx=0x7fb8c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1413972dd43db60 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0019f0 con 0x7fb8d40adab0 2023-11-17T06:33:02.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8004030 con 0x7fb8d40adab0 2023-11-17T06:33:02.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8d37fe700 1 -- 172.21.15.100:0/3740074240 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80043c0 con 0x7fb8d40adab0 2023-11-17T06:33:02.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3740074240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d40adab0 msgr2=0x7fb8d40ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3740074240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d40adab0 0x7fb8d40ae530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009850 tx=0x7fb8c8009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3740074240 shutdown_connections 2023-11-17T06:33:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3740074240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d40adab0 0x7fb8d40ae530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3740074240 >> 172.21.15.100:0/3740074240 conn(0x7fb8d40cf050 msgr2=0x7fb8d40cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3740074240 shutdown_connections 2023-11-17T06:33:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.899+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3740074240 wait complete. 2023-11-17T06:33:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 Processor -- start 2023-11-17T06:33:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 -- start start 2023-11-17T06:33:02.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8d40c2730 0x7fb8d409c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d4165f00 0x7fb8d40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d4164da0 con 0x7fb8d40adab0 2023-11-17T06:33:02.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d409a400 con 0x7fb8d4165f00 2023-11-17T06:33:02.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8db1fe700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d409c8d0 con 0x7fb8d40c2730 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35222/0 (socket says 172.21.15.100:35222) 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3944681544 learned_addr learned my addr 172.21.15.100:0/3944681544 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d3fff700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8d40c2730 0x7fb8d409c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d979b700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d4165f00 0x7fb8d40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8d40c2730 msgr2=0x7fb8d409c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8d40c2730 0x7fb8d409c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d4165f00 msgr2=0x7fb8d40b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d4165f00 0x7fb8d40b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 -- 172.21.15.100:0/3944681544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80094b0 con 0x7fb8d40adab0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.903+0000 7fb8d8f9a700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009eb0 tx=0x7fb8c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8011830 con 0x7fb8d40adab0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c801f070 con 0x7fb8d40adab0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8011bd0 con 0x7fb8d40adab0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d409c680 con 0x7fb8d40adab0 2023-11-17T06:33:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d409a600 con 0x7fb8d40adab0 2023-11-17T06:33:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d404eea0 con 0x7fb8d40adab0 2023-11-17T06:33:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.907+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8c8011d30 con 0x7fb8d40adab0 2023-11-17T06:33:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.911+0000 7fb8d17fa700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 0x7fb8b80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.911+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb8c8021070 con 0x7fb8d40adab0 2023-11-17T06:33:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.911+0000 7fb8d3fff700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 0x7fb8b80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.911+0000 7fb8d3fff700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 0x7fb8b80689d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8d41fa3f0 tx=0x7fb8c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:02.915+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8c8052c60 con 0x7fb8d40adab0 2023-11-17T06:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8d40cfef0 con 0x7fb8d40adab0 2023-11-17T06:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8d17fa700 1 -- 172.21.15.100:0/3944681544 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8c802b0a0 con 0x7fb8d40adab0 2023-11-17T06:33:03.094 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 msgr2=0x7fb8b80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 0x7fb8b80689d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8d41fa3f0 tx=0x7fb8c0009040 comp rx=0 tx=0).stop 2023-11-17T06:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 msgr2=0x7fb8d4164860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.091+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009eb0 tx=0x7fb8c8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 shutdown_connections 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8d4165f00 0x7fb8d40b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8d40c2730 0x7fb8d409c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb8b8066510 0x7fb8b80689d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 --2- 172.21.15.100:0/3944681544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d40adab0 0x7fb8d4164860 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 >> 172.21.15.100:0/3944681544 conn(0x7fb8d40cf050 msgr2=0x7fb8d40c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 shutdown_connections 2023-11-17T06:33:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.095+0000 7fb8db1fe700 1 -- 172.21.15.100:0/3944681544 wait complete. 2023-11-17T06:33:03.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.287+0000 7f245533c700 1 Processor -- start 2023-11-17T06:33:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.287+0000 7f245533c700 1 -- start start 2023-11-17T06:33:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f245533c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f245006bc20 0x7f245006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f245533c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f245015ca60 0x7f245015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f245533c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500cb620 con 0x7f24500cb9e0 2023-11-17T06:33:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f245533c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450155e10 con 0x7f245015ca60 2023-11-17T06:33:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f245533c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245006c150 con 0x7f245006bc20 2023-11-17T06:33:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244f7fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f245015ca60 0x7f245015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f245006bc20 0x7f245006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f245006bc20 0x7f245006fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:40408/0 (socket says 172.21.15.100:40408) 2023-11-17T06:33:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 -- 172.21.15.100:0/1079428664 learned_addr learned my addr 172.21.15.100:0/1079428664 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244effd700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f24500cb9e0 0x7f24500cbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:42518/0 (socket says 172.21.15.100:42518) 2023-11-17T06:33:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 -- 172.21.15.100:0/1079428664 >> v2:172.21.15.100:3300/0 conn(0x7f245015ca60 msgr2=0x7f245015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 --2- 172.21.15.100:0/1079428664 >> v2:172.21.15.100:3300/0 conn(0x7f245015ca60 0x7f245015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 -- 172.21.15.100:0/1079428664 >> v1:172.21.15.119:6789/0 conn(0x7f24500cb9e0 legacy=0x7f24500cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 -- 172.21.15.100:0/1079428664 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245006c430 con 0x7f245006bc20 2023-11-17T06:33:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244e7fc700 1 --2- 172.21.15.100:0/1079428664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245006bc20 0x7f245006fc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24500cc5e0 tx=0x7f2444009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796455876ec6d46e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.291+0000 7f244dffb700 1 -- 172.21.15.100:0/1079428664 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011830 con 0x7f245006bc20 2023-11-17T06:33:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f244dffb700 1 -- 172.21.15.100:0/1079428664 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444011990 con 0x7f245006bc20 2023-11-17T06:33:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f244dffb700 1 -- 172.21.15.100:0/1079428664 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011d20 con 0x7f245006bc20 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- 172.21.15.100:0/1079428664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245006bc20 msgr2=0x7f245006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 --2- 172.21.15.100:0/1079428664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245006bc20 0x7f245006fc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24500cc5e0 tx=0x7f2444009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- 172.21.15.100:0/1079428664 shutdown_connections 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 --2- 172.21.15.100:0/1079428664 >> v2:172.21.15.100:3300/0 conn(0x7f245015ca60 0x7f245015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 --2- 172.21.15.100:0/1079428664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245006bc20 0x7f245006fc80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- 172.21.15.100:0/1079428664 >> 172.21.15.100:0/1079428664 conn(0x7f245006a480 msgr2=0x7f245006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- 172.21.15.100:0/1079428664 shutdown_connections 2023-11-17T06:33:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- 172.21.15.100:0/1079428664 wait complete. 2023-11-17T06:33:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 Processor -- start 2023-11-17T06:33:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.295+0000 7f245533c700 1 -- start start 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f245006bc20 0x7f245014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245015ca60 0x7f245006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500cc890 con 0x7f24500cb9e0 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500ccae0 con 0x7f245015ca60 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500ccdc0 con 0x7f245006bc20 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35234/0 (socket says 172.21.15.100:35234) 2023-11-17T06:33:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 -- 172.21.15.100:0/285442838 learned_addr learned my addr 172.21.15.100:0/285442838 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:03.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244f7fe700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245015ca60 0x7f245006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244effd700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f245006bc20 0x7f245014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 -- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f245006bc20 msgr2=0x7f245014a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f245006bc20 0x7f245014a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 -- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245015ca60 msgr2=0x7f245006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245015ca60 0x7f245006ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 -- 172.21.15.100:0/285442838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444009570 con 0x7f24500cb9e0 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f244e7fc700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f245006c290 tx=0x7f2444004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444004450 con 0x7f24500cb9e0 2023-11-17T06:33:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244401f070 con 0x7f24500cb9e0 2023-11-17T06:33:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500cd0a0 con 0x7f24500cb9e0 2023-11-17T06:33:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444003900 con 0x7f24500cb9e0 2023-11-17T06:33:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.299+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245014a5b0 con 0x7f24500cb9e0 2023-11-17T06:33:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.303+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2450067990 con 0x7f24500cb9e0 2023-11-17T06:33:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.303+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2444003a60 con 0x7f24500cb9e0 2023-11-17T06:33:03.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.307+0000 7f24377fe700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 0x7f243c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.307+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2444021070 con 0x7f24500cb9e0 2023-11-17T06:33:03.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.307+0000 7f244effd700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 0x7f243c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.307+0000 7f244effd700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 0x7f243c0689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2440000f60 tx=0x7f2440007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.311+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24440526f0 con 0x7f24500cb9e0 2023-11-17T06:33:03.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.495+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24500c25d0 con 0x7f24500cb9e0 2023-11-17T06:33:03.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f24377fe700 1 -- 172.21.15.100:0/285442838 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+124 (secure 0 0 0) 0x7f24440045d0 con 0x7f24500cb9e0 2023-11-17T06:33:03.502 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6835/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:03.502 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6833/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 msgr2=0x7f243c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 0x7f243c0689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2440000f60 tx=0x7f2440007ef0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 msgr2=0x7f245006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f245006c290 tx=0x7f2444004770 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 shutdown_connections 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f245015ca60 0x7f245006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f243c066510 0x7f243c0689d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24500cb9e0 0x7f245006fa70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 --2- 172.21.15.100:0/285442838 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f245006bc20 0x7f245014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 >> 172.21.15.100:0/285442838 conn(0x7f245006a480 msgr2=0x7f245015bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 shutdown_connections 2023-11-17T06:33:03.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:03.499+0000 7f245533c700 1 -- 172.21.15.100:0/285442838 wait complete. 2023-11-17T06:33:03.507 INFO:teuthology.orchestra.run.smithi100.stderr:listed 2 entries 2023-11-17T06:33:03.523 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-11-17T06:33:03.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:03.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:03.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[47618]: fuse finished with error 0 and tester_r 0 2023-11-17T06:33:03.560 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:33:09.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:33:09.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:09.661 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:33:09.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:33:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.891+0000 7f8d1d797700 1 Processor -- start 2023-11-17T06:33:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.891+0000 7f8d1d797700 1 -- start start 2023-11-17T06:33:09.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d1d797700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d18160b60 0x7f8d180d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d1d797700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180b04d0 con 0x7f8d18160f40 2023-11-17T06:33:09.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d1d797700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180d0710 con 0x7f8d180d17e0 2023-11-17T06:33:09.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d1d797700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d180d09f0 con 0x7f8d18160b60 2023-11-17T06:33:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d167fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8d18160f40 0x7f8d180d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45514/0 (socket says 172.21.15.100:45514) 2023-11-17T06:33:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d167fc700 1 -- 172.21.15.100:0/2679386005 learned_addr learned my addr 172.21.15.100:0/2679386005 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/2679386005 >> v2:172.21.15.100:3300/0 conn(0x7f8d18160b60 0x7f8d180d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231169078 0 0) 0x7f8d180b04d0 con 0x7f8d18160f40 2023-11-17T06:33:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d000035d0 con 0x7f8d18160f40 2023-11-17T06:33:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642263343 0 0) 0x7f8d180d0710 con 0x7f8d180d17e0 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d180b04d0 con 0x7f8d180d17e0 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227530810 0 0) 0x7f8d000035d0 con 0x7f8d18160f40 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 >> v2:172.21.15.100:3300/0 conn(0x7f8d18160b60 msgr2=0x7f8d180d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 --2- 172.21.15.100:0/2679386005 >> v2:172.21.15.100:3300/0 conn(0x7f8d18160b60 0x7f8d180d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 >> v1:172.21.15.119:6789/0 conn(0x7f8d180d17e0 legacy=0x7f8d180b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180afe80 con 0x7f8d18160f40 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f8d0c001670 con 0x7f8d18160f40 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 >> v1:172.21.15.100:6789/0 conn(0x7f8d18160f40 legacy=0x7f8d180d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 0x7f8d00004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.895+0000 7f8d15ffb700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00004870 0x7f8d00004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d00005230 0x7f8d0000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180d09f0 con 0x7f8d00003c70 2023-11-17T06:33:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0000c1d0 con 0x7f8d00004870 2023-11-17T06:33:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0000c390 con 0x7f8d00005230 2023-11-17T06:33:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 0x7f8d00004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d167fc700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00004870 0x7f8d00004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 -- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d00005230 msgr2=0x7f8d0000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:09.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d00005230 0x7f8d0000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 -- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00004870 msgr2=0x7f8d00004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00004870 0x7f8d00004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d177fe700 1 -- 172.21.15.100:0/2679386005 reap_dead start 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 -- 172.21.15.100:0/2679386005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000035d0 con 0x7f8d00003c70 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d167fc700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00004870 0x7f8d00004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 0x7f8d00004070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009b70 tx=0x7f8d000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875af166a9d39183 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800e6c0 con 0x7f8d00003c70 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800e820 con 0x7f8d00003c70 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d15ffb700 1 -- 172.21.15.100:0/2679386005 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800ebb0 con 0x7f8d00003c70 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 -- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 msgr2=0x7f8d00004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 0x7f8d00004070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009b70 tx=0x7f8d000058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 -- 172.21.15.100:0/2679386005 shutdown_connections 2023-11-17T06:33:09.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 --2- 172.21.15.100:0/2679386005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d00003c70 0x7f8d00004070 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 -- 172.21.15.100:0/2679386005 >> 172.21.15.100:0/2679386005 conn(0x7f8d180d31d0 msgr2=0x7f8d180d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:09.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 -- 172.21.15.100:0/2679386005 shutdown_connections 2023-11-17T06:33:09.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.899+0000 7f8d1d797700 1 -- 172.21.15.100:0/2679386005 wait complete. 2023-11-17T06:33:09.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.903+0000 7f8d1d797700 1 Processor -- start 2023-11-17T06:33:09.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.903+0000 7f8d1d797700 1 -- start start 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00003c70 0x7f8d181f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d180b86e0 0x7f8d1815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180b82c0 con 0x7f8d180c9930 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180cc240 con 0x7f8d00003c70 2023-11-17T06:33:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180b7640 con 0x7f8d180b86e0 2023-11-17T06:33:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35252/0 (socket says 172.21.15.100:35252) 2023-11-17T06:33:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 -- 172.21.15.100:0/1772198095 learned_addr learned my addr 172.21.15.100:0/1772198095 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00003c70 0x7f8d181f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d177fe700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d180b86e0 0x7f8d1815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 -- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d180b86e0 msgr2=0x7f8d1815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d180b86e0 0x7f8d1815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 -- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00003c70 msgr2=0x7f8d181f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00003c70 0x7f8d181f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 -- 172.21.15.100:0/1772198095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180b7920 con 0x7f8d180c9930 2023-11-17T06:33:09.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d167fc700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00d780 tx=0x7f8d0c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004ca0 con 0x7f8d180c9930 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c004e00 con 0x7f8d180c9930 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007310 con 0x7f8d180c9930 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d180b7c00 con 0x7f8d180c9930 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.907+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d180b72f0 con 0x7f8d180c9930 2023-11-17T06:33:09.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.911+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d180b8400 con 0x7f8d180c9930 2023-11-17T06:33:09.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.911+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d0c007470 con 0x7f8d180c9930 2023-11-17T06:33:09.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.915+0000 7f8cff7fe700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 0x7f8d040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:09.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.915+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d0c083cd0 con 0x7f8d180c9930 2023-11-17T06:33:09.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.915+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 0x7f8d040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:09.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.915+0000 7f8d16ffd700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 0x7f8d040689d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8d080090b0 tx=0x7f8d0801e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:09.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:09.919+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d180b8400 con 0x7f8d180c9930 2023-11-17T06:33:10.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.139+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8d180b8400 con 0x7f8d180c9930 2023-11-17T06:33:10.144 INFO:tasks.ceph.mon.a.smithi100.stderr:2023-11-17T06:33:10.139+0000 7f0e7e1f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:33:10.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.143+0000 7f8cff7fe700 1 -- 172.21.15.100:0/1772198095 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8d180b8400 con 0x7f8d180c9930 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 msgr2=0x7f8d040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 0x7f8d040689d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8d080090b0 tx=0x7f8d0801e040 comp rx=0 tx=0).stop 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 msgr2=0x7f8d180cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00d780 tx=0x7f8d0c00da90 comp rx=0 tx=0).stop 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 shutdown_connections 2023-11-17T06:33:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d180b86e0 0x7f8d1815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f8d04066510 0x7f8d040689d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d180c9930 0x7f8d180cbd00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 --2- 172.21.15.100:0/1772198095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d00003c70 0x7f8d181f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 >> 172.21.15.100:0/1772198095 conn(0x7f8d180d31d0 msgr2=0x7f8d180cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 shutdown_connections 2023-11-17T06:33:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.151+0000 7f8d1d797700 1 -- 172.21.15.100:0/1772198095 wait complete. 2023-11-17T06:33:10.157 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:33:10.170 INFO:tasks.ceph.mds.a.smithi100.stderr: -5245> 2023-11-17T06:31:36.205+0000 7fbdfcd51700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:10.175 DEBUG:teuthology.orchestra.run.smithi100:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-11-17T06:33:10.232 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2023-11-17T06:33:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 -- start start 2023-11-17T06:33:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 Processor -- start 2023-11-17T06:33:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636eef43400 0x5636eefb6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636eef43000 0x5636eefb7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef79180 con 0x5636eef43800 2023-11-17T06:33:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef78140 con 0x5636eef43400 2023-11-17T06:33:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636eef78000 con 0x5636eef43000 2023-11-17T06:33:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35290/0 (socket says 172.21.15.100:35290) 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 -- 172.21.15.100:0/2805097670 learned_addr learned my addr 172.21.15.100:0/2805097670 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a18ee700 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636eef43000 0x5636eefb7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a08ec700 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636eef43400 0x5636eefb6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 -- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636eef43000 msgr2=0x5636eefb7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636eef43000 0x5636eefb7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 -- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636eef43400 msgr2=0x5636eefb6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636eef43400 0x5636eefb6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 -- 172.21.15.100:0/2805097670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636eef64b60 con 0x5636eef43800 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f49a10ed700 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5636ef02b410 tx=0x5636efcac120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5c65371a842b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.235+0000 7f499e8e8700 1 -- 172.21.15.100:0/2805097670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef77600 con 0x5636eef43800 2023-11-17T06:33:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f499e8e8700 1 -- 172.21.15.100:0/2805097670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636eef8e480 con 0x5636eef43800 2023-11-17T06:33:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636eef64340 con 0x5636eef43800 2023-11-17T06:33:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5636eef64000 con 0x5636eef43800 2023-11-17T06:33:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 4 waiting for MDS map... 2023-11-17T06:33:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f499e8e8700 1 -- 172.21.15.100:0/2805097670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef771e0 con 0x5636eef43800 2023-11-17T06:33:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f499e8e8700 1 -- 172.21.15.100:0/2805097670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x5636eef7cc40 con 0x5636eef43800 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f499e8e8700 1 -- 172.21.15.100:0/2805097670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) v1 ==== 2723+0+0 (secure 0 0 0) 0x5636efdba000 con 0x5636eef43800 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 4 Got MDS map 24 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 Processor -- start 2023-11-17T06:33:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- start start 2023-11-17T06:33:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228800 0x5636eefb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 0x5636eefb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef78a00 con 0x5636ef228c00 2023-11-17T06:33:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef9d180 con 0x5636ef228800 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636eef9cdc0 con 0x5636ef228400 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a18ee700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 0x5636eefb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a18ee700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:35526/0 (socket says 172.21.15.100:35526) 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a18ee700 1 -- 172.21.15.100:0/2995325578 learned_addr learned my addr 172.21.15.100:0/2995325578 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a10ed700 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228800 0x5636eefb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 -- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 msgr2=0x5636eefb7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 -- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228800 msgr2=0x5636eefb7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228800 0x5636eefb7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.239+0000 7f49a08ec700 1 -- 172.21.15.100:0/2995325578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636eef64ea0 con 0x5636ef228c00 2023-11-17T06:33:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a08ec700 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 0x5636eefb8100 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5636efd28840 tx=0x5636ef23ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c913e03bcb80a271 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f499c8e4700 1 -- 172.21.15.100:0/2995325578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef77600 con 0x5636ef228c00 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f499c8e4700 1 -- 172.21.15.100:0/2995325578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636eef8e900 con 0x5636ef228c00 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f499c8e4700 1 -- 172.21.15.100:0/2995325578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef771e0 con 0x5636ef228c00 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- 172.21.15.100:0/2995325578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 msgr2=0x5636eefb8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 0x5636eefb8100 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5636efd28840 tx=0x5636ef23ac00 comp rx=0 tx=0).stop 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- 172.21.15.100:0/2995325578 shutdown_connections 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228c00 0x5636eefb8100 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228800 0x5636eefb7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- 172.21.15.100:0/2995325578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- 172.21.15.100:0/2995325578 >> 172.21.15.100:0/2995325578 conn(0x5636eef42c00 msgr2=0x5636ef00d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- 172.21.15.100:0/2995325578 shutdown_connections 2023-11-17T06:33:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- 172.21.15.100:0/2995325578 wait complete. 2023-11-17T06:33:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 Processor -- start 2023-11-17T06:33:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- start start 2023-11-17T06:33:10.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 0x5636eefb8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228c00 0x5636eefb8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef9cc80 con 0x5636ef228800 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eef78140 con 0x5636ef228c00 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a2931840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636eef78b40 con 0x5636ef228400 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a10ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 0x5636eefb8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a10ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 0x5636eefb8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35318/0 (socket says 172.21.15.100:35318) 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.243+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 learned_addr learned my addr 172.21.15.100:0/235437869 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228c00 0x5636eefb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 msgr2=0x5636eefb9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636ef228400 0x5636eefb9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228c00 msgr2=0x5636eefb8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636ef228c00 0x5636eefb8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636eef64b60 con 0x5636ef228800 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 0x5636eefb8c00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5636ef02b800 tx=0x5636ef014060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f499b0e1700 1 -- 172.21.15.100:0/235437869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef76f20 con 0x5636ef228800 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f499b0e1700 1 -- 172.21.15.100:0/235437869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636efd32c00 con 0x5636ef228800 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f499b0e1700 1 -- 172.21.15.100:0/235437869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5636eef77600 con 0x5636ef228800 2023-11-17T06:33:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636eef64340 con 0x5636ef228800 2023-11-17T06:33:10.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636eef65520 con 0x5636ef228800 2023-11-17T06:33:10.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f49a2931840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:10.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.247+0000 7f499b0e1700 1 -- 172.21.15.100:0/235437869 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x5636eef90840 con 0x5636ef228800 2023-11-17T06:33:10.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f499b0e1700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x5636ef388000 0x5636eefb9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f499b0e1700 1 -- 172.21.15.100:0/235437869 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x5636eef7ca80 con 0x5636ef228800 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a2931840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a2931840 4 datascan.main: data pool 'cephfs_data' has ID 5 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a2931840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x5636ef229000 0x5636eefb8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:1 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229000 2023-11-17T06:33:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x5636ef388000 0x5636eefb9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x5636ef229000 0x5636eefb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x5636ef388000 0x5636eefb9700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5636ef02a990 tx=0x5636ef015740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.251+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x5636ef229000 0x5636eefb8100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.255+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 1 ==== osd_op_reply(1 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.255+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:2 5.0 5:0181e5f0:::10000000061.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229000 2023-11-17T06:33:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.255+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 2 ==== osd_op_reply(2 10000000061.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.255+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627873.0 2023-11-17T06:33:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.255+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:3 5.0 5:0181e5f0:::10000000061.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229000 2023-11-17T06:33:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 3 ==== osd_op_reply(3 10000000061.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:4 5.0 5:03de5254::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229000 2023-11-17T06:33:10.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 4 ==== osd_op_reply(4 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:5 5.0 5:03de5254:::10000000054.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229000 2023-11-17T06:33:10.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 5 ==== osd_op_reply(5 10000000054.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627860.0 2023-11-17T06:33:10.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.259+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:6 5.0 5:03de5254:::10000000054.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef229000 2023-11-17T06:33:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.263+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 6 ==== osd_op_reply(6 10000000054.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.263+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x5636ef229400 0x5636eefb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.263+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:7 5.20 5:04000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229400 2023-11-17T06:33:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.263+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x5636ef229400 0x5636eefb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.263+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x5636ef229400 0x5636eefb7b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.271+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.271+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:8 5.20 5:0699973a:::10000000064.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.271+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 2 ==== osd_op_reply(8 10000000064.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.271+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627876.0 2023-11-17T06:33:10.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.271+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:9 5.20 5:0699973a:::10000000064.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef229400 2023-11-17T06:33:10.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 3 ==== osd_op_reply(9 10000000064.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:10 5.20 5:072a8150::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229400 2023-11-17T06:33:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:11 5.20 5:072a8150:::1000000001a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 5 ==== osd_op_reply(11 1000000001a.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627802.0 2023-11-17T06:33:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.279+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:12 5.20 5:072a8150:::1000000001a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229400 2023-11-17T06:33:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 6 ==== osd_op_reply(12 1000000001a.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:13 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229400 2023-11-17T06:33:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 7 ==== osd_op_reply(13 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:14 5.10 5:0b7da9c3:::10000000014.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229400 2023-11-17T06:33:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 8 ==== osd_op_reply(14 10000000014.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627796.0 2023-11-17T06:33:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.283+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:15 5.10 5:0b7da9c3:::10000000014.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229400 2023-11-17T06:33:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 9 ==== osd_op_reply(15 10000000014.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:16 5.30 5:0c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229400 2023-11-17T06:33:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 10 ==== osd_op_reply(16 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:17 5.30 5:0cbf7f79:::1000000005c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229400 2023-11-17T06:33:10.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 11 ==== osd_op_reply(17 1000000005c.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627868.0 2023-11-17T06:33:10.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.287+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:18 5.30 5:0cbf7f79:::1000000005c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef229400 2023-11-17T06:33:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 12 ==== osd_op_reply(18 1000000005c.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:19 5.30 5:0d373645::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229400 2023-11-17T06:33:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 13 ==== osd_op_reply(19 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:20 5.30 5:0d373645:::10000000062.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 14 ==== osd_op_reply(20 10000000062.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627874.0 2023-11-17T06:33:10.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.295+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:21 5.30 5:0d373645:::10000000062.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229400 2023-11-17T06:33:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 15 ==== osd_op_reply(21 10000000062.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x5636ef229800 0x5636eefb7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:22 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229800 2023-11-17T06:33:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x5636ef229800 0x5636eefb7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x5636ef229800 0x5636eefb7600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 1 ==== osd_op_reply(22 [pgnls start_epoch 37 out=101b] v35'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:23 5.8 5:1044c7a4:::10000000047.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229800 2023-11-17T06:33:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 2 ==== osd_op_reply(23 10000000047.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627847.0 2023-11-17T06:33:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.299+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:24 5.8 5:1044c7a4:::10000000047.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229800 2023-11-17T06:33:10.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.303+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 3 ==== osd_op_reply(24 10000000047.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.303+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:25 5.8 5:12420646::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef229800 2023-11-17T06:33:10.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.303+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 4 ==== osd_op_reply(25 [pgnls start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.303+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:26 5.8 5:12420646:::1000000003c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229800 2023-11-17T06:33:10.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 5 ==== osd_op_reply(26 1000000003c.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627836.0 2023-11-17T06:33:10.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:27 5.8 5:12420646:::1000000003c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229800 2023-11-17T06:33:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 6 ==== osd_op_reply(27 1000000003c.00000000 [call] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:28 5.8 5:12420902::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229800 2023-11-17T06:33:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 7 ==== osd_op_reply(28 [pgnls start_epoch 37 out=81b] v37'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.307+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:29 5.8 5:12420902:::1000000001b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229800 2023-11-17T06:33:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 8 ==== osd_op_reply(29 1000000001b.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627803.0 2023-11-17T06:33:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:30 5.8 5:12420902:::1000000001b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229800 2023-11-17T06:33:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 9 ==== osd_op_reply(30 1000000001b.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x5636ef388400 0x5636ef3ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:31 5.28 5:14000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388400 2023-11-17T06:33:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.311+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x5636ef388400 0x5636ef3ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x5636ef388400 0x5636ef3ae000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 1 ==== osd_op_reply(31 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:32 5.28 5:166e0f51:::10000000056.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388400 2023-11-17T06:33:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 2 ==== osd_op_reply(32 10000000056.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627862.0 2023-11-17T06:33:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.315+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:33 5.28 5:166e0f51:::10000000056.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef388400 2023-11-17T06:33:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 3 ==== osd_op_reply(33 10000000056.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x5636ef388800 0x5636ef3ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:34 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef388800 2023-11-17T06:33:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x5636ef388800 0x5636ef3ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x5636ef388800 0x5636ef3ae580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 1 ==== osd_op_reply(34 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.319+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:35 5.18 5:19311010:::10000000029.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef388800 2023-11-17T06:33:10.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.323+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 2 ==== osd_op_reply(35 10000000029.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.323+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627817.0 2023-11-17T06:33:10.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.323+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:36 5.18 5:19311010:::10000000029.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef388800 2023-11-17T06:33:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 3 ==== osd_op_reply(36 10000000029.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:37 5.18 5:1ae6cdf3::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388800 2023-11-17T06:33:10.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 4 ==== osd_op_reply(37 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:38 5.18 5:1ae6cdf3:::1000000005a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388800 2023-11-17T06:33:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 5 ==== osd_op_reply(38 1000000005a.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627866.0 2023-11-17T06:33:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.327+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:39 5.18 5:1ae6cdf3:::1000000005a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388800 2023-11-17T06:33:10.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 6 ==== osd_op_reply(39 1000000005a.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:40 5.38 5:1c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229400 2023-11-17T06:33:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 16 ==== osd_op_reply(40 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:41 5.38 5:1e1620c8:::10000000035.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 17 ==== osd_op_reply(41 10000000035.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627829.0 2023-11-17T06:33:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.331+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:42 5.38 5:1e1620c8:::10000000035.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229400 2023-11-17T06:33:10.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 18 ==== osd_op_reply(42 10000000035.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:43 5.38 5:1e20cbdb::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229400 2023-11-17T06:33:10.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 19 ==== osd_op_reply(43 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:44 5.38 5:1e20cbdb:::10000000016.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229400 2023-11-17T06:33:10.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 20 ==== osd_op_reply(44 10000000016.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627798.0 2023-11-17T06:33:10.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.339+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:45 5.38 5:1e20cbdb:::10000000016.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef229400 2023-11-17T06:33:10.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.343+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 21 ==== osd_op_reply(45 10000000016.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.343+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:46 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229400 2023-11-17T06:33:10.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.343+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 22 ==== osd_op_reply(46 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.343+0000 7f499c8e4700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:47 5.24 5:24000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388400 2023-11-17T06:33:10.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 4 ==== osd_op_reply(47 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:48 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229000 2023-11-17T06:33:10.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 7 ==== osd_op_reply(48 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:49 5.14 5:2a40c2ef:::10000000025.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229000 2023-11-17T06:33:10.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 8 ==== osd_op_reply(49 10000000025.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627813.0 2023-11-17T06:33:10.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.347+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:50 5.14 5:2a40c2ef:::10000000025.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229000 2023-11-17T06:33:10.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 9 ==== osd_op_reply(50 10000000025.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:51 5.14 5:2b0a3bc5::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 10 ==== osd_op_reply(51 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:52 5.14 5:2b0a3bc5:::10000000058.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229000 2023-11-17T06:33:10.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 11 ==== osd_op_reply(52 10000000058.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627864.0 2023-11-17T06:33:10.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.351+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:53 5.14 5:2b0a3bc5:::10000000058.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229000 2023-11-17T06:33:10.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.355+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 12 ==== osd_op_reply(53 10000000058.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.355+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:54 5.34 5:2c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388400 2023-11-17T06:33:10.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.355+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 5 ==== osd_op_reply(54 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.355+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:55 5.34 5:2eb4da2b:::10000000009.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388400 2023-11-17T06:33:10.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 6 ==== osd_op_reply(55 10000000009.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627785.0 2023-11-17T06:33:10.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:56 5.34 5:2eb4da2b:::10000000009.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388400 2023-11-17T06:33:10.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 7 ==== osd_op_reply(56 10000000009.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x5636ef388c00 0x5636ef3aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:57 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef388c00 2023-11-17T06:33:10.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.359+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x5636ef388c00 0x5636ef3aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a10ed700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x5636ef388c00 0x5636ef3aeb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 1 ==== osd_op_reply(57 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:58 5.2c 5:34000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8000 con 0x5636ef229800 2023-11-17T06:33:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 10 ==== osd_op_reply(58 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:59 5.2c 5:34658595:::1000000005f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229800 2023-11-17T06:33:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 11 ==== osd_op_reply(59 1000000005f.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627871.0 2023-11-17T06:33:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.363+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:60 5.2c 5:34658595:::1000000005f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229800 2023-11-17T06:33:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 12 ==== osd_op_reply(60 1000000005f.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:61 5.2c 5:3665eb52::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8000 con 0x5636ef229800 2023-11-17T06:33:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 13 ==== osd_op_reply(61 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:62 5.2c 5:3665eb52:::1000000003e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8700 con 0x5636ef229800 2023-11-17T06:33:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 14 ==== osd_op_reply(62 1000000003e.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627838.0 2023-11-17T06:33:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.367+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:63 5.2c 5:3665eb52:::1000000003e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8a80 con 0x5636ef229800 2023-11-17T06:33:10.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.371+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 15 ==== osd_op_reply(63 1000000003e.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.371+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:64 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8e00 con 0x5636ef388800 2023-11-17T06:33:10.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 7 ==== osd_op_reply(64 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f499c8e4700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:65 5.3c 5:3c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef388c00 2023-11-17T06:33:10.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 2 ==== osd_op_reply(65 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:66 5.3c 5:3c3d7520:::1000000003b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c9180 con 0x5636ef388c00 2023-11-17T06:33:10.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 3 ==== osd_op_reply(66 1000000003b.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627835.0 2023-11-17T06:33:10.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.375+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:67 5.3c 5:3c3d7520:::1000000003b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c9500 con 0x5636ef388c00 2023-11-17T06:33:10.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 4 ==== osd_op_reply(67 1000000003b.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:68 5.3c 5:3d4c06c4::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c9880 con 0x5636ef388c00 2023-11-17T06:33:10.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 5 ==== osd_op_reply(68 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:69 5.3c 5:3d4c06c4:::1000000002a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c9c00 con 0x5636ef388c00 2023-11-17T06:33:10.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 6 ==== osd_op_reply(69 1000000002a.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627818.0 2023-11-17T06:33:10.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.379+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:70 5.3c 5:3d4c06c4:::1000000002a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef388c00 2023-11-17T06:33:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.383+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 7 ==== osd_op_reply(70 1000000002a.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.383+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x5636ef389000 0x5636ef3af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.383+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:71 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef389000 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.383+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x5636ef389000 0x5636ef3af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.383+0000 7f49a08ec700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x5636ef389000 0x5636ef3af080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(71 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:72 5.22 5:44000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8380 con 0x5636ef229400 2023-11-17T06:33:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 23 ==== osd_op_reply(72 [pgnls start_epoch 37 out=101b] v35'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:73 5.22 5:44135715:::10000000039.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 24 ==== osd_op_reply(73 10000000039.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627833.0 2023-11-17T06:33:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.387+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:74 5.22 5:44135715:::10000000039.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229400 2023-11-17T06:33:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.391+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 25 ==== osd_op_reply(74 10000000039.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.391+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:75 5.22 5:44834937::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef229400 2023-11-17T06:33:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.391+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 26 ==== osd_op_reply(75 [pgnls start_epoch 37 out=101b] v37'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.391+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:76 5.22 5:44834937:::10000000013.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef229400 2023-11-17T06:33:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 27 ==== osd_op_reply(76 10000000013.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627795.0 2023-11-17T06:33:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:77 5.22 5:44834937:::10000000013.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229400 2023-11-17T06:33:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 28 ==== osd_op_reply(77 10000000013.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:78 5.22 5:4503a7ea::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229400 2023-11-17T06:33:10.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 29 ==== osd_op_reply(78 [pgnls start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.395+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:79 5.22 5:4503a7ea:::10000000020.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8000 con 0x5636ef229400 2023-11-17T06:33:10.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.399+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 30 ==== osd_op_reply(79 10000000020.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.399+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627808.0 2023-11-17T06:33:10.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.399+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:80 5.22 5:4503a7ea:::10000000020.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8700 con 0x5636ef229400 2023-11-17T06:33:10.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.399+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 31 ==== osd_op_reply(80 10000000020.00000000 [call] v37'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.399+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:81 5.22 5:45d72e17::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c8a80 con 0x5636ef229400 2023-11-17T06:33:10.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.403+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 32 ==== osd_op_reply(81 [pgnls start_epoch 37 out=101b] v37'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.403+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:82 5.22 5:45d72e17:::1000000000a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3c9180 con 0x5636ef229400 2023-11-17T06:33:10.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.403+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 33 ==== osd_op_reply(82 1000000000a.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.403+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627786.0 2023-11-17T06:33:10.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.403+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:83 5.22 5:45d72e17:::1000000000a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229400 2023-11-17T06:33:10.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 34 ==== osd_op_reply(83 1000000000a.00000000 [call] v37'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:84 5.22 5:46cca9ab::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229400 2023-11-17T06:33:10.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 35 ==== osd_op_reply(84 [pgnls start_epoch 37 out=81b] v37'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:85 5.22 5:46cca9ab:::1000000000c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229400 2023-11-17T06:33:10.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 36 ==== osd_op_reply(85 1000000000c.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627788.0 2023-11-17T06:33:10.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.407+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:86 5.22 5:46cca9ab:::1000000000c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef229400 2023-11-17T06:33:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 37 ==== osd_op_reply(86 1000000000c.00000000 [call] v37'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:87 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388c00 2023-11-17T06:33:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 8 ==== osd_op_reply(87 [pgnls start_epoch 37 out=101b] v35'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:88 5.12 5:4899516f:::10000000048.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388c00 2023-11-17T06:33:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 9 ==== osd_op_reply(88 10000000048.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627848.0 2023-11-17T06:33:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.411+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:89 5.12 5:4899516f:::10000000048.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388c00 2023-11-17T06:33:10.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.415+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 10 ==== osd_op_reply(89 10000000048.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.415+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:90 5.12 5:49e35fbc::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388c00 2023-11-17T06:33:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.415+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 11 ==== osd_op_reply(90 [pgnls start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.415+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:91 5.12 5:49e35fbc:::1000000000f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef388c00 2023-11-17T06:33:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.419+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 12 ==== osd_op_reply(91 1000000000f.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.419+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627791.0 2023-11-17T06:33:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.419+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:92 5.12 5:49e35fbc:::1000000000f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef388c00 2023-11-17T06:33:10.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.419+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 13 ==== osd_op_reply(92 1000000000f.00000000 [call] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.419+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:93 5.12 5:49ffa098::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef388c00 2023-11-17T06:33:10.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 14 ==== osd_op_reply(93 [pgnls start_epoch 37 out=101b] v37'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:94 5.12 5:49ffa098:::1000000002e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef388c00 2023-11-17T06:33:10.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 15 ==== osd_op_reply(94 1000000002e.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627822.0 2023-11-17T06:33:10.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:95 5.12 5:49ffa098:::1000000002e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef388c00 2023-11-17T06:33:10.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.423+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 16 ==== osd_op_reply(95 1000000002e.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:96 5.12 5:4bec3886::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef388c00 2023-11-17T06:33:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 17 ==== osd_op_reply(96 [pgnls start_epoch 37 out=81b] v37'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:97 5.12 5:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef388c00 2023-11-17T06:33:10.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 18 ==== osd_op_reply(97 10000000002.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627778.0 2023-11-17T06:33:10.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.427+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:98 5.12 5:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388c00 2023-11-17T06:33:10.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 19 ==== osd_op_reply(98 10000000002.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:99 5.32 5:4c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229000 2023-11-17T06:33:10.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 13 ==== osd_op_reply(99 [pgnls start_epoch 37 out=101b] v35'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:100 5.32 5:4d757255:::10000000055.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229000 2023-11-17T06:33:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 14 ==== osd_op_reply(100 10000000055.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627861.0 2023-11-17T06:33:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.431+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:101 5.32 5:4d757255:::10000000055.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef229000 2023-11-17T06:33:10.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 15 ==== osd_op_reply(101 10000000055.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:102 5.32 5:4def72d4::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef229000 2023-11-17T06:33:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 16 ==== osd_op_reply(102 [pgnls start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:103 5.32 5:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229000 2023-11-17T06:33:10.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 17 ==== osd_op_reply(103 10000000003.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627779.0 2023-11-17T06:33:10.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.435+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:104 5.32 5:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef229000 2023-11-17T06:33:10.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 18 ==== osd_op_reply(104 10000000003.00000000 [call] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:105 5.32 5:4ecb6bb7::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef229000 2023-11-17T06:33:10.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 19 ==== osd_op_reply(105 [pgnls start_epoch 37 out=101b] v37'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:106 5.32 5:4ecb6bb7:::1000000003f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef229000 2023-11-17T06:33:10.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 20 ==== osd_op_reply(106 1000000003f.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627839.0 2023-11-17T06:33:10.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:107 5.32 5:4ecb6bb7:::1000000003f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 21 ==== osd_op_reply(107 1000000003f.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:108 5.32 5:4f7da3cc::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 22 ==== osd_op_reply(108 [pgnls start_epoch 37 out=81b] v37'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.439+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:109 5.32 5:4f7da3cc:::1000000001e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 23 ==== osd_op_reply(109 1000000001e.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627806.0 2023-11-17T06:33:10.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:110 5.32 5:4f7da3cc:::1000000001e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef229000 2023-11-17T06:33:10.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 24 ==== osd_op_reply(110 1000000001e.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:111 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229800 2023-11-17T06:33:10.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 16 ==== osd_op_reply(111 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.443+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:112 5.2a 5:54000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef388800 2023-11-17T06:33:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 8 ==== osd_op_reply(112 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f499c8e4700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:113 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce380 con 0x5636ef229400 2023-11-17T06:33:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 38 ==== osd_op_reply(113 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:114 5.1a 5:5b3b19a5:::10000000018.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef229400 2023-11-17T06:33:10.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 39 ==== osd_op_reply(114 10000000018.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627800.0 2023-11-17T06:33:10.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.447+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:115 5.1a 5:5b3b19a5:::10000000018.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef229400 2023-11-17T06:33:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.451+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 40 ==== osd_op_reply(115 10000000018.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.451+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:116 5.1a 5:5bd35317::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229400 2023-11-17T06:33:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.451+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 41 ==== osd_op_reply(116 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.451+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:117 5.1a 5:5bd35317:::10000000044.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.455+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 42 ==== osd_op_reply(117 10000000044.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.455+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627844.0 2023-11-17T06:33:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.455+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:118 5.1a 5:5bd35317:::10000000044.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef229400 2023-11-17T06:33:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.455+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 43 ==== osd_op_reply(118 10000000044.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.455+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:119 5.3a 5:5c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229000 2023-11-17T06:33:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.459+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 25 ==== osd_op_reply(119 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.459+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:120 5.3a 5:5f13809d:::1000000001f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.459+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 26 ==== osd_op_reply(120 1000000001f.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.459+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627807.0 2023-11-17T06:33:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.459+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:121 5.3a 5:5f13809d:::1000000001f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229000 2023-11-17T06:33:10.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 27 ==== osd_op_reply(121 1000000001f.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:122 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229800 2023-11-17T06:33:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 17 ==== osd_op_reply(122 [pgnls start_epoch 37 out=101b] v35'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:123 5.6 5:60a13eb4:::10000000037.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229800 2023-11-17T06:33:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 18 ==== osd_op_reply(123 10000000037.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627831.0 2023-11-17T06:33:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.463+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:124 5.6 5:60a13eb4:::10000000037.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229800 2023-11-17T06:33:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 19 ==== osd_op_reply(124 10000000037.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:125 5.6 5:61404748::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229800 2023-11-17T06:33:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 20 ==== osd_op_reply(125 [pgnls start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:126 5.6 5:61404748:::10000000042.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef229800 2023-11-17T06:33:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 21 ==== osd_op_reply(126 10000000042.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627842.0 2023-11-17T06:33:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.467+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:127 5.6 5:61404748:::10000000042.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef229800 2023-11-17T06:33:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 22 ==== osd_op_reply(127 10000000042.00000000 [call] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:128 5.6 5:614fee2a::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229800 2023-11-17T06:33:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 23 ==== osd_op_reply(128 [pgnls start_epoch 37 out=81b] v37'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:129 5.6 5:614fee2a:::1000000003d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef229800 2023-11-17T06:33:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 24 ==== osd_op_reply(129 1000000003d.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627837.0 2023-11-17T06:33:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.471+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:130 5.6 5:614fee2a:::1000000003d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef229800 2023-11-17T06:33:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 25 ==== osd_op_reply(130 1000000003d.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:131 5.26 5:64000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229000 2023-11-17T06:33:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 28 ==== osd_op_reply(131 [pgnls start_epoch 37 out=101b] v35'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:132 5.26 5:645408ac:::1000000002b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef229000 2023-11-17T06:33:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 29 ==== osd_op_reply(132 1000000002b.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627819.0 2023-11-17T06:33:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.475+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:133 5.26 5:645408ac:::1000000002b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef229000 2023-11-17T06:33:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 30 ==== osd_op_reply(133 1000000002b.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:134 5.26 5:65f9ba37::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229000 2023-11-17T06:33:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 31 ==== osd_op_reply(134 [pgnls start_epoch 37 out=101b] v37'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:135 5.26 5:65f9ba37:::10000000038.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229000 2023-11-17T06:33:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 32 ==== osd_op_reply(135 10000000038.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627832.0 2023-11-17T06:33:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.479+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:136 5.26 5:65f9ba37:::10000000038.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229000 2023-11-17T06:33:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.483+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 33 ==== osd_op_reply(136 10000000038.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.483+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:137 5.26 5:660982fc::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.483+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 34 ==== osd_op_reply(137 [pgnls start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.483+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:138 5.26 5:660982fc:::1000000002d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229000 2023-11-17T06:33:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 35 ==== osd_op_reply(138 1000000002d.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627821.0 2023-11-17T06:33:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:139 5.26 5:660982fc:::1000000002d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229000 2023-11-17T06:33:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 36 ==== osd_op_reply(139 1000000002d.00000000 [call] v37'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:140 5.26 5:66f1e28f::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229000 2023-11-17T06:33:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 37 ==== osd_op_reply(140 [pgnls start_epoch 37 out=101b] v37'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.487+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:141 5.26 5:66f1e28f:::10000000063.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229000 2023-11-17T06:33:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 38 ==== osd_op_reply(141 10000000063.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627875.0 2023-11-17T06:33:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:142 5.26 5:66f1e28f:::10000000063.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229000 2023-11-17T06:33:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 39 ==== osd_op_reply(142 10000000063.00000000 [call] v37'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:143 5.26 5:678705fb::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.491+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 40 ==== osd_op_reply(143 [pgnls start_epoch 37 out=81b] v37'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.495+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:144 5.26 5:678705fb:::10000000046.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229000 2023-11-17T06:33:10.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.495+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 41 ==== osd_op_reply(144 10000000046.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.495+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627846.0 2023-11-17T06:33:10.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.495+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:145 5.26 5:678705fb:::10000000046.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229000 2023-11-17T06:33:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.495+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 42 ==== osd_op_reply(145 10000000046.00000000 [call] v37'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:146 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef388400 2023-11-17T06:33:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 8 ==== osd_op_reply(146 [pgnls start_epoch 37 out=101b] v35'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:147 5.16 5:69de5632:::10000000050.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef388400 2023-11-17T06:33:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 9 ==== osd_op_reply(147 10000000050.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627856.0 2023-11-17T06:33:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.499+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:148 5.16 5:69de5632:::10000000050.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388400 2023-11-17T06:33:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 10 ==== osd_op_reply(148 10000000050.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:149 5.16 5:6a23747e::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef388400 2023-11-17T06:33:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 11 ==== osd_op_reply(149 [pgnls start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:150 5.16 5:6a23747e:::10000000053.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec380 con 0x5636ef388400 2023-11-17T06:33:10.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 12 ==== osd_op_reply(150 10000000053.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627859.0 2023-11-17T06:33:10.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.503+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:151 5.16 5:6a23747e:::10000000053.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec700 con 0x5636ef388400 2023-11-17T06:33:10.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 13 ==== osd_op_reply(151 10000000053.00000000 [call] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:152 5.16 5:6a415a36::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3eca80 con 0x5636ef388400 2023-11-17T06:33:10.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 14 ==== osd_op_reply(152 [pgnls start_epoch 37 out=101b] v37'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:153 5.16 5:6a415a36:::10000000043.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ece00 con 0x5636ef388400 2023-11-17T06:33:10.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 15 ==== osd_op_reply(153 10000000043.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627843.0 2023-11-17T06:33:10.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.507+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:154 5.16 5:6a415a36:::10000000043.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed180 con 0x5636ef388400 2023-11-17T06:33:10.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 16 ==== osd_op_reply(154 10000000043.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:155 5.16 5:6a54d456::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed500 con 0x5636ef388400 2023-11-17T06:33:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 17 ==== osd_op_reply(155 [pgnls start_epoch 37 out=81b] v37'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:156 5.16 5:6a54d456:::1000000001c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed880 con 0x5636ef388400 2023-11-17T06:33:10.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 18 ==== osd_op_reply(156 1000000001c.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627804.0 2023-11-17T06:33:10.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.511+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:157 5.16 5:6a54d456:::1000000001c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3edc00 con 0x5636ef388400 2023-11-17T06:33:10.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.515+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 19 ==== osd_op_reply(157 1000000001c.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.515+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:158 5.36 5:6c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef388c00 2023-11-17T06:33:10.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.515+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 20 ==== osd_op_reply(158 [pgnls start_epoch 37 out=101b] v35'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:159 5.36 5:6c82bb73:::1000000004d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef388c00 2023-11-17T06:33:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 21 ==== osd_op_reply(159 1000000004d.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627853.0 2023-11-17T06:33:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:160 5.36 5:6c82bb73:::1000000004d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef388c00 2023-11-17T06:33:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 22 ==== osd_op_reply(160 1000000004d.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.519+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:161 5.36 5:6dc1a442::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef388c00 2023-11-17T06:33:10.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 23 ==== osd_op_reply(161 [pgnls start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:162 5.36 5:6dc1a442:::10000000015.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388c00 2023-11-17T06:33:10.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 24 ==== osd_op_reply(162 10000000015.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627797.0 2023-11-17T06:33:10.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:163 5.36 5:6dc1a442:::10000000015.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388c00 2023-11-17T06:33:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 25 ==== osd_op_reply(163 10000000015.00000000 [call] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.523+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:164 5.36 5:6f6f8b6e::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef388c00 2023-11-17T06:33:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 26 ==== osd_op_reply(164 [pgnls start_epoch 37 out=81b] v37'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:165 5.36 5:6f6f8b6e:::10000000045.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef388c00 2023-11-17T06:33:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 27 ==== osd_op_reply(165 10000000045.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627845.0 2023-11-17T06:33:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:166 5.36 5:6f6f8b6e:::10000000045.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef388c00 2023-11-17T06:33:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 28 ==== osd_op_reply(166 10000000045.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.527+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:167 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388800 2023-11-17T06:33:10.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 9 ==== osd_op_reply(167 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:168 5.2e 5:74000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef229000 2023-11-17T06:33:10.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 43 ==== osd_op_reply(168 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:169 5.2e 5:74dc0bdf:::10000000057.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229000 2023-11-17T06:33:10.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 44 ==== osd_op_reply(169 10000000057.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627863.0 2023-11-17T06:33:10.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.531+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:170 5.2e 5:74dc0bdf:::10000000057.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef229000 2023-11-17T06:33:10.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 45 ==== osd_op_reply(170 10000000057.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x5636ef389400 0x5636ef3af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:171 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef389400 2023-11-17T06:33:10.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x5636ef389400 0x5636ef3af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a18ee700 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x5636ef389400 0x5636ef3af600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 1 ==== osd_op_reply(171 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.535+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:172 5.1e 5:78cea7f0:::10000000017.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef389400 2023-11-17T06:33:10.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.539+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 2 ==== osd_op_reply(172 10000000017.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.539+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627799.0 2023-11-17T06:33:10.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.539+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:173 5.1e 5:78cea7f0:::10000000017.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef389400 2023-11-17T06:33:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.539+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 3 ==== osd_op_reply(173 10000000017.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.539+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:174 5.3e 5:7c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229000 2023-11-17T06:33:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 46 ==== osd_op_reply(174 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:175 5.3e 5:7e2d0da6:::10000000033.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef229000 2023-11-17T06:33:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 47 ==== osd_op_reply(175 10000000033.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627827.0 2023-11-17T06:33:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:176 5.3e 5:7e2d0da6:::10000000033.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cfc00 con 0x5636ef229000 2023-11-17T06:33:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 48 ==== osd_op_reply(176 10000000033.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.543+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:177 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388800 2023-11-17T06:33:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.547+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 10 ==== osd_op_reply(177 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.547+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:178 5.1 5:81df0dbf:::10000000034.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef388800 2023-11-17T06:33:10.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.547+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 11 ==== osd_op_reply(178 10000000034.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.547+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627828.0 2023-11-17T06:33:10.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.547+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:179 5.1 5:81df0dbf:::10000000034.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef388800 2023-11-17T06:33:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.551+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 12 ==== osd_op_reply(179 10000000034.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.551+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:180 5.21 5:84000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef389000 2023-11-17T06:33:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.551+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 2 ==== osd_op_reply(180 [pgnls start_epoch 37 out=101b] v35'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.551+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:181 5.21 5:844eae9e:::1000000004c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef389000 2023-11-17T06:33:10.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.555+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 3 ==== osd_op_reply(181 1000000004c.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.555+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627852.0 2023-11-17T06:33:10.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.555+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:182 5.21 5:844eae9e:::1000000004c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef389000 2023-11-17T06:33:10.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 4 ==== osd_op_reply(182 1000000004c.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:183 5.21 5:8660ae9f::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef389000 2023-11-17T06:33:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 5 ==== osd_op_reply(183 [pgnls start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:184 5.21 5:8660ae9f:::1000000004f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef389000 2023-11-17T06:33:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 6 ==== osd_op_reply(184 1000000004f.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627855.0 2023-11-17T06:33:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.559+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:185 5.21 5:8660ae9f:::1000000004f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef389000 2023-11-17T06:33:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 7 ==== osd_op_reply(185 1000000004f.00000000 [call] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:186 5.21 5:86d8200e::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec380 con 0x5636ef389000 2023-11-17T06:33:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 8 ==== osd_op_reply(186 [pgnls start_epoch 37 out=101b] v37'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:187 5.21 5:86d8200e:::10000000019.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec700 con 0x5636ef389000 2023-11-17T06:33:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 9 ==== osd_op_reply(187 10000000019.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627801.0 2023-11-17T06:33:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.563+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:188 5.21 5:86d8200e:::10000000019.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3eca80 con 0x5636ef389000 2023-11-17T06:33:10.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 10 ==== osd_op_reply(188 10000000019.00000000 [call] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:189 5.21 5:870ac4b3::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ece00 con 0x5636ef389000 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 11 ==== osd_op_reply(189 [pgnls start_epoch 37 out=81b] v37'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:190 5.21 5:870ac4b3:::1000000005e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed180 con 0x5636ef389000 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 12 ==== osd_op_reply(190 1000000005e.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627870.0 2023-11-17T06:33:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.567+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:191 5.21 5:870ac4b3:::1000000005e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed500 con 0x5636ef389000 2023-11-17T06:33:10.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.571+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 13 ==== osd_op_reply(191 1000000005e.00000000 [call] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.571+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:192 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed880 con 0x5636ef389000 2023-11-17T06:33:10.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.571+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 14 ==== osd_op_reply(192 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.571+0000 7f499c8e4700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:193 5.31 5:8c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef388400 2023-11-17T06:33:10.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.575+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 20 ==== osd_op_reply(193 [pgnls start_epoch 37 out=101b] v35'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.575+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:194 5.31 5:8e5cc622:::1000000004b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3edc00 con 0x5636ef388400 2023-11-17T06:33:10.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.575+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 21 ==== osd_op_reply(194 1000000004b.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.575+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627851.0 2023-11-17T06:33:10.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.575+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:195 5.31 5:8e5cc622:::1000000004b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce380 con 0x5636ef388400 2023-11-17T06:33:10.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 22 ==== osd_op_reply(195 1000000004b.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:196 5.31 5:8ea80fc8::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef388400 2023-11-17T06:33:10.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 23 ==== osd_op_reply(196 [pgnls start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:197 5.31 5:8ea80fc8:::10000000032.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef388400 2023-11-17T06:33:10.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 24 ==== osd_op_reply(197 10000000032.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627826.0 2023-11-17T06:33:10.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.579+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:198 5.31 5:8ea80fc8:::10000000032.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef388400 2023-11-17T06:33:10.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.583+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 25 ==== osd_op_reply(198 10000000032.00000000 [call] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.583+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:199 5.31 5:8ff022d2::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef388400 2023-11-17T06:33:10.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.583+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 26 ==== osd_op_reply(199 [pgnls start_epoch 37 out=81b] v37'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.583+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:200 5.31 5:8ff022d2:::10000000059.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388400 2023-11-17T06:33:10.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.587+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 27 ==== osd_op_reply(200 10000000059.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.587+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627865.0 2023-11-17T06:33:10.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.587+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:201 5.31 5:8ff022d2:::10000000059.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec380 con 0x5636ef388400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.587+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 28 ==== osd_op_reply(201 10000000059.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.587+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:202 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec700 con 0x5636ef229400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.591+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 44 ==== osd_op_reply(202 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.591+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:203 5.9 5:9258b67d:::10000000005.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3eca80 con 0x5636ef229400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.591+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 45 ==== osd_op_reply(203 10000000005.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.591+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627781.0 2023-11-17T06:33:10.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.591+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:204 5.9 5:9258b67d:::10000000005.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229400 2023-11-17T06:33:10.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 46 ==== osd_op_reply(204 10000000005.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:205 5.29 5:94000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef389400 2023-11-17T06:33:10.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 4 ==== osd_op_reply(205 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:206 5.29 5:954bc910:::1000000004e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef389400 2023-11-17T06:33:10.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 5 ==== osd_op_reply(206 1000000004e.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627854.0 2023-11-17T06:33:10.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.595+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:207 5.29 5:954bc910:::1000000004e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef389400 2023-11-17T06:33:10.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 6 ==== osd_op_reply(207 1000000004e.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:208 5.29 5:9752f43f::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef389400 2023-11-17T06:33:10.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 7 ==== osd_op_reply(208 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:209 5.29 5:9752f43f:::1000000000b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef389400 2023-11-17T06:33:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 8 ==== osd_op_reply(209 1000000000b.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627787.0 2023-11-17T06:33:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.599+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:210 5.29 5:9752f43f:::1000000000b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef389400 2023-11-17T06:33:10.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 9 ==== osd_op_reply(210 1000000000b.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:211 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388c00 2023-11-17T06:33:10.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 29 ==== osd_op_reply(211 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:212 5.19 5:9ae7aaf4:::10000000051.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef388c00 2023-11-17T06:33:10.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 30 ==== osd_op_reply(212 10000000051.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627857.0 2023-11-17T06:33:10.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.603+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:213 5.19 5:9ae7aaf4:::10000000051.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388c00 2023-11-17T06:33:10.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.607+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 31 ==== osd_op_reply(213 10000000051.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.607+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:214 5.39 5:9c000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229400 2023-11-17T06:33:10.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.607+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 47 ==== osd_op_reply(214 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.607+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:215 5.39 5:9fc48627:::1000000005b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce380 con 0x5636ef229400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.611+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 48 ==== osd_op_reply(215 1000000005b.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.611+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627867.0 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.611+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:216 5.39 5:9fc48627:::1000000005b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef229400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.611+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 49 ==== osd_op_reply(216 1000000005b.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.611+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:217 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef389400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.615+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 10 ==== osd_op_reply(217 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.615+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:218 5.5 5:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef389400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.615+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 11 ==== osd_op_reply(218 10000000004.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.615+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627780.0 2023-11-17T06:33:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.615+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:219 5.5 5:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef389400 2023-11-17T06:33:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 12 ==== osd_op_reply(219 10000000004.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:220 5.25 5:a4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef388c00 2023-11-17T06:33:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 32 ==== osd_op_reply(220 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:221 5.25 5:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388c00 2023-11-17T06:33:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 33 ==== osd_op_reply(221 10000000006.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627782.0 2023-11-17T06:33:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.619+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:222 5.25 5:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef388c00 2023-11-17T06:33:10.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.623+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 34 ==== osd_op_reply(222 10000000006.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.623+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:223 5.25 5:a622384a::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388c00 2023-11-17T06:33:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.623+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 35 ==== osd_op_reply(223 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.623+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:224 5.25 5:a622384a:::1000000002c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388c00 2023-11-17T06:33:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.623+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 36 ==== osd_op_reply(224 1000000002c.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.627+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627820.0 2023-11-17T06:33:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.627+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:225 5.25 5:a622384a:::1000000002c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef388c00 2023-11-17T06:33:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.627+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 37 ==== osd_op_reply(225 1000000002c.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.627+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:226 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec380 con 0x5636ef388400 2023-11-17T06:33:10.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.631+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 29 ==== osd_op_reply(226 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.631+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:227 5.15 5:ab5910e2:::10000000011.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec700 con 0x5636ef388400 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.631+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 30 ==== osd_op_reply(227 10000000011.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.631+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627793.0 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.631+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:228 5.15 5:ab5910e2:::10000000011.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3eca80 con 0x5636ef388400 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 31 ==== osd_op_reply(228 10000000011.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:229 5.35 5:ac000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ece00 con 0x5636ef229400 2023-11-17T06:33:10.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 50 ==== osd_op_reply(229 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:230 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef229800 2023-11-17T06:33:10.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 26 ==== osd_op_reply(230 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:231 5.d 5:b0d15537:::10000000027.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed180 con 0x5636ef229800 2023-11-17T06:33:10.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 27 ==== osd_op_reply(231 10000000027.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627815.0 2023-11-17T06:33:10.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.635+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:232 5.d 5:b0d15537:::10000000027.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed500 con 0x5636ef229800 2023-11-17T06:33:10.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 28 ==== osd_op_reply(232 10000000027.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:233 5.d 5:b185e6e8::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed880 con 0x5636ef229800 2023-11-17T06:33:10.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 29 ==== osd_op_reply(233 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:234 5.d 5:b185e6e8:::10000000012.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3edc00 con 0x5636ef229800 2023-11-17T06:33:10.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 30 ==== osd_op_reply(234 10000000012.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627794.0 2023-11-17T06:33:10.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.639+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:235 5.d 5:b185e6e8:::10000000012.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef229800 2023-11-17T06:33:10.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.643+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 31 ==== osd_op_reply(235 10000000012.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.643+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:236 5.2d 5:b4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef229000 2023-11-17T06:33:10.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.643+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 49 ==== osd_op_reply(236 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.643+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:237 5.2d 5:b5236558:::1000000005d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef229000 2023-11-17T06:33:10.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 50 ==== osd_op_reply(237 1000000005d.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627869.0 2023-11-17T06:33:10.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:238 5.2d 5:b5236558:::1000000005d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 51 ==== osd_op_reply(238 1000000005d.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:239 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388c00 2023-11-17T06:33:10.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 38 ==== osd_op_reply(239 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.647+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:240 5.1d 5:ba3960b0:::10000000028.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388c00 2023-11-17T06:33:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.651+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 39 ==== osd_op_reply(240 10000000028.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.651+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627816.0 2023-11-17T06:33:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.651+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:241 5.1d 5:ba3960b0:::10000000028.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388c00 2023-11-17T06:33:10.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.651+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 40 ==== osd_op_reply(241 10000000028.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.651+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:242 5.1d 5:bbf5850a::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef388c00 2023-11-17T06:33:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 41 ==== osd_op_reply(242 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:243 5.1d 5:bbf5850a:::10000000007.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef388c00 2023-11-17T06:33:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 42 ==== osd_op_reply(243 10000000007.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627783.0 2023-11-17T06:33:10.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:244 5.1d 5:bbf5850a:::10000000007.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388c00 2023-11-17T06:33:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 43 ==== osd_op_reply(244 10000000007.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.655+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:245 5.3d 5:bc000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef388400 2023-11-17T06:33:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.659+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 32 ==== osd_op_reply(245 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.659+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:246 5.3d 5:be1922a8:::10000000026.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410000 con 0x5636ef388400 2023-11-17T06:33:10.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.659+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 33 ==== osd_op_reply(246 10000000026.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.659+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627814.0 2023-11-17T06:33:10.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.659+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:247 5.3d 5:be1922a8:::10000000026.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410380 con 0x5636ef388400 2023-11-17T06:33:10.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 34 ==== osd_op_reply(247 10000000026.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:248 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410700 con 0x5636ef389400 2023-11-17T06:33:10.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 13 ==== osd_op_reply(248 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:249 5.3 5:c001b242:::10000000060.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410a80 con 0x5636ef389400 2023-11-17T06:33:10.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 14 ==== osd_op_reply(249 10000000060.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627872.0 2023-11-17T06:33:10.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.663+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:250 5.3 5:c001b242:::10000000060.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410e00 con 0x5636ef389400 2023-11-17T06:33:10.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 15 ==== osd_op_reply(250 10000000060.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:251 5.3 5:c1adcc3d::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411180 con 0x5636ef389400 2023-11-17T06:33:10.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 16 ==== osd_op_reply(251 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:252 5.3 5:c1adcc3d:::10000000030.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411500 con 0x5636ef389400 2023-11-17T06:33:10.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 17 ==== osd_op_reply(252 10000000030.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627824.0 2023-11-17T06:33:10.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.667+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:253 5.3 5:c1adcc3d:::10000000030.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411880 con 0x5636ef389400 2023-11-17T06:33:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.671+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.0 v2:172.21.15.100:6801/1609678627 18 ==== osd_op_reply(253 10000000030.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef389400 2023-11-17T06:33:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.671+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:254 5.23 5:c4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411c00 con 0x5636ef388800 2023-11-17T06:33:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.671+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 13 ==== osd_op_reply(254 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.671+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:255 5.23 5:c550f404:::1000000002f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410700 con 0x5636ef388800 2023-11-17T06:33:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.675+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 14 ==== osd_op_reply(255 1000000002f.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.675+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627823.0 2023-11-17T06:33:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.675+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:256 5.23 5:c550f404:::1000000002f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410a80 con 0x5636ef388800 2023-11-17T06:33:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.675+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 15 ==== osd_op_reply(256 1000000002f.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.675+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:257 5.23 5:c6a0a389::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410e00 con 0x5636ef388800 2023-11-17T06:33:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.679+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 16 ==== osd_op_reply(257 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.679+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:258 5.23 5:c6a0a389:::10000000040.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ece00 con 0x5636ef388800 2023-11-17T06:33:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.679+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 17 ==== osd_op_reply(258 10000000040.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.679+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627840.0 2023-11-17T06:33:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.679+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:259 5.23 5:c6a0a389:::10000000040.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef388800 2023-11-17T06:33:10.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 18 ==== osd_op_reply(259 10000000040.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:260 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229000 2023-11-17T06:33:10.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 52 ==== osd_op_reply(260 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:261 5.13 5:cabe77c1:::10000000008.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef229000 2023-11-17T06:33:10.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 53 ==== osd_op_reply(261 10000000008.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627784.0 2023-11-17T06:33:10.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.683+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:262 5.13 5:cabe77c1:::10000000008.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce380 con 0x5636ef229000 2023-11-17T06:33:10.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.687+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 54 ==== osd_op_reply(262 10000000008.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.687+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:263 5.33 5:cc000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef229800 2023-11-17T06:33:10.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.687+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 32 ==== osd_op_reply(263 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.687+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:264 5.33 5:cf746ac5:::1000000001d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef229800 2023-11-17T06:33:10.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 33 ==== osd_op_reply(264 1000000001d.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627805.0 2023-11-17T06:33:10.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:265 5.33 5:cf746ac5:::1000000001d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 34 ==== osd_op_reply(265 1000000001d.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:266 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 35 ==== osd_op_reply(266 [pgnls start_epoch 37 out=101b] v35'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.691+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:267 5.b 5:d2626379:::10000000022.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 36 ==== osd_op_reply(267 10000000022.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627810.0 2023-11-17T06:33:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:268 5.b 5:d2626379:::10000000022.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef229800 2023-11-17T06:33:10.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 37 ==== osd_op_reply(268 10000000022.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:269 5.b 5:d30f9a54::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef229800 2023-11-17T06:33:10.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 38 ==== osd_op_reply(269 [pgnls start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:270 5.b 5:d30f9a54:::10000000052.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed180 con 0x5636ef229800 2023-11-17T06:33:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 39 ==== osd_op_reply(270 10000000052.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627858.0 2023-11-17T06:33:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.695+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:271 5.b 5:d30f9a54:::10000000052.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed500 con 0x5636ef229800 2023-11-17T06:33:10.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 40 ==== osd_op_reply(271 10000000052.00000000 [call] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:272 5.b 5:d3d0d483::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ed880 con 0x5636ef229800 2023-11-17T06:33:10.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 41 ==== osd_op_reply(272 [pgnls start_epoch 37 out=81b] v37'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:273 5.b 5:d3d0d483:::10000000021.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3edc00 con 0x5636ef229800 2023-11-17T06:33:10.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 42 ==== osd_op_reply(273 10000000021.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627809.0 2023-11-17T06:33:10.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.699+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:274 5.b 5:d3d0d483:::10000000021.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ec000 con 0x5636ef229800 2023-11-17T06:33:10.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 43 ==== osd_op_reply(274 10000000021.00000000 [call] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:275 5.2b 5:d4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef388800 2023-11-17T06:33:10.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 19 ==== osd_op_reply(275 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:276 5.2b 5:d4b9b687:::10000000041.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388800 2023-11-17T06:33:10.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 20 ==== osd_op_reply(276 10000000041.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627841.0 2023-11-17T06:33:10.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.703+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:277 5.2b 5:d4b9b687:::10000000041.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388800 2023-11-17T06:33:10.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.707+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 21 ==== osd_op_reply(277 10000000041.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.707+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:278 5.2b 5:d747f723::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388800 2023-11-17T06:33:10.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.707+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 22 ==== osd_op_reply(278 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.707+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:279 5.2b 5:d747f723:::10000000036.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397180 con 0x5636ef388800 2023-11-17T06:33:10.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.711+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 23 ==== osd_op_reply(279 10000000036.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.711+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627830.0 2023-11-17T06:33:10.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.711+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:280 5.2b 5:d747f723:::10000000036.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397880 con 0x5636ef388800 2023-11-17T06:33:10.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.711+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 24 ==== osd_op_reply(280 10000000036.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.711+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:281 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef388400 2023-11-17T06:33:10.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.715+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 35 ==== osd_op_reply(281 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.715+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:282 5.1b 5:d88bb762:::10000000031.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef388400 2023-11-17T06:33:10.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.715+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 36 ==== osd_op_reply(282 10000000031.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.715+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627825.0 2023-11-17T06:33:10.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.715+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:283 5.1b 5:d88bb762:::10000000031.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396700 con 0x5636ef388400 2023-11-17T06:33:10.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 37 ==== osd_op_reply(283 10000000031.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:284 5.3b 5:dc000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ece00 con 0x5636ef229800 2023-11-17T06:33:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 44 ==== osd_op_reply(284 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:285 5.3b 5:dde6a3df:::10000000010.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411180 con 0x5636ef229800 2023-11-17T06:33:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 45 ==== osd_op_reply(285 10000000010.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627792.0 2023-11-17T06:33:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.719+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:286 5.3b 5:dde6a3df:::10000000010.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411500 con 0x5636ef229800 2023-11-17T06:33:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.723+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.2 v2:172.21.15.100:6824/177771602 46 ==== osd_op_reply(286 10000000010.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef229800 2023-11-17T06:33:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.723+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:287 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411880 con 0x5636ef388400 2023-11-17T06:33:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.723+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 38 ==== osd_op_reply(287 [pgnls start_epoch 37 out=101b] v35'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.723+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:288 5.7 5:e2d50132:::10000000049.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411c00 con 0x5636ef388400 2023-11-17T06:33:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.727+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 39 ==== osd_op_reply(288 10000000049.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.727+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627849.0 2023-11-17T06:33:10.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.727+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:289 5.7 5:e2d50132:::10000000049.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410700 con 0x5636ef388400 2023-11-17T06:33:10.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.727+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 40 ==== osd_op_reply(289 10000000049.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.727+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:290 5.7 5:e2e07930::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410a80 con 0x5636ef388400 2023-11-17T06:33:10.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.731+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 41 ==== osd_op_reply(290 [pgnls start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.731+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:291 5.7 5:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410e00 con 0x5636ef388400 2023-11-17T06:33:10.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.731+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 42 ==== osd_op_reply(291 10000000001.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.731+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627777.0 2023-11-17T06:33:10.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.731+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:292 5.7 5:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396a80 con 0x5636ef388400 2023-11-17T06:33:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 43 ==== osd_op_reply(292 10000000001.00000000 [call] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:293 5.27 5:e4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396e00 con 0x5636ef388c00 2023-11-17T06:33:10.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a10ed700 1 -- 172.21.15.100:0/235437869 <== osd.1 v2:172.21.15.100:6804/897523512 44 ==== osd_op_reply(293 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30fc0 con 0x5636ef388c00 2023-11-17T06:33:10.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f499c0e3700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:294 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef40a000 con 0x5636ef229000 2023-11-17T06:33:10.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 55 ==== osd_op_reply(294 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:295 5.17 5:e9ecae36:::1000000000d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397500 con 0x5636ef229000 2023-11-17T06:33:10.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 56 ==== osd_op_reply(295 1000000000d.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627789.0 2023-11-17T06:33:10.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.735+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:296 5.17 5:e9ecae36:::1000000000d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396000 con 0x5636ef229000 2023-11-17T06:33:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 57 ==== osd_op_reply(296 1000000000d.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:297 5.17 5:eb6757d1::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef396380 con 0x5636ef229000 2023-11-17T06:33:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 58 ==== osd_op_reply(297 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:298 5.17 5:eb6757d1:::10000000023.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef397c00 con 0x5636ef229000 2023-11-17T06:33:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 59 ==== osd_op_reply(298 10000000023.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627811.0 2023-11-17T06:33:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.739+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:299 5.17 5:eb6757d1:::10000000023.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf500 con 0x5636ef229000 2023-11-17T06:33:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.3 v2:172.21.15.100:6800/2990712957 60 ==== osd_op_reply(299 10000000023.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef229000 2023-11-17T06:33:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:300 5.37 5:ec000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce000 con 0x5636ef388800 2023-11-17T06:33:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 25 ==== osd_op_reply(300 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:301 5.37 5:eefe613f:::1000000000e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce700 con 0x5636ef388800 2023-11-17T06:33:10.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 26 ==== osd_op_reply(301 1000000000e.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627790.0 2023-11-17T06:33:10.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.743+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:302 5.37 5:eefe613f:::1000000000e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cee00 con 0x5636ef388800 2023-11-17T06:33:10.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.4 v2:172.21.15.119:6824/3894860840 27 ==== osd_op_reply(302 1000000000e.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef388800 2023-11-17T06:33:10.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:303 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf180 con 0x5636ef388400 2023-11-17T06:33:10.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 44 ==== osd_op_reply(303 [pgnls start_epoch 37 out=81b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:304 5.f 5:f1a9c549:::1000000003a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cea80 con 0x5636ef388400 2023-11-17T06:33:10.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 45 ==== osd_op_reply(304 1000000003a.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.747+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627834.0 2023-11-17T06:33:10.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.751+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:305 5.f 5:f1a9c549:::1000000003a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3ce380 con 0x5636ef388400 2023-11-17T06:33:10.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.751+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.5 v2:172.21.15.119:6810/2475678651 46 ==== osd_op_reply(305 1000000003a.00000000 [call] v37'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef388400 2023-11-17T06:33:10.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.751+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:306 5.2f 5:f4000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef411180 con 0x5636ef229400 2023-11-17T06:33:10.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 51 ==== osd_op_reply(306 [pgnls start_epoch 37 out=101b] v35'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:307 5.2f 5:f6ddf183:::10000000024.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410000 con 0x5636ef229400 2023-11-17T06:33:10.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 52 ==== osd_op_reply(307 10000000024.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627812.0 2023-11-17T06:33:10.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:308 5.2f 5:f6ddf183:::10000000024.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef410380 con 0x5636ef229400 2023-11-17T06:33:10.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 53 ==== osd_op_reply(308 10000000024.00000000 [call] v37'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.755+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:309 5.2f 5:f7911ae7::::head [pgnls start_epoch 37 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89880 con 0x5636ef229400 2023-11-17T06:33:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 54 ==== osd_op_reply(309 [pgnls start_epoch 37 out=81b] v37'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:310 5.2f 5:f7911ae7:::1000000004a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636eef89c00 con 0x5636ef229400 2023-11-17T06:33:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 55 ==== osd_op_reply(310 1000000004a.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a2931840 10 datascan.operator(): handling object 1099511627850.0 2023-11-17T06:33:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:311 5.2f 5:f7911ae7:::1000000004a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef40a000 con 0x5636ef229400 2023-11-17T06:33:10.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a18ee700 1 -- 172.21.15.100:0/235437869 <== osd.7 v2:172.21.15.119:6808/609004044 56 ==== osd_op_reply(311 1000000004a.00000000 [call] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5636efd30d80 con 0x5636ef229400 2023-11-17T06:33:10.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.759+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:312 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef40ae00 con 0x5636ef389000 2023-11-17T06:33:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 15 ==== osd_op_reply(312 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f499c8e4700 1 -- 172.21.15.100:0/235437869 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:313 5.3f 5:fc000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5636ef3cf880 con 0x5636ef389000 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 <== osd.6 v2:172.21.15.119:6800/1264916422 16 ==== osd_op_reply(313 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5636efd30b40 con 0x5636ef389000 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x5636ef389400 msgr2=0x5636ef3af600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x5636ef389400 0x5636ef3af600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x5636ef388c00 msgr2=0x5636ef3aeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x5636ef388c00 0x5636ef3aeb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x5636ef229800 msgr2=0x5636eefb7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x5636ef229800 0x5636eefb7600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x5636ef229000 msgr2=0x5636eefb8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x5636ef229000 0x5636eefb8100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 reap_dead start 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x5636ef388800 msgr2=0x5636ef3ae580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x5636ef388800 0x5636ef3ae580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 reap_dead start 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x5636ef388400 msgr2=0x5636ef3ae000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x5636ef388400 0x5636ef3ae000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x5636ef389000 msgr2=0x5636ef3af080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x5636ef389000 0x5636ef3af080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x5636ef229400 msgr2=0x5636eefb7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x5636ef229400 0x5636eefb7b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x5636ef388000 msgr2=0x5636eefb9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x5636ef388000 0x5636eefb9700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5636ef02a990 tx=0x5636ef015740 comp rx=0 tx=0).stop 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 msgr2=0x5636eefb8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/235437869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636ef228800 0x5636eefb8c00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5636ef02b800 tx=0x5636ef014060 comp rx=0 tx=0).stop 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a08ec700 1 -- 172.21.15.100:0/235437869 reap_dead start 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 shutdown_connections 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 >> 172.21.15.100:0/235437869 conn(0x5636eef42c00 msgr2=0x5636ef00d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 shutdown_connections 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/235437869 wait complete. 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 msgr2=0x5636eefb6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5636ef02b410 tx=0x5636efcac120 comp rx=0 tx=0).stop 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 shutdown_connections 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5636eef43000 0x5636eefb7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5636eef43400 0x5636eefb6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 --2- 172.21.15.100:0/2805097670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636eef43800 0x5636eefb6580 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.763+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 >> 172.21.15.100:0/2805097670 conn(0x5636eef43c00 msgr2=0x5636ef00d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.767+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 shutdown_connections 2023-11-17T06:33:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.767+0000 7f49a2931840 1 -- 172.21.15.100:0/2805097670 wait complete. 2023-11-17T06:33:10.778 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.603045, result: 2023-11-17T06:33:10.779 DEBUG:teuthology.orchestra.run.smithi100:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-11-17T06:33:10.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 -- start start 2023-11-17T06:33:10.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 Processor -- start 2023-11-17T06:33:10.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 0x55e5beeca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 0x55e5beecb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8d180 con 0x55e5bee57400 2023-11-17T06:33:10.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8c000 con 0x55e5bee57000 2023-11-17T06:33:10.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8c140 con 0x55e5bee57800 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35320/0 (socket says 172.21.15.100:35320) 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 -- 172.21.15.100:0/2046282489 learned_addr learned my addr 172.21.15.100:0/2046282489 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 0x55e5beeca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f864e700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 0x55e5beecb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 -- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 msgr2=0x55e5beeca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 0x55e5beeca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 -- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 msgr2=0x55e5beecb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 0x55e5beecb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 -- 172.21.15.100:0/2046282489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5bee78b60 con 0x55e5bee57400 2023-11-17T06:33:10.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 0x55e5beeca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:10.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f864e700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 0x55e5beecb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.883+0000 7fe2f764c700 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55e5bfbc33b0 tx=0x55e5bf13e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8d0f7123af034e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f5648700 1 -- 172.21.15.100:0/2046282489 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8b600 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f5648700 1 -- 172.21.15.100:0/2046282489 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5beea2480 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f5648700 1 -- 172.21.15.100:0/2046282489 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8b1e0 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5bee78340 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e5bee78000 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 4 waiting for MDS map... 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f5648700 1 -- 172.21.15.100:0/2046282489 <== mon.0 v2:172.21.15.100:3300/0 4 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x55e5bee90c40 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f5648700 1 -- 172.21.15.100:0/2046282489 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) v1 ==== 2723+0+0 (secure 0 0 0) 0x55e5bfc38000 con 0x55e5bee57400 2023-11-17T06:33:10.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 4 Got MDS map 24 2023-11-17T06:33:10.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:10.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:10.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 Processor -- start 2023-11-17T06:33:10.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- start start 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148400 0x55e5beecb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148800 0x55e5beecbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8ca00 con 0x55e5bf148c00 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5beeb1180 con 0x55e5bf148400 2023-11-17T06:33:10.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.887+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5beeb0dc0 con 0x55e5bf148800 2023-11-17T06:33:10.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35328/0 (socket says 172.21.15.100:35328) 2023-11-17T06:33:10.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f7e4d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148800 0x55e5beecbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.897 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 -- 172.21.15.100:0/4014221615 learned_addr learned my addr 172.21.15.100:0/4014221615 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f864e700 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148400 0x55e5beecb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 -- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148800 msgr2=0x55e5beecbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148800 0x55e5beecbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 -- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148400 msgr2=0x55e5beecb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148400 0x55e5beecb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 -- 172.21.15.100:0/4014221615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5bee78ea0 con 0x55e5bf148c00 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f764c700 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55e5bfbc37a0 tx=0x55e5bef28120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fde7b776f7f2f91 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f3644700 1 -- 172.21.15.100:0/4014221615 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8af20 con 0x55e5bf148c00 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f3644700 1 -- 172.21.15.100:0/4014221615 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5bfc40900 con 0x55e5bf148c00 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f3644700 1 -- 172.21.15.100:0/4014221615 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8b600 con 0x55e5bf148c00 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- 172.21.15.100:0/4014221615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 msgr2=0x55e5beecc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55e5bfbc37a0 tx=0x55e5bef28120 comp rx=0 tx=0).stop 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- 172.21.15.100:0/4014221615 shutdown_connections 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148c00 0x55e5beecc100 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148800 0x55e5beecbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 --2- 172.21.15.100:0/4014221615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148400 0x55e5beecb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- 172.21.15.100:0/4014221615 >> 172.21.15.100:0/4014221615 conn(0x55e5bee56c00 msgr2=0x55e5bef21800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- 172.21.15.100:0/4014221615 shutdown_connections 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- 172.21.15.100:0/4014221615 wait complete. 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 Processor -- start 2023-11-17T06:33:10.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.891+0000 7fe2f9691840 1 -- start start 2023-11-17T06:33:10.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148400 0x55e5beecd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148c00 0x55e5beecc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.901 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5beeb0c80 con 0x55e5bf148800 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8c000 con 0x55e5bf148c00 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5bee8cb40 con 0x55e5bf148400 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35338/0 (socket says 172.21.15.100:35338) 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 learned_addr learned my addr 172.21.15.100:0/3123290970 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148c00 0x55e5beecc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148400 0x55e5beecd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148400 msgr2=0x55e5beecd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bf148400 0x55e5beecd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148c00 msgr2=0x55e5beecc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bf148c00 0x55e5beecc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:10.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5bee78b60 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55e5bf1574a0 tx=0x55e5bf162e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f1e41700 1 -- 172.21.15.100:0/3123290970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8af20 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f1e41700 1 -- 172.21.15.100:0/3123290970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5beea2180 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f1e41700 1 -- 172.21.15.100:0/3123290970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e5bee8b600 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e5bee78340 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5bee79520 con 0x55e5bf148800 2023-11-17T06:33:10.903 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.895+0000 7fe2f9691840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:10.904 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f1e41700 1 -- 172.21.15.100:0/3123290970 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x55e5beea4840 con 0x55e5bf148800 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f1e41700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x55e5bf2a0000 0x55e5beecd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f1e41700 1 -- 172.21.15.100:0/3123290970 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x55e5bee90a80 con 0x55e5bf148800 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 4 datascan.main: data pool 'cephfs_data' has ID 5 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x55e5bf149000 0x55e5beecc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:1 4.14 4:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x55e5bf2a0000 0x55e5beecd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x55e5bf149000 0x55e5beecc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x55e5bf2a0000 0x55e5beecd700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55e5bee6fe30 tx=0x55e5bef29740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x55e5bf149000 0x55e5beecc100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55e5bf149400 0x55e5beecbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.899+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:2 4.1f 4:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:10.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55e5bf149400 0x55e5beecbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55e5bf149400 0x55e5beecbb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls-filter start_epoch 37 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149000 2023-11-17T06:33:10.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 2 ==== osd_op_reply(3 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.903+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149000 2023-11-17T06:33:10.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 3 ==== osd_op_reply(4 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000061.00000000 2023-11-17T06:33:10.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000061.0 2023-11-17T06:33:10.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:5 5.0 5:0181e5f0:::10000000061.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149000 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 4 ==== osd_op_reply(5 10000000061.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000061 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/96 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=96 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:6 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149000 2023-11-17T06:33:10.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 5 ==== osd_op_reply(6 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:7 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 2 ==== osd_op_reply(7 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:8 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:10.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 3 ==== osd_op_reply(8 10000000000.01000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.907+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-11-17T06:33:10.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.911+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:9 4.5 4:a40620de:::10000000000.01000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:10.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 4 ==== osd_op_reply(9 10000000000.01000000 [create,omap-set-header] v37'5 uv5 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-11-17T06:33:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:10 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 5 ==== osd_op_reply(10 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-11-17T06:33:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 20 datascan.read_dentry: 96_head not found in result 2023-11-17T06:33:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000061 at 0x0x10000000000/96 with size=2 bytes 2023-11-17T06:33:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.915+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:11 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 6 ==== osd_op_reply(11 10000000000.01000000 [omap-set-vals] v37'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000061 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:12 4.1f 4:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 7 ==== osd_op_reply(12 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-11-17T06:33:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-11-17T06:33:10.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:13 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 8 ==== osd_op_reply(13 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:10.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-11-17T06:33:10.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:14 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:10.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 9 ==== osd_op_reply(14 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-11-17T06:33:10.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:15 5.0 5:03de5254::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 6 ==== osd_op_reply(15 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000054.00000000 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000054.0 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.919+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:16 5.0 5:03de5254:::10000000054.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149000 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 7 ==== osd_op_reply(16 10000000054.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000054 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/83 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=83 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:17 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149000 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 8 ==== osd_op_reply(17 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:18 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 10 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:19 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 11 ==== osd_op_reply(19 10000000000.01000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:20 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:10.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 12 ==== osd_op_reply(20 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-11-17T06:33:10.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 20 datascan.read_dentry: 83_head not found in result 2023-11-17T06:33:10.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000054 at 0x0x10000000000/83 with size=2 bytes 2023-11-17T06:33:10.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.923+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:21 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:10.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.927+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 13 ==== osd_op_reply(21 10000000000.01000000 [omap-set-vals] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.927+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000054 2023-11-17T06:33:10.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.927+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x55e5bf2a0800 0x55e5beecb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.927+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:22 5.20 5:04000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a0800 2023-11-17T06:33:10.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.927+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x55e5bf2a0800 0x55e5beecb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x55e5bf2a0800 0x55e5beecb600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 1 ==== osd_op_reply(22 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000064.00000000 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000064.0 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:23 5.20 5:0699973a:::10000000064.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a0800 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 2 ==== osd_op_reply(23 10000000064.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000064 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/99 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=99 2023-11-17T06:33:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:24 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149000 2023-11-17T06:33:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 9 ==== osd_op_reply(24 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.931+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:25 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 14 ==== osd_op_reply(25 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x55e5bf2a1000 0x55e5bf2c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:26 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x55e5bf2a1000 0x55e5bf2c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x55e5bf2a1000 0x55e5bf2c0000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 1 ==== osd_op_reply(26 10000000000.01800000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-11-17T06:33:10.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.935+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:27 4.1b 4:dcc776e0:::10000000000.01800000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:10.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 2 ==== osd_op_reply(27 10000000000.01800000 [create,omap-set-header] v37'6 uv6 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-11-17T06:33:10.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:28 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a1000 2023-11-17T06:33:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 3 ==== osd_op_reply(28 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-11-17T06:33:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 20 datascan.read_dentry: 99_head not found in result 2023-11-17T06:33:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000064 at 0x0x10000000000/99 with size=2 bytes 2023-11-17T06:33:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.939+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:29 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:10.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 4 ==== osd_op_reply(29 10000000000.01800000 [omap-set-vals] v37'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000064 2023-11-17T06:33:10.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-11-17T06:33:10.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-11-17T06:33:10.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:30 4.1f 4:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 15 ==== osd_op_reply(30 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:31 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 16 ==== osd_op_reply(31 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-11-17T06:33:10.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.943+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:32 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:10.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 17 ==== osd_op_reply(32 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-11-17T06:33:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:33 5.20 5:072a8150::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a0800 2023-11-17T06:33:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001a.00000000 2023-11-17T06:33:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001a.0 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:34 5.20 5:072a8150:::1000000001a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf2a0800 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 4 ==== osd_op_reply(34 1000000001a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001a 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/25 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=25 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:35 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149000 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 10 ==== osd_op_reply(35 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:36 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:10.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 18 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.947+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:37 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1000 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 5 ==== osd_op_reply(37 10000000000.01800000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:38 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a1000 2023-11-17T06:33:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 6 ==== osd_op_reply(38 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-11-17T06:33:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 20 datascan.read_dentry: 25_head not found in result 2023-11-17T06:33:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001a at 0x0x10000000000/25 with size=2 bytes 2023-11-17T06:33:10.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.951+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:39 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 7 ==== osd_op_reply(39 10000000000.01800000 [omap-set-vals] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000001a 2023-11-17T06:33:10.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:40 5.10 5:08000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a0800 2023-11-17T06:33:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 5 ==== osd_op_reply(40 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000014.00000000 2023-11-17T06:33:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000014.0 2023-11-17T06:33:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:41 5.10 5:0b7da9c3:::10000000014.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a0800 2023-11-17T06:33:10.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 6 ==== osd_op_reply(41 10000000014.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000014 2023-11-17T06:33:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/19 2023-11-17T06:33:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=19 2023-11-17T06:33:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.955+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:42 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149000 2023-11-17T06:33:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 11 ==== osd_op_reply(42 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:43 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 19 ==== osd_op_reply(43 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:44 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf149400 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 20 ==== osd_op_reply(44 10000000000.01000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:45 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149400 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 21 ==== osd_op_reply(45 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 20 datascan.read_dentry: 19_head not found in result 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000014 at 0x0x10000000000/19 with size=2 bytes 2023-11-17T06:33:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.959+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:46 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:10.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.963+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 22 ==== osd_op_reply(46 10000000000.01000000 [omap-set-vals] v37'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.963+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000014 2023-11-17T06:33:10.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.963+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:47 5.30 5:0c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a0800 2023-11-17T06:33:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005c.00000000 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005c.0 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:48 5.30 5:0cbf7f79:::1000000005c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a0800 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 8 ==== osd_op_reply(48 1000000005c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005c 2023-11-17T06:33:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/91 2023-11-17T06:33:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=91 2023-11-17T06:33:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:49 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149000 2023-11-17T06:33:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 12 ==== osd_op_reply(49 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:50 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 23 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:51 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a1000 2023-11-17T06:33:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 8 ==== osd_op_reply(51 10000000000.01800000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-11-17T06:33:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.967+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:52 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a1000 2023-11-17T06:33:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 9 ==== osd_op_reply(52 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-11-17T06:33:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 20 datascan.read_dentry: 91_head not found in result 2023-11-17T06:33:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005c at 0x0x10000000000/91 with size=2 bytes 2023-11-17T06:33:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:53 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:10.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 10 ==== osd_op_reply(53 10000000000.01800000 [omap-set-vals] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:10.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x1000000005c 2023-11-17T06:33:10.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.971+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:54 5.30 5:0d373645::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2a0800 2023-11-17T06:33:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 9 ==== osd_op_reply(54 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000062.00000000 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000062.0 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:55 5.30 5:0d373645:::10000000062.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2a0800 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 10 ==== osd_op_reply(55 10000000062.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000062 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/97 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=97 2023-11-17T06:33:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:56 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149000 2023-11-17T06:33:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 13 ==== osd_op_reply(56 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:57 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 24 ==== osd_op_reply(57 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:58 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.975+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 25 ==== osd_op_reply(58 10000000000.01000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:59 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 26 ==== osd_op_reply(59 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 20 datascan.read_dentry: 97_head not found in result 2023-11-17T06:33:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000062 at 0x0x10000000000/97 with size=2 bytes 2023-11-17T06:33:10.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:60 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 27 ==== osd_op_reply(60 10000000000.01000000 [omap-set-vals] v37'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000062 2023-11-17T06:33:10.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x55e5bf2a1400 0x55e5bf2c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:10.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.979+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:61 5.8 5:10000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a1400 2023-11-17T06:33:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x55e5bf2a1400 0x55e5bf2c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x55e5bf2a1400 0x55e5bf2c0580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:10.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 1 ==== osd_op_reply(61 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:10.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000047.00000000 2023-11-17T06:33:10.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000047.0 2023-11-17T06:33:10.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:62 5.8 5:1044c7a4:::10000000047.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a1400 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 2 ==== osd_op_reply(62 10000000047.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000047 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/70 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=70 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:63 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149000 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 14 ==== osd_op_reply(63 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.983+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:64 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 28 ==== osd_op_reply(64 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:65 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:10.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 29 ==== osd_op_reply(65 10000000000.01000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:66 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 30 ==== osd_op_reply(66 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 20 datascan.read_dentry: 70_head not found in result 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000047 at 0x0x10000000000/70 with size=2 bytes 2023-11-17T06:33:10.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.987+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:67 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 31 ==== osd_op_reply(67 10000000000.01000000 [omap-set-vals] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x10000000047 2023-11-17T06:33:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:68 5.8 5:12420646::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1400 2023-11-17T06:33:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003c.00000000 2023-11-17T06:33:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003c.0 2023-11-17T06:33:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:69 5.8 5:12420646:::1000000003c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1400 2023-11-17T06:33:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 4 ==== osd_op_reply(69 1000000003c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003c 2023-11-17T06:33:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/59 2023-11-17T06:33:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=59 2023-11-17T06:33:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:70 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149000 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 15 ==== osd_op_reply(70 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:71 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 32 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.991+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:72 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:10.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 33 ==== osd_op_reply(72 10000000000.01000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-11-17T06:33:10.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:10.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:73 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:10.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 34 ==== osd_op_reply(73 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:10.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-11-17T06:33:10.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 20 datascan.read_dentry: 59_head not found in result 2023-11-17T06:33:10.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003c at 0x0x10000000000/59 with size=2 bytes 2023-11-17T06:33:10.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:74 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 35 ==== osd_op_reply(74 10000000000.01000000 [omap-set-vals] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x1000000003c 2023-11-17T06:33:11.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.995+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:75 5.8 5:12420902::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a1400 2023-11-17T06:33:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 5 ==== osd_op_reply(75 [pgnls-filter start_epoch 37 out=81b] v37'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001b.00000000 2023-11-17T06:33:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001b.0 2023-11-17T06:33:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:76 5.8 5:12420902:::1000000001b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1400 2023-11-17T06:33:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 6 ==== osd_op_reply(76 1000000001b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001b 2023-11-17T06:33:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/26 2023-11-17T06:33:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=26 2023-11-17T06:33:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:77 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149000 2023-11-17T06:33:11.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 16 ==== osd_op_reply(77 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:78 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:11.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 36 ==== osd_op_reply(78 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:79 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 11 ==== osd_op_reply(79 10000000000.01800000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-11-17T06:33:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:10.999+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:80 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.003+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 12 ==== osd_op_reply(80 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.003+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-11-17T06:33:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.003+0000 7fe2f9691840 20 datascan.read_dentry: 26_head not found in result 2023-11-17T06:33:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.003+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001b at 0x0x10000000000/26 with size=2 bytes 2023-11-17T06:33:11.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.003+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:81 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 13 ==== osd_op_reply(81 10000000000.01800000 [omap-set-vals] v37'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000001b 2023-11-17T06:33:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x55e5bf2da800 0x55e5bf2c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:82 5.28 5:14000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf2da800 2023-11-17T06:33:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x55e5bf2da800 0x55e5bf2c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f7e4d700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x55e5bf2da800 0x55e5bf2c0b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 1 ==== osd_op_reply(82 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000056.00000000 2023-11-17T06:33:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000056.0 2023-11-17T06:33:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:83 5.28 5:166e0f51:::10000000056.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2da800 2023-11-17T06:33:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.007+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 2 ==== osd_op_reply(83 10000000056.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000056 2023-11-17T06:33:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/85 2023-11-17T06:33:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=85 2023-11-17T06:33:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:84 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf149000 2023-11-17T06:33:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 17 ==== osd_op_reply(84 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:85 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149400 2023-11-17T06:33:11.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 37 ==== osd_op_reply(85 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:86 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf149400 2023-11-17T06:33:11.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 38 ==== osd_op_reply(86 10000000000.01000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-11-17T06:33:11.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:87 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149400 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 39 ==== osd_op_reply(87 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 20 datascan.read_dentry: 85_head not found in result 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000056 at 0x0x10000000000/85 with size=2 bytes 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.011+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:88 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149400 2023-11-17T06:33:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.015+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 40 ==== osd_op_reply(88 10000000000.01000000 [omap-set-vals] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.015+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x10000000056 2023-11-17T06:33:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.015+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:89 5.18 5:18000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 14 ==== osd_op_reply(89 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000029.00000000 2023-11-17T06:33:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000029.0 2023-11-17T06:33:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:90 5.18 5:19311010:::10000000029.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 15 ==== osd_op_reply(90 10000000029.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000029 2023-11-17T06:33:11.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/40 2023-11-17T06:33:11.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=40 2023-11-17T06:33:11.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:91 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149000 2023-11-17T06:33:11.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 18 ==== osd_op_reply(91 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:92 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 41 ==== osd_op_reply(92 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.019+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:93 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 16 ==== osd_op_reply(93 10000000000.01800000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-11-17T06:33:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:94 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a1000 2023-11-17T06:33:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 17 ==== osd_op_reply(94 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-11-17T06:33:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 20 datascan.read_dentry: 40_head not found in result 2023-11-17T06:33:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000029 at 0x0x10000000000/40 with size=2 bytes 2023-11-17T06:33:11.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.023+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:95 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 18 ==== osd_op_reply(95 10000000000.01800000 [omap-set-vals] v37'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x10000000029 2023-11-17T06:33:11.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:96 5.18 5:1ae6cdf3::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a1000 2023-11-17T06:33:11.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 19 ==== osd_op_reply(96 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005a.00000000 2023-11-17T06:33:11.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005a.0 2023-11-17T06:33:11.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:97 5.18 5:1ae6cdf3:::1000000005a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1000 2023-11-17T06:33:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 20 ==== osd_op_reply(97 1000000005a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005a 2023-11-17T06:33:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/89 2023-11-17T06:33:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=89 2023-11-17T06:33:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:98 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149000 2023-11-17T06:33:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 19 ==== osd_op_reply(98 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.027+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:99 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 42 ==== osd_op_reply(99 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:100 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a1000 2023-11-17T06:33:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 21 ==== osd_op_reply(100 10000000000.01800000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-11-17T06:33:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:101 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 22 ==== osd_op_reply(101 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-11-17T06:33:11.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 20 datascan.read_dentry: 89_head not found in result 2023-11-17T06:33:11.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005a at 0x0x10000000000/89 with size=2 bytes 2023-11-17T06:33:11.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.031+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:102 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 23 ==== osd_op_reply(102 10000000000.01800000 [omap-set-vals] v37'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000005a 2023-11-17T06:33:11.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:103 5.38 5:1c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a0800 2023-11-17T06:33:11.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 11 ==== osd_op_reply(103 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000035.00000000 2023-11-17T06:33:11.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000035.0 2023-11-17T06:33:11.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:104 5.38 5:1e1620c8:::10000000035.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a0800 2023-11-17T06:33:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 12 ==== osd_op_reply(104 10000000035.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000035 2023-11-17T06:33:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/52 2023-11-17T06:33:11.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=52 2023-11-17T06:33:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.035+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:105 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149000 2023-11-17T06:33:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 20 ==== osd_op_reply(105 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:106 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 43 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:107 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 44 ==== osd_op_reply(107 10000000000.01000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-11-17T06:33:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:108 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 45 ==== osd_op_reply(108 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-11-17T06:33:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 20 datascan.read_dentry: 52_head not found in result 2023-11-17T06:33:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000035 at 0x0x10000000000/52 with size=2 bytes 2023-11-17T06:33:11.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.039+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:109 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 46 ==== osd_op_reply(109 10000000000.01000000 [omap-set-vals] v37'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000035 2023-11-17T06:33:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:110 5.38 5:1e20cbdb::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2a0800 2023-11-17T06:33:11.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 13 ==== osd_op_reply(110 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000016.00000000 2023-11-17T06:33:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000016.0 2023-11-17T06:33:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.043+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:111 5.38 5:1e20cbdb:::10000000016.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a0800 2023-11-17T06:33:11.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 14 ==== osd_op_reply(111 10000000016.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000016 2023-11-17T06:33:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/21 2023-11-17T06:33:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=21 2023-11-17T06:33:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:112 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149000 2023-11-17T06:33:11.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 21 ==== osd_op_reply(112 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:113 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 47 ==== osd_op_reply(113 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:114 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 48 ==== osd_op_reply(114 10000000000.01000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-11-17T06:33:11.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:115 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 49 ==== osd_op_reply(115 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-11-17T06:33:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 20 datascan.read_dentry: 21_head not found in result 2023-11-17T06:33:11.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000016 at 0x0x10000000000/21 with size=2 bytes 2023-11-17T06:33:11.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.047+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:116 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.051+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 50 ==== osd_op_reply(116 10000000000.01000000 [omap-set-vals] v37'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.051+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x10000000016 2023-11-17T06:33:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.051+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:117 5.4 5:20000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a0800 2023-11-17T06:33:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.051+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 15 ==== osd_op_reply(117 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f2e43700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:118 5.24 5:24000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf2da800 2023-11-17T06:33:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 3 ==== osd_op_reply(118 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:119 5.14 5:28000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149000 2023-11-17T06:33:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 22 ==== osd_op_reply(119 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000025.00000000 2023-11-17T06:33:11.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000025.0 2023-11-17T06:33:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:120 5.14 5:2a40c2ef:::10000000025.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf149000 2023-11-17T06:33:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 23 ==== osd_op_reply(120 10000000025.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000025 2023-11-17T06:33:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/36 2023-11-17T06:33:11.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=36 2023-11-17T06:33:11.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.055+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:121 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149000 2023-11-17T06:33:11.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 24 ==== osd_op_reply(121 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:122 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf149400 2023-11-17T06:33:11.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 51 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:123 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149400 2023-11-17T06:33:11.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 52 ==== osd_op_reply(123 10000000000.01000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-11-17T06:33:11.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:124 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:11.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 53 ==== osd_op_reply(124 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-11-17T06:33:11.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 20 datascan.read_dentry: 36_head not found in result 2023-11-17T06:33:11.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000025 at 0x0x10000000000/36 with size=2 bytes 2023-11-17T06:33:11.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.059+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:125 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 54 ==== osd_op_reply(125 10000000000.01000000 [omap-set-vals] v37'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000025 2023-11-17T06:33:11.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:126 5.14 5:2b0a3bc5::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149000 2023-11-17T06:33:11.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 25 ==== osd_op_reply(126 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000058.00000000 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000058.0 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:127 5.14 5:2b0a3bc5:::10000000058.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149000 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 26 ==== osd_op_reply(127 10000000058.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000058 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/87 2023-11-17T06:33:11.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=87 2023-11-17T06:33:11.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.063+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:128 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149000 2023-11-17T06:33:11.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 27 ==== osd_op_reply(128 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:129 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:11.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 55 ==== osd_op_reply(129 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:130 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 56 ==== osd_op_reply(130 10000000000.01000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-11-17T06:33:11.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:131 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 57 ==== osd_op_reply(131 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-11-17T06:33:11.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 20 datascan.read_dentry: 87_head not found in result 2023-11-17T06:33:11.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000058 at 0x0x10000000000/87 with size=2 bytes 2023-11-17T06:33:11.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.067+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:132 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.071+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 58 ==== osd_op_reply(132 10000000000.01000000 [omap-set-vals] v37'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.071+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x10000000058 2023-11-17T06:33:11.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.071+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:133 5.34 5:2c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2da800 2023-11-17T06:33:11.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 4 ==== osd_op_reply(133 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000009.00000000 2023-11-17T06:33:11.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000009.0 2023-11-17T06:33:11.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:134 5.34 5:2eb4da2b:::10000000009.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf2da800 2023-11-17T06:33:11.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 5 ==== osd_op_reply(134 10000000009.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000009 2023-11-17T06:33:11.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/8 2023-11-17T06:33:11.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=8 2023-11-17T06:33:11.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:135 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149000 2023-11-17T06:33:11.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 28 ==== osd_op_reply(135 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:136 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:11.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 59 ==== osd_op_reply(136 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.075+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:137 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 60 ==== osd_op_reply(137 10000000000.01000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-11-17T06:33:11.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:138 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 61 ==== osd_op_reply(138 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-11-17T06:33:11.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 20 datascan.read_dentry: 8_head not found in result 2023-11-17T06:33:11.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000009 at 0x0x10000000000/8 with size=1 bytes 2023-11-17T06:33:11.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.079+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:139 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149400 2023-11-17T06:33:11.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 62 ==== osd_op_reply(139 10000000000.01000000 [omap-set-vals] v37'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x10000000009 2023-11-17T06:33:11.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x55e5bf2da000 0x55e5bf2c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:140 5.c 5:30000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf2da000 2023-11-17T06:33:11.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x55e5bf2da000 0x55e5bf2c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f764c700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x55e5bf2da000 0x55e5bf2c1080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 1 ==== osd_op_reply(140 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.083+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:141 5.2c 5:34000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2a1400 2023-11-17T06:33:11.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 7 ==== osd_op_reply(141 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005f.00000000 2023-11-17T06:33:11.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005f.0 2023-11-17T06:33:11.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:142 5.2c 5:34658595:::1000000005f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf2a1400 2023-11-17T06:33:11.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 8 ==== osd_op_reply(142 1000000005f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005f 2023-11-17T06:33:11.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/94 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=94 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:143 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149000 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 29 ==== osd_op_reply(143 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:144 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:11.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 63 ==== osd_op_reply(144 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:145 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 24 ==== osd_op_reply(145 10000000000.01800000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-11-17T06:33:11.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.087+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:146 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 25 ==== osd_op_reply(146 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-11-17T06:33:11.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 20 datascan.read_dentry: 94_head not found in result 2023-11-17T06:33:11.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005f at 0x0x10000000000/94 with size=2 bytes 2023-11-17T06:33:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:147 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 26 ==== osd_op_reply(147 10000000000.01800000 [omap-set-vals] v37'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x1000000005f 2023-11-17T06:33:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.091+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:148 5.2c 5:3665eb52::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf2a1400 2023-11-17T06:33:11.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 9 ==== osd_op_reply(148 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003e.00000000 2023-11-17T06:33:11.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003e.0 2023-11-17T06:33:11.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:149 5.2c 5:3665eb52:::1000000003e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1400 2023-11-17T06:33:11.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 10 ==== osd_op_reply(149 1000000003e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003e 2023-11-17T06:33:11.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/61 2023-11-17T06:33:11.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=61 2023-11-17T06:33:11.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:150 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149000 2023-11-17T06:33:11.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 30 ==== osd_op_reply(150 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:151 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 64 ==== osd_op_reply(151 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:152 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 65 ==== osd_op_reply(152 10000000000.01000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-11-17T06:33:11.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.095+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:153 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 66 ==== osd_op_reply(153 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-11-17T06:33:11.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 20 datascan.read_dentry: 61_head not found in result 2023-11-17T06:33:11.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003e at 0x0x10000000000/61 with size=2 bytes 2023-11-17T06:33:11.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:154 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 67 ==== osd_op_reply(154 10000000000.01000000 [omap-set-vals] v37'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x1000000003e 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.099+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:155 5.1c 5:38000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 27 ==== osd_op_reply(155 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f2e43700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:156 5.3c 5:3c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2da000 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 2 ==== osd_op_reply(156 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003b.00000000 2023-11-17T06:33:11.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003b.0 2023-11-17T06:33:11.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:157 5.3c 5:3c3d7520:::1000000003b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf2da000 2023-11-17T06:33:11.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 3 ==== osd_op_reply(157 1000000003b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003b 2023-11-17T06:33:11.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/58 2023-11-17T06:33:11.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=58 2023-11-17T06:33:11.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:158 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149000 2023-11-17T06:33:11.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 31 ==== osd_op_reply(158 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:159 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149400 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.103+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 68 ==== osd_op_reply(159 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:160 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a1000 2023-11-17T06:33:11.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 28 ==== osd_op_reply(160 10000000000.01800000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-11-17T06:33:11.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:161 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf2a1000 2023-11-17T06:33:11.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 29 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-11-17T06:33:11.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 20 datascan.read_dentry: 58_head not found in result 2023-11-17T06:33:11.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003b at 0x0x10000000000/58 with size=2 bytes 2023-11-17T06:33:11.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.107+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:162 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 30 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v37'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000003b 2023-11-17T06:33:11.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:163 5.3c 5:3d4c06c4::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2da000 2023-11-17T06:33:11.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 4 ==== osd_op_reply(163 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002a.00000000 2023-11-17T06:33:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002a.0 2023-11-17T06:33:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:164 5.3c 5:3d4c06c4:::1000000002a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf2da000 2023-11-17T06:33:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 5 ==== osd_op_reply(164 1000000002a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002a 2023-11-17T06:33:11.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/41 2023-11-17T06:33:11.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=41 2023-11-17T06:33:11.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:165 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149000 2023-11-17T06:33:11.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 32 ==== osd_op_reply(165 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:166 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf149400 2023-11-17T06:33:11.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 69 ==== osd_op_reply(166 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.111+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:167 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 31 ==== osd_op_reply(167 10000000000.01800000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-11-17T06:33:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:168 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 32 ==== osd_op_reply(168 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-11-17T06:33:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 20 datascan.read_dentry: 41_head not found in result 2023-11-17T06:33:11.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002a at 0x0x10000000000/41 with size=2 bytes 2023-11-17T06:33:11.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.115+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:169 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 33 ==== osd_op_reply(169 10000000000.01800000 [omap-set-vals] v37'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000002a 2023-11-17T06:33:11.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:170 5.2 5:40000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:11.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 70 ==== osd_op_reply(170 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:171 5.22 5:44000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf2a0800 2023-11-17T06:33:11.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 16 ==== osd_op_reply(171 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000039.00000000 2023-11-17T06:33:11.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000039.0 2023-11-17T06:33:11.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:172 5.22 5:44135715:::10000000039.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a0800 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 17 ==== osd_op_reply(172 10000000039.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000039 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/56 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=56 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:173 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf149000 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 33 ==== osd_op_reply(173 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.119+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:174 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149400 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 71 ==== osd_op_reply(174 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:175 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 34 ==== osd_op_reply(175 10000000000.01800000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:176 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 35 ==== osd_op_reply(176 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 20 datascan.read_dentry: 56_head not found in result 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000039 at 0x0x10000000000/56 with size=2 bytes 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.123+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:177 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 36 ==== osd_op_reply(177 10000000000.01800000 [omap-set-vals] v37'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x10000000039 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:178 5.22 5:44834937::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf2a0800 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 18 ==== osd_op_reply(178 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000013.00000000 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000013.0 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:179 5.22 5:44834937:::10000000013.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a0800 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 19 ==== osd_op_reply(179 10000000013.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000013 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/18 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=18 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.127+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:180 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149000 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 34 ==== osd_op_reply(180 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:181 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 72 ==== osd_op_reply(181 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:182 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf2a1000 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 37 ==== osd_op_reply(182 10000000000.01800000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:183 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a1000 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 38 ==== osd_op_reply(183 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-11-17T06:33:11.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 20 datascan.read_dentry: 18_head not found in result 2023-11-17T06:33:11.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000013 at 0x0x10000000000/18 with size=2 bytes 2023-11-17T06:33:11.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.131+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:184 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1000 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 39 ==== osd_op_reply(184 10000000000.01800000 [omap-set-vals] v37'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000013 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:185 5.22 5:4503a7ea::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a0800 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 20 ==== osd_op_reply(185 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000020.00000000 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000020.0 2023-11-17T06:33:11.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.135+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:186 5.22 5:4503a7ea:::10000000020.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a0800 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 21 ==== osd_op_reply(186 10000000020.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000020 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/31 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=31 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:187 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149000 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 35 ==== osd_op_reply(187 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:188 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 73 ==== osd_op_reply(188 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:189 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf149400 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 74 ==== osd_op_reply(189 10000000000.01000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:190 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf149400 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 75 ==== osd_op_reply(190 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 20 datascan.read_dentry: 31_head not found in result 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000020 at 0x0x10000000000/31 with size=2 bytes 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.139+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:191 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149400 2023-11-17T06:33:11.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 76 ==== osd_op_reply(191 10000000000.01000000 [omap-set-vals] v37'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000020 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:192 5.22 5:45d72e17::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf2a0800 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 22 ==== osd_op_reply(192 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000a.00000000 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000a.0 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.143+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:193 5.22 5:45d72e17:::1000000000a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf2a0800 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 23 ==== osd_op_reply(193 1000000000a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000a 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/9 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=9 2023-11-17T06:33:11.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:194 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149000 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 36 ==== osd_op_reply(194 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:195 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 77 ==== osd_op_reply(195 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:196 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 78 ==== osd_op_reply(196 10000000000.01000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:197 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 79 ==== osd_op_reply(197 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 20 datascan.read_dentry: 9_head not found in result 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000a at 0x0x10000000000/9 with size=1 bytes 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.147+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:198 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 80 ==== osd_op_reply(198 10000000000.01000000 [omap-set-vals] v37'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x1000000000a 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:199 5.22 5:46cca9ab::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a0800 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 24 ==== osd_op_reply(199 [pgnls-filter start_epoch 37 out=81b] v37'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000c.00000000 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000c.0 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.151+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:200 5.22 5:46cca9ab:::1000000000c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2a0800 2023-11-17T06:33:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 25 ==== osd_op_reply(200 1000000000c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000c 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/11 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=11 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:201 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf149000 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 37 ==== osd_op_reply(201 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:202 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 81 ==== osd_op_reply(202 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:203 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 82 ==== osd_op_reply(203 10000000000.01000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:204 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 83 ==== osd_op_reply(204 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 20 datascan.read_dentry: 11_head not found in result 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000c at 0x0x10000000000/11 with size=2 bytes 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.155+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:205 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 84 ==== osd_op_reply(205 10000000000.01000000 [omap-set-vals] v37'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x1000000000c 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:206 5.12 5:48000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf2da000 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 6 ==== osd_op_reply(206 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000048.00000000 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000048.0 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:207 5.12 5:4899516f:::10000000048.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf2da000 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 7 ==== osd_op_reply(207 10000000048.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000048 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/71 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=71 2023-11-17T06:33:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.159+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:208 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149000 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 38 ==== osd_op_reply(208 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:209 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149400 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 85 ==== osd_op_reply(209 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:210 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 40 ==== osd_op_reply(210 10000000000.01800000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:211 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 41 ==== osd_op_reply(211 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 20 datascan.read_dentry: 71_head not found in result 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000048 at 0x0x10000000000/71 with size=2 bytes 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.163+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:212 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 42 ==== osd_op_reply(212 10000000000.01800000 [omap-set-vals] v37'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x10000000048 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:213 5.12 5:49e35fbc::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf2da000 2023-11-17T06:33:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 8 ==== osd_op_reply(213 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000f.00000000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000f.0 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:214 5.12 5:49e35fbc:::1000000000f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2da000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 9 ==== osd_op_reply(214 1000000000f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000f 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/14 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=14 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:215 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf149000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 39 ==== osd_op_reply(215 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:216 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149400 2023-11-17T06:33:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 86 ==== osd_op_reply(216 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.167+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:217 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2a1000 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 43 ==== osd_op_reply(217 10000000000.01800000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:218 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 44 ==== osd_op_reply(218 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 20 datascan.read_dentry: 14_head not found in result 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000f at 0x0x10000000000/14 with size=2 bytes 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.171+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:219 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf2a1000 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 45 ==== osd_op_reply(219 10000000000.01800000 [omap-set-vals] v37'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x1000000000f 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:220 5.12 5:49ffa098::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2da000 2023-11-17T06:33:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 10 ==== osd_op_reply(220 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002e.00000000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002e.0 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:221 5.12 5:49ffa098:::1000000002e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2da000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 11 ==== osd_op_reply(221 1000000002e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002e 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/45 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=45 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:222 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 40 ==== osd_op_reply(222 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:223 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 87 ==== osd_op_reply(223 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:224 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.175+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 46 ==== osd_op_reply(224 10000000000.01800000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:225 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a1000 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 47 ==== osd_op_reply(225 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 20 datascan.read_dentry: 45_head not found in result 2023-11-17T06:33:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002e at 0x0x10000000000/45 with size=2 bytes 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:226 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 48 ==== osd_op_reply(226 10000000000.01800000 [omap-set-vals] v37'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x1000000002e 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.179+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:227 5.12 5:4bec3886::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf2da000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 12 ==== osd_op_reply(227 [pgnls-filter start_epoch 37 out=81b] v37'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000002.00000000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000002.0 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:228 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2da000 2023-11-17T06:33:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 13 ==== osd_op_reply(228 10000000002.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000002 2023-11-17T06:33:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/1 2023-11-17T06:33:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=1 2023-11-17T06:33:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:229 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149000 2023-11-17T06:33:11.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 41 ==== osd_op_reply(229 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:230 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 88 ==== osd_op_reply(230 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:231 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 89 ==== osd_op_reply(231 10000000000.01000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.183+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:232 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 90 ==== osd_op_reply(232 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-11-17T06:33:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 20 datascan.read_dentry: 1_head not found in result 2023-11-17T06:33:11.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000002 at 0x0x10000000000/1 with size=1 bytes 2023-11-17T06:33:11.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:233 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:11.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 91 ==== osd_op_reply(233 10000000000.01000000 [omap-set-vals] v37'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x10000000002 2023-11-17T06:33:11.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.187+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:234 5.32 5:4c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149000 2023-11-17T06:33:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 42 ==== osd_op_reply(234 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000055.00000000 2023-11-17T06:33:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000055.0 2023-11-17T06:33:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:235 5.32 5:4d757255:::10000000055.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149000 2023-11-17T06:33:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 43 ==== osd_op_reply(235 10000000055.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000055 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/84 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=84 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:236 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf149000 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 44 ==== osd_op_reply(236 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:237 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149400 2023-11-17T06:33:11.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 92 ==== osd_op_reply(237 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.191+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:238 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 93 ==== osd_op_reply(238 10000000000.01000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:239 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 94 ==== osd_op_reply(239 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-11-17T06:33:11.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 20 datascan.read_dentry: 84_head not found in result 2023-11-17T06:33:11.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000055 at 0x0x10000000000/84 with size=2 bytes 2023-11-17T06:33:11.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.195+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:240 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 95 ==== osd_op_reply(240 10000000000.01000000 [omap-set-vals] v37'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000055 2023-11-17T06:33:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:241 5.32 5:4def72d4::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149000 2023-11-17T06:33:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 45 ==== osd_op_reply(241 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2023-11-17T06:33:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000003.0 2023-11-17T06:33:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:242 5.32 5:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 46 ==== osd_op_reply(242 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2023-11-17T06:33:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/2 2023-11-17T06:33:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=2 2023-11-17T06:33:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.199+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:243 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149000 2023-11-17T06:33:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 47 ==== osd_op_reply(243 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:244 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 96 ==== osd_op_reply(244 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:245 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 97 ==== osd_op_reply(245 10000000000.01000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-11-17T06:33:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:246 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 98 ==== osd_op_reply(246 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 20 datascan.read_dentry: 2_head not found in result 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000000/2 with size=1 bytes 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.203+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:247 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 99 ==== osd_op_reply(247 10000000000.01000000 [omap-set-vals] v37'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x10000000003 2023-11-17T06:33:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:248 5.32 5:4ecb6bb7::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149000 2023-11-17T06:33:11.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 48 ==== osd_op_reply(248 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003f.00000000 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003f.0 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:249 5.32 5:4ecb6bb7:::1000000003f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf149000 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 49 ==== osd_op_reply(249 1000000003f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003f 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/62 2023-11-17T06:33:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=62 2023-11-17T06:33:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.207+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:250 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149000 2023-11-17T06:33:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 50 ==== osd_op_reply(250 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:251 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 100 ==== osd_op_reply(251 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:252 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 49 ==== osd_op_reply(252 10000000000.01800000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:253 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a1000 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 50 ==== osd_op_reply(253 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 20 datascan.read_dentry: 62_head not found in result 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003f at 0x0x10000000000/62 with size=2 bytes 2023-11-17T06:33:11.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.211+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:254 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf2a1000 2023-11-17T06:33:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 51 ==== osd_op_reply(254 10000000000.01800000 [omap-set-vals] v37'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x1000000003f 2023-11-17T06:33:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:255 5.32 5:4f7da3cc::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf149000 2023-11-17T06:33:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 51 ==== osd_op_reply(255 [pgnls-filter start_epoch 37 out=81b] v37'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001e.00000000 2023-11-17T06:33:11.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001e.0 2023-11-17T06:33:11.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:256 5.32 5:4f7da3cc:::1000000001e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149000 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 52 ==== osd_op_reply(256 1000000001e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001e 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/29 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=29 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.215+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:257 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149000 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 53 ==== osd_op_reply(257 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:258 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149400 2023-11-17T06:33:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 101 ==== osd_op_reply(258 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:259 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 52 ==== osd_op_reply(259 10000000000.01800000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:260 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf2a1000 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 53 ==== osd_op_reply(260 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 20 datascan.read_dentry: 29_head not found in result 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001e at 0x0x10000000000/29 with size=2 bytes 2023-11-17T06:33:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.219+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:261 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 54 ==== osd_op_reply(261 10000000000.01800000 [omap-set-vals] v37'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x1000000001e 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:262 5.a 5:50000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a1400 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 11 ==== osd_op_reply(262 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:263 5.2a 5:54000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.223+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 55 ==== osd_op_reply(263 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f2e43700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:264 5.1a 5:58000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c380 con 0x55e5bf2a0800 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 26 ==== osd_op_reply(264 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000018.00000000 2023-11-17T06:33:11.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000018.0 2023-11-17T06:33:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:265 5.1a 5:5b3b19a5:::10000000018.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8700 con 0x55e5bf2a0800 2023-11-17T06:33:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 27 ==== osd_op_reply(265 10000000018.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000018 2023-11-17T06:33:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/23 2023-11-17T06:33:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=23 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:266 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf149000 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 54 ==== osd_op_reply(266 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.227+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:267 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149400 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 102 ==== osd_op_reply(267 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:268 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2a1000 2023-11-17T06:33:11.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 56 ==== osd_op_reply(268 10000000000.01800000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-11-17T06:33:11.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:269 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf2a1000 2023-11-17T06:33:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 57 ==== osd_op_reply(269 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-11-17T06:33:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 20 datascan.read_dentry: 23_head not found in result 2023-11-17T06:33:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000018 at 0x0x10000000000/23 with size=2 bytes 2023-11-17T06:33:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.231+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:270 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf2a1000 2023-11-17T06:33:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 58 ==== osd_op_reply(270 10000000000.01800000 [omap-set-vals] v37'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x10000000018 2023-11-17T06:33:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:271 5.1a 5:5bd35317::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a0800 2023-11-17T06:33:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 28 ==== osd_op_reply(271 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000044.00000000 2023-11-17T06:33:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000044.0 2023-11-17T06:33:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:272 5.1a 5:5bd35317:::10000000044.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2a0800 2023-11-17T06:33:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 29 ==== osd_op_reply(272 10000000044.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000044 2023-11-17T06:33:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/67 2023-11-17T06:33:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=67 2023-11-17T06:33:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:273 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149000 2023-11-17T06:33:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 55 ==== osd_op_reply(273 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.235+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:274 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 103 ==== osd_op_reply(274 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:275 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 59 ==== osd_op_reply(275 10000000000.01800000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:276 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a1000 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 60 ==== osd_op_reply(276 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-11-17T06:33:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 20 datascan.read_dentry: 67_head not found in result 2023-11-17T06:33:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000044 at 0x0x10000000000/67 with size=2 bytes 2023-11-17T06:33:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.239+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:277 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 61 ==== osd_op_reply(277 10000000000.01800000 [omap-set-vals] v37'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000044 2023-11-17T06:33:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:278 5.3a 5:5c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149000 2023-11-17T06:33:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 56 ==== osd_op_reply(278 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001f.00000000 2023-11-17T06:33:11.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001f.0 2023-11-17T06:33:11.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:279 5.3a 5:5f13809d:::1000000001f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf149000 2023-11-17T06:33:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 57 ==== osd_op_reply(279 1000000001f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001f 2023-11-17T06:33:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/30 2023-11-17T06:33:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=30 2023-11-17T06:33:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.243+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:280 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149000 2023-11-17T06:33:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 58 ==== osd_op_reply(280 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:281 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 104 ==== osd_op_reply(281 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:282 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2a1000 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 62 ==== osd_op_reply(282 10000000000.01800000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-11-17T06:33:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:283 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 63 ==== osd_op_reply(283 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-11-17T06:33:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 20 datascan.read_dentry: 30_head not found in result 2023-11-17T06:33:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001f at 0x0x10000000000/30 with size=2 bytes 2023-11-17T06:33:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.247+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:284 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 64 ==== osd_op_reply(284 10000000000.01800000 [omap-set-vals] v37'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x1000000001f 2023-11-17T06:33:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:285 5.6 5:60000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2a1400 2023-11-17T06:33:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 12 ==== osd_op_reply(285 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000037.00000000 2023-11-17T06:33:11.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000037.0 2023-11-17T06:33:11.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:286 5.6 5:60a13eb4:::10000000037.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a1400 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 13 ==== osd_op_reply(286 10000000037.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000037 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/54 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=54 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.251+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:287 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149000 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 59 ==== osd_op_reply(287 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:288 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 105 ==== osd_op_reply(288 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:289 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 65 ==== osd_op_reply(289 10000000000.01800000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-11-17T06:33:11.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:290 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a1000 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 66 ==== osd_op_reply(290 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 20 datascan.read_dentry: 54_head not found in result 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000037 at 0x0x10000000000/54 with size=2 bytes 2023-11-17T06:33:11.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.255+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:291 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 67 ==== osd_op_reply(291 10000000000.01800000 [omap-set-vals] v37'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x10000000037 2023-11-17T06:33:11.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:292 5.6 5:61404748::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a1400 2023-11-17T06:33:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 14 ==== osd_op_reply(292 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000042.00000000 2023-11-17T06:33:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000042.0 2023-11-17T06:33:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:293 5.6 5:61404748:::10000000042.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2a1400 2023-11-17T06:33:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 15 ==== osd_op_reply(293 10000000042.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000042 2023-11-17T06:33:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/65 2023-11-17T06:33:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=65 2023-11-17T06:33:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:294 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149000 2023-11-17T06:33:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 60 ==== osd_op_reply(294 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.259+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:295 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149400 2023-11-17T06:33:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 106 ==== osd_op_reply(295 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:296 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 107 ==== osd_op_reply(296 10000000000.01000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:297 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149400 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 108 ==== osd_op_reply(297 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 20 datascan.read_dentry: 65_head not found in result 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000042 at 0x0x10000000000/65 with size=2 bytes 2023-11-17T06:33:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.263+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:298 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 109 ==== osd_op_reply(298 10000000000.01000000 [omap-set-vals] v37'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000042 2023-11-17T06:33:11.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:299 5.6 5:614fee2a::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf2a1400 2023-11-17T06:33:11.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 16 ==== osd_op_reply(299 [pgnls-filter start_epoch 37 out=81b] v37'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003d.00000000 2023-11-17T06:33:11.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003d.0 2023-11-17T06:33:11.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:300 5.6 5:614fee2a:::1000000003d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf2a1400 2023-11-17T06:33:11.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 17 ==== osd_op_reply(300 1000000003d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003d 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/60 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=60 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:301 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149000 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.267+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 61 ==== osd_op_reply(301 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:302 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf149400 2023-11-17T06:33:11.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 110 ==== osd_op_reply(302 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:303 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf2a1000 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 68 ==== osd_op_reply(303 10000000000.01800000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:304 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a1000 2023-11-17T06:33:11.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 69 ==== osd_op_reply(304 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-11-17T06:33:11.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 20 datascan.read_dentry: 60_head not found in result 2023-11-17T06:33:11.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003d at 0x0x10000000000/60 with size=2 bytes 2023-11-17T06:33:11.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.271+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:305 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 70 ==== osd_op_reply(305 10000000000.01800000 [omap-set-vals] v37'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x1000000003d 2023-11-17T06:33:11.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:306 5.26 5:64000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149000 2023-11-17T06:33:11.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 62 ==== osd_op_reply(306 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002b.00000000 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002b.0 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:307 5.26 5:645408ac:::1000000002b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149000 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.275+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 63 ==== osd_op_reply(307 1000000002b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002b 2023-11-17T06:33:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/42 2023-11-17T06:33:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=42 2023-11-17T06:33:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:308 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149000 2023-11-17T06:33:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 64 ==== osd_op_reply(308 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:309 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149400 2023-11-17T06:33:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 111 ==== osd_op_reply(309 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:310 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 112 ==== osd_op_reply(310 10000000000.01000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:311 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 113 ==== osd_op_reply(311 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 20 datascan.read_dentry: 42_head not found in result 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002b at 0x0x10000000000/42 with size=2 bytes 2023-11-17T06:33:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.279+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:312 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 114 ==== osd_op_reply(312 10000000000.01000000 [omap-set-vals] v37'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000002b 2023-11-17T06:33:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:313 5.26 5:65f9ba37::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf149000 2023-11-17T06:33:11.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 65 ==== osd_op_reply(313 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000038.00000000 2023-11-17T06:33:11.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000038.0 2023-11-17T06:33:11.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:314 5.26 5:65f9ba37:::10000000038.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149000 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 66 ==== osd_op_reply(314 10000000038.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000038 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/55 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=55 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.283+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:315 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149000 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 67 ==== osd_op_reply(315 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:316 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 115 ==== osd_op_reply(316 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:317 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 116 ==== osd_op_reply(317 10000000000.01000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-11-17T06:33:11.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:318 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 117 ==== osd_op_reply(318 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-11-17T06:33:11.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 20 datascan.read_dentry: 55_head not found in result 2023-11-17T06:33:11.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000038 at 0x0x10000000000/55 with size=2 bytes 2023-11-17T06:33:11.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.287+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:319 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf330000 con 0x55e5bf149400 2023-11-17T06:33:11.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.291+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 118 ==== osd_op_reply(319 10000000000.01000000 [omap-set-vals] v37'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.291+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x10000000038 2023-11-17T06:33:11.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.291+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:320 5.26 5:660982fc::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf330380 con 0x55e5bf149000 2023-11-17T06:33:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 68 ==== osd_op_reply(320 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002d.00000000 2023-11-17T06:33:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002d.0 2023-11-17T06:33:11.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:321 5.26 5:660982fc:::1000000002d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf330700 con 0x55e5bf149000 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 69 ==== osd_op_reply(321 1000000002d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002d 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/44 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=44 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:322 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf330e00 con 0x55e5bf149000 2023-11-17T06:33:11.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 70 ==== osd_op_reply(322 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:323 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf331180 con 0x55e5bf149400 2023-11-17T06:33:11.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 119 ==== osd_op_reply(323 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.295+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:324 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf331500 con 0x55e5bf2a1000 2023-11-17T06:33:11.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 71 ==== osd_op_reply(324 10000000000.01800000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-11-17T06:33:11.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:325 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf331880 con 0x55e5bf2a1000 2023-11-17T06:33:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 72 ==== osd_op_reply(325 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-11-17T06:33:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 20 datascan.read_dentry: 44_head not found in result 2023-11-17T06:33:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002d at 0x0x10000000000/44 with size=2 bytes 2023-11-17T06:33:11.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.299+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:326 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf331c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 73 ==== osd_op_reply(326 10000000000.01800000 [omap-set-vals] v37'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x1000000002d 2023-11-17T06:33:11.306 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:327 5.26 5:66f1e28f::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf330380 con 0x55e5bf149000 2023-11-17T06:33:11.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 71 ==== osd_op_reply(327 [pgnls-filter start_epoch 37 out=101b] v37'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000063.00000000 2023-11-17T06:33:11.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000063.0 2023-11-17T06:33:11.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:328 5.26 5:66f1e28f:::10000000063.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149000 2023-11-17T06:33:11.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 72 ==== osd_op_reply(328 10000000063.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000063 2023-11-17T06:33:11.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/98 2023-11-17T06:33:11.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=98 2023-11-17T06:33:11.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:329 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149000 2023-11-17T06:33:11.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 73 ==== osd_op_reply(329 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.303+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:330 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 120 ==== osd_op_reply(330 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:331 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1000 2023-11-17T06:33:11.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 74 ==== osd_op_reply(331 10000000000.01800000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-11-17T06:33:11.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:332 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2a1000 2023-11-17T06:33:11.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 75 ==== osd_op_reply(332 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-11-17T06:33:11.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 20 datascan.read_dentry: 98_head not found in result 2023-11-17T06:33:11.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000063 at 0x0x10000000000/98 with size=2 bytes 2023-11-17T06:33:11.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.307+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:333 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a1000 2023-11-17T06:33:11.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 76 ==== osd_op_reply(333 10000000000.01800000 [omap-set-vals] v37'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000063 2023-11-17T06:33:11.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:334 5.26 5:678705fb::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149000 2023-11-17T06:33:11.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 74 ==== osd_op_reply(334 [pgnls-filter start_epoch 37 out=81b] v37'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000046.00000000 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000046.0 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:335 5.26 5:678705fb:::10000000046.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149000 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 75 ==== osd_op_reply(335 10000000046.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000046 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/69 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=69 2023-11-17T06:33:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:336 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149000 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 76 ==== osd_op_reply(336 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.311+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:337 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 121 ==== osd_op_reply(337 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:338 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149400 2023-11-17T06:33:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 122 ==== osd_op_reply(338 10000000000.01000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-11-17T06:33:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:339 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149400 2023-11-17T06:33:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 123 ==== osd_op_reply(339 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-11-17T06:33:11.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 20 datascan.read_dentry: 69_head not found in result 2023-11-17T06:33:11.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000046 at 0x0x10000000000/69 with size=2 bytes 2023-11-17T06:33:11.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.315+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:340 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149400 2023-11-17T06:33:11.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 124 ==== osd_op_reply(340 10000000000.01000000 [omap-set-vals] v37'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x10000000046 2023-11-17T06:33:11.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:341 5.16 5:68000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf2da800 2023-11-17T06:33:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 6 ==== osd_op_reply(341 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000050.00000000 2023-11-17T06:33:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000050.0 2023-11-17T06:33:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.319+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:342 5.16 5:69de5632:::10000000050.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2da800 2023-11-17T06:33:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 7 ==== osd_op_reply(342 10000000050.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000050 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/79 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=79 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:343 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149000 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 77 ==== osd_op_reply(343 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:344 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:11.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 125 ==== osd_op_reply(344 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:345 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf2a1000 2023-11-17T06:33:11.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 77 ==== osd_op_reply(345 10000000000.01800000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-11-17T06:33:11.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:346 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2a1000 2023-11-17T06:33:11.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 78 ==== osd_op_reply(346 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-11-17T06:33:11.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 20 datascan.read_dentry: 79_head not found in result 2023-11-17T06:33:11.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000050 at 0x0x10000000000/79 with size=2 bytes 2023-11-17T06:33:11.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.323+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:347 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf2a1000 2023-11-17T06:33:11.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 79 ==== osd_op_reply(347 10000000000.01800000 [omap-set-vals] v37'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000050 2023-11-17T06:33:11.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:348 5.16 5:6a23747e::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf2da800 2023-11-17T06:33:11.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 8 ==== osd_op_reply(348 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000053.00000000 2023-11-17T06:33:11.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000053.0 2023-11-17T06:33:11.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.327+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:349 5.16 5:6a23747e:::10000000053.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf2da800 2023-11-17T06:33:11.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 9 ==== osd_op_reply(349 10000000053.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000053 2023-11-17T06:33:11.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/82 2023-11-17T06:33:11.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=82 2023-11-17T06:33:11.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:350 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337500 con 0x55e5bf149000 2023-11-17T06:33:11.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 78 ==== osd_op_reply(350 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:351 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf149400 2023-11-17T06:33:11.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 126 ==== osd_op_reply(351 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:352 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 80 ==== osd_op_reply(352 10000000000.01800000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.331+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:353 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf2a1000 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 81 ==== osd_op_reply(353 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 20 datascan.read_dentry: 82_head not found in result 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000053 at 0x0x10000000000/82 with size=2 bytes 2023-11-17T06:33:11.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:354 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf2a1000 2023-11-17T06:33:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 82 ==== osd_op_reply(354 10000000000.01800000 [omap-set-vals] v37'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000053 2023-11-17T06:33:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.335+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:355 5.16 5:6a415a36::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2da800 2023-11-17T06:33:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 10 ==== osd_op_reply(355 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000043.00000000 2023-11-17T06:33:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000043.0 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:356 5.16 5:6a415a36:::10000000043.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf2da800 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 11 ==== osd_op_reply(356 10000000043.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000043 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/66 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=66 2023-11-17T06:33:11.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:357 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf149000 2023-11-17T06:33:11.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 79 ==== osd_op_reply(357 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:358 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf149400 2023-11-17T06:33:11.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 127 ==== osd_op_reply(358 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.339+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:359 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149400 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 128 ==== osd_op_reply(359 10000000000.01000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:360 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9880 con 0x55e5bf149400 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 129 ==== osd_op_reply(360 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-11-17T06:33:11.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 20 datascan.read_dentry: 66_head not found in result 2023-11-17T06:33:11.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000043 at 0x0x10000000000/66 with size=2 bytes 2023-11-17T06:33:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.343+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:361 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 130 ==== osd_op_reply(361 10000000000.01000000 [omap-set-vals] v37'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000043 2023-11-17T06:33:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:362 5.16 5:6a54d456::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2da800 2023-11-17T06:33:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 12 ==== osd_op_reply(362 [pgnls-filter start_epoch 37 out=81b] v37'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001c.00000000 2023-11-17T06:33:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001c.0 2023-11-17T06:33:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:363 5.16 5:6a54d456:::1000000001c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2da800 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 13 ==== osd_op_reply(363 1000000001c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001c 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/27 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=27 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:364 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf149000 2023-11-17T06:33:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 80 ==== osd_op_reply(364 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.347+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:365 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 131 ==== osd_op_reply(365 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:366 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 132 ==== osd_op_reply(366 10000000000.01000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-11-17T06:33:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:367 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 133 ==== osd_op_reply(367 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-11-17T06:33:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 20 datascan.read_dentry: 27_head not found in result 2023-11-17T06:33:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001c at 0x0x10000000000/27 with size=2 bytes 2023-11-17T06:33:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.351+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:368 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 134 ==== osd_op_reply(368 10000000000.01000000 [omap-set-vals] v37'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x1000000001c 2023-11-17T06:33:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:369 5.36 5:6c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2da000 2023-11-17T06:33:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 14 ==== osd_op_reply(369 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004d.00000000 2023-11-17T06:33:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004d.0 2023-11-17T06:33:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:370 5.36 5:6c82bb73:::1000000004d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2da000 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.355+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 15 ==== osd_op_reply(370 1000000004d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004d 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/76 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=76 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:371 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149000 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 81 ==== osd_op_reply(371 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:372 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 135 ==== osd_op_reply(372 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:373 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1000 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 83 ==== osd_op_reply(373 10000000000.01800000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:374 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 84 ==== osd_op_reply(374 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-11-17T06:33:11.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 20 datascan.read_dentry: 76_head not found in result 2023-11-17T06:33:11.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004d at 0x0x10000000000/76 with size=2 bytes 2023-11-17T06:33:11.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.359+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:375 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2a1000 2023-11-17T06:33:11.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 85 ==== osd_op_reply(375 10000000000.01800000 [omap-set-vals] v37'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x1000000004d 2023-11-17T06:33:11.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:376 5.36 5:6dc1a442::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf2da000 2023-11-17T06:33:11.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 16 ==== osd_op_reply(376 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000015.00000000 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000015.0 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:377 5.36 5:6dc1a442:::10000000015.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf2da000 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.363+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 17 ==== osd_op_reply(377 10000000015.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000015 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/20 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=20 2023-11-17T06:33:11.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:378 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149000 2023-11-17T06:33:11.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 82 ==== osd_op_reply(378 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:379 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149400 2023-11-17T06:33:11.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 136 ==== osd_op_reply(379 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:380 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf149400 2023-11-17T06:33:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 137 ==== osd_op_reply(380 10000000000.01000000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-11-17T06:33:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:381 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149400 2023-11-17T06:33:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 138 ==== osd_op_reply(381 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-11-17T06:33:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 20 datascan.read_dentry: 20_head not found in result 2023-11-17T06:33:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000015 at 0x0x10000000000/20 with size=2 bytes 2023-11-17T06:33:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.367+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:382 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf149400 2023-11-17T06:33:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.371+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 139 ==== osd_op_reply(382 10000000000.01000000 [omap-set-vals] v37'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.371+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000015 2023-11-17T06:33:11.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.371+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:383 5.36 5:6f6f8b6e::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2da000 2023-11-17T06:33:11.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 18 ==== osd_op_reply(383 [pgnls-filter start_epoch 37 out=81b] v37'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000045.00000000 2023-11-17T06:33:11.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000045.0 2023-11-17T06:33:11.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:384 5.36 5:6f6f8b6e:::10000000045.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf2da000 2023-11-17T06:33:11.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 19 ==== osd_op_reply(384 10000000045.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000045 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/68 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=68 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:385 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149000 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 83 ==== osd_op_reply(385 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:386 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf149400 2023-11-17T06:33:11.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 140 ==== osd_op_reply(386 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:387 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a1000 2023-11-17T06:33:11.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 86 ==== osd_op_reply(387 10000000000.01800000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-11-17T06:33:11.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.375+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:388 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c380 con 0x55e5bf2a1000 2023-11-17T06:33:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.379+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 87 ==== osd_op_reply(388 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.379+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-11-17T06:33:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.379+0000 7fe2f9691840 20 datascan.read_dentry: 68_head not found in result 2023-11-17T06:33:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.379+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000045 at 0x0x10000000000/68 with size=2 bytes 2023-11-17T06:33:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.379+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:389 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a1000 2023-11-17T06:33:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 88 ==== osd_op_reply(389 10000000000.01800000 [omap-set-vals] v37'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000045 2023-11-17T06:33:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:390 5.e 5:70000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf2a1000 2023-11-17T06:33:11.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 89 ==== osd_op_reply(390 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:391 5.2e 5:74000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149000 2023-11-17T06:33:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 84 ==== osd_op_reply(391 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000057.00000000 2023-11-17T06:33:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000057.0 2023-11-17T06:33:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:392 5.2e 5:74dc0bdf:::10000000057.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf149000 2023-11-17T06:33:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 85 ==== osd_op_reply(392 10000000057.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000057 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/86 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=86 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.383+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:393 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149000 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 86 ==== osd_op_reply(393 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:394 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 141 ==== osd_op_reply(394 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:395 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 142 ==== osd_op_reply(395 10000000000.01000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-11-17T06:33:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:396 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf149400 2023-11-17T06:33:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 143 ==== osd_op_reply(396 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-11-17T06:33:11.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 20 datascan.read_dentry: 86_head not found in result 2023-11-17T06:33:11.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000057 at 0x0x10000000000/86 with size=2 bytes 2023-11-17T06:33:11.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.387+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:397 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c380 con 0x55e5bf149400 2023-11-17T06:33:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 144 ==== osd_op_reply(397 10000000000.01000000 [omap-set-vals] v37'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x10000000057 2023-11-17T06:33:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x55e5bf2dac00 0x55e5bf2c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:398 5.1e 5:78000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2dac00 2023-11-17T06:33:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x55e5bf2dac00 0x55e5bf2c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.391+0000 7fe2f864e700 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x55e5bf2dac00 0x55e5bf2c1600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 1 ==== osd_op_reply(398 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000017.00000000 2023-11-17T06:33:11.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000017.0 2023-11-17T06:33:11.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:399 5.1e 5:78cea7f0:::10000000017.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9500 con 0x55e5bf2dac00 2023-11-17T06:33:11.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 2 ==== osd_op_reply(399 10000000017.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000017 2023-11-17T06:33:11.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/22 2023-11-17T06:33:11.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=22 2023-11-17T06:33:11.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:400 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8a80 con 0x55e5bf149000 2023-11-17T06:33:11.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 87 ==== osd_op_reply(400 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:401 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8e00 con 0x55e5bf149400 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 145 ==== osd_op_reply(401 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.395+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:402 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8380 con 0x55e5bf2a1000 2023-11-17T06:33:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 90 ==== osd_op_reply(402 10000000000.01800000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:403 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 91 ==== osd_op_reply(403 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-11-17T06:33:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 20 datascan.read_dentry: 22_head not found in result 2023-11-17T06:33:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000017 at 0x0x10000000000/22 with size=2 bytes 2023-11-17T06:33:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.399+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:404 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf2a1000 2023-11-17T06:33:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 92 ==== osd_op_reply(404 10000000000.01800000 [omap-set-vals] v37'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x10000000017 2023-11-17T06:33:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:405 5.3e 5:7c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf149000 2023-11-17T06:33:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 88 ==== osd_op_reply(405 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000033.00000000 2023-11-17T06:33:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000033.0 2023-11-17T06:33:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:406 5.3e 5:7e2d0da6:::10000000033.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf149000 2023-11-17T06:33:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 89 ==== osd_op_reply(406 10000000033.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000033 2023-11-17T06:33:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/50 2023-11-17T06:33:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=50 2023-11-17T06:33:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:407 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 90 ==== osd_op_reply(407 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:408 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 146 ==== osd_op_reply(408 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.403+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:409 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 147 ==== osd_op_reply(409 10000000000.01000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-11-17T06:33:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:410 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 148 ==== osd_op_reply(410 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-11-17T06:33:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 20 datascan.read_dentry: 50_head not found in result 2023-11-17T06:33:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000033 at 0x0x10000000000/50 with size=2 bytes 2023-11-17T06:33:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.407+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:411 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf149400 2023-11-17T06:33:11.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 149 ==== osd_op_reply(411 10000000000.01000000 [omap-set-vals] v37'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000033 2023-11-17T06:33:11.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:412 5.1 5:80000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1000 2023-11-17T06:33:11.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 93 ==== osd_op_reply(412 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000034.00000000 2023-11-17T06:33:11.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000034.0 2023-11-17T06:33:11.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:413 5.1 5:81df0dbf:::10000000034.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1000 2023-11-17T06:33:11.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 94 ==== osd_op_reply(413 10000000034.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000034 2023-11-17T06:33:11.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/51 2023-11-17T06:33:11.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=51 2023-11-17T06:33:11.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:414 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149000 2023-11-17T06:33:11.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 91 ==== osd_op_reply(414 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:415 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 150 ==== osd_op_reply(415 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.411+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:416 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c700 con 0x55e5bf2a1000 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 95 ==== osd_op_reply(416 10000000000.01800000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:417 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c380 con 0x55e5bf2a1000 2023-11-17T06:33:11.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 96 ==== osd_op_reply(417 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-11-17T06:33:11.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 20 datascan.read_dentry: 51_head not found in result 2023-11-17T06:33:11.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000034 at 0x0x10000000000/51 with size=2 bytes 2023-11-17T06:33:11.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.415+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:418 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a1000 2023-11-17T06:33:11.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 97 ==== osd_op_reply(418 10000000000.01800000 [omap-set-vals] v37'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000034 2023-11-17T06:33:11.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:419 5.21 5:84000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e8000 con 0x55e5bf149400 2023-11-17T06:33:11.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 151 ==== osd_op_reply(419 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004c.00000000 2023-11-17T06:33:11.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004c.0 2023-11-17T06:33:11.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:420 5.21 5:844eae9e:::1000000004c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9c00 con 0x55e5bf149400 2023-11-17T06:33:11.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 152 ==== osd_op_reply(420 1000000004c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004c 2023-11-17T06:33:11.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/75 2023-11-17T06:33:11.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=75 2023-11-17T06:33:11.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:421 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2e9180 con 0x55e5bf149000 2023-11-17T06:33:11.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 92 ==== osd_op_reply(421 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.419+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:422 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf149400 2023-11-17T06:33:11.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 153 ==== osd_op_reply(422 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:423 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149400 2023-11-17T06:33:11.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 154 ==== osd_op_reply(423 10000000000.01000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-11-17T06:33:11.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:424 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf149400 2023-11-17T06:33:11.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 155 ==== osd_op_reply(424 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-11-17T06:33:11.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 20 datascan.read_dentry: 75_head not found in result 2023-11-17T06:33:11.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004c at 0x0x10000000000/75 with size=2 bytes 2023-11-17T06:33:11.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.423+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:425 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 156 ==== osd_op_reply(425 10000000000.01000000 [omap-set-vals] v37'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x1000000004c 2023-11-17T06:33:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:426 5.21 5:8660ae9f::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:11.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 157 ==== osd_op_reply(426 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004f.00000000 2023-11-17T06:33:11.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004f.0 2023-11-17T06:33:11.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:427 5.21 5:8660ae9f:::1000000004f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.427+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 158 ==== osd_op_reply(427 1000000004f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004f 2023-11-17T06:33:11.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/78 2023-11-17T06:33:11.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=78 2023-11-17T06:33:11.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:428 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149000 2023-11-17T06:33:11.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 93 ==== osd_op_reply(428 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:429 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149400 2023-11-17T06:33:11.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 159 ==== osd_op_reply(429 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:430 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322000 con 0x55e5bf2a1000 2023-11-17T06:33:11.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 98 ==== osd_op_reply(430 10000000000.01800000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:431 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322380 con 0x55e5bf2a1000 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 99 ==== osd_op_reply(431 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 20 datascan.read_dentry: 78_head not found in result 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004f at 0x0x10000000000/78 with size=2 bytes 2023-11-17T06:33:11.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.431+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:432 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322700 con 0x55e5bf2a1000 2023-11-17T06:33:11.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.435+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 100 ==== osd_op_reply(432 10000000000.01800000 [omap-set-vals] v37'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.435+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x1000000004f 2023-11-17T06:33:11.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.435+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:433 5.21 5:86d8200e::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322a80 con 0x55e5bf149400 2023-11-17T06:33:11.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 160 ==== osd_op_reply(433 [pgnls-filter start_epoch 37 out=101b] v37'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000019.00000000 2023-11-17T06:33:11.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000019.0 2023-11-17T06:33:11.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:434 5.21 5:86d8200e:::10000000019.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf149400 2023-11-17T06:33:11.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 161 ==== osd_op_reply(434 10000000019.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000019 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/24 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=24 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:435 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323500 con 0x55e5bf149000 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 94 ==== osd_op_reply(435 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:436 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323880 con 0x55e5bf149400 2023-11-17T06:33:11.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 162 ==== osd_op_reply(436 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.439+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:437 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 101 ==== osd_op_reply(437 10000000000.01800000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-11-17T06:33:11.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:438 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 102 ==== osd_op_reply(438 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-11-17T06:33:11.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 20 datascan.read_dentry: 24_head not found in result 2023-11-17T06:33:11.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000019 at 0x0x10000000000/24 with size=2 bytes 2023-11-17T06:33:11.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.443+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:439 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322000 con 0x55e5bf2a1000 2023-11-17T06:33:11.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 103 ==== osd_op_reply(439 10000000000.01800000 [omap-set-vals] v37'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x10000000019 2023-11-17T06:33:11.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:440 5.21 5:870ac4b3::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322380 con 0x55e5bf149400 2023-11-17T06:33:11.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 163 ==== osd_op_reply(440 [pgnls-filter start_epoch 37 out=81b] v37'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005e.00000000 2023-11-17T06:33:11.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005e.0 2023-11-17T06:33:11.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:441 5.21 5:870ac4b3:::1000000005e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 164 ==== osd_op_reply(441 1000000005e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005e 2023-11-17T06:33:11.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/93 2023-11-17T06:33:11.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=93 2023-11-17T06:33:11.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:442 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149000 2023-11-17T06:33:11.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 95 ==== osd_op_reply(442 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.447+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:443 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf149400 2023-11-17T06:33:11.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 165 ==== osd_op_reply(443 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:444 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca380 con 0x55e5bf2a1000 2023-11-17T06:33:11.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 104 ==== osd_op_reply(444 10000000000.01800000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-11-17T06:33:11.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:445 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 105 ==== osd_op_reply(445 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-11-17T06:33:11.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 20 datascan.read_dentry: 93_head not found in result 2023-11-17T06:33:11.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005e at 0x0x10000000000/93 with size=2 bytes 2023-11-17T06:33:11.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.451+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:446 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.455+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 106 ==== osd_op_reply(446 10000000000.01800000 [omap-set-vals] v37'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.455+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x1000000005e 2023-11-17T06:33:11.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.455+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:447 5.11 5:88000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.455+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 166 ==== osd_op_reply(447 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.455+0000 7fe2f2e43700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:448 5.31 5:8c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2da800 2023-11-17T06:33:11.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 14 ==== osd_op_reply(448 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004b.00000000 2023-11-17T06:33:11.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004b.0 2023-11-17T06:33:11.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:449 5.31 5:8e5cc622:::1000000004b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2da800 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 15 ==== osd_op_reply(449 1000000004b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004b 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/74 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=74 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:450 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149000 2023-11-17T06:33:11.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 96 ==== osd_op_reply(450 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:451 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149400 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.459+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 167 ==== osd_op_reply(451 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:452 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149400 2023-11-17T06:33:11.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 168 ==== osd_op_reply(452 10000000000.01000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-11-17T06:33:11.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:453 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:11.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 169 ==== osd_op_reply(453 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-11-17T06:33:11.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 20 datascan.read_dentry: 74_head not found in result 2023-11-17T06:33:11.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004b at 0x0x10000000000/74 with size=2 bytes 2023-11-17T06:33:11.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.463+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:454 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 170 ==== osd_op_reply(454 10000000000.01000000 [omap-set-vals] v37'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000004b 2023-11-17T06:33:11.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:455 5.31 5:8ea80fc8::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2da800 2023-11-17T06:33:11.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 16 ==== osd_op_reply(455 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000032.00000000 2023-11-17T06:33:11.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000032.0 2023-11-17T06:33:11.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:456 5.31 5:8ea80fc8:::10000000032.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf2da800 2023-11-17T06:33:11.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 17 ==== osd_op_reply(456 10000000032.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000032 2023-11-17T06:33:11.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/49 2023-11-17T06:33:11.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=49 2023-11-17T06:33:11.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:457 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf149000 2023-11-17T06:33:11.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.467+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 97 ==== osd_op_reply(457 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:458 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf149400 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 171 ==== osd_op_reply(458 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:459 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf2a1000 2023-11-17T06:33:11.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 107 ==== osd_op_reply(459 10000000000.01800000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-11-17T06:33:11.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:460 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf2a1000 2023-11-17T06:33:11.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 108 ==== osd_op_reply(460 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-11-17T06:33:11.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 20 datascan.read_dentry: 49_head not found in result 2023-11-17T06:33:11.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000032 at 0x0x10000000000/49 with size=2 bytes 2023-11-17T06:33:11.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.471+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:461 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2a1000 2023-11-17T06:33:11.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.475+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 109 ==== osd_op_reply(461 10000000000.01800000 [omap-set-vals] v37'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.475+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000032 2023-11-17T06:33:11.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.475+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:462 5.31 5:8ff022d2::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf2da800 2023-11-17T06:33:11.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 18 ==== osd_op_reply(462 [pgnls-filter start_epoch 37 out=81b] v37'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000059.00000000 2023-11-17T06:33:11.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000059.0 2023-11-17T06:33:11.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:463 5.31 5:8ff022d2:::10000000059.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2da800 2023-11-17T06:33:11.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 19 ==== osd_op_reply(463 10000000059.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000059 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/88 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=88 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:464 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf149000 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 98 ==== osd_op_reply(464 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.483 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:465 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 172 ==== osd_op_reply(465 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:466 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.479+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 173 ==== osd_op_reply(466 10000000000.01000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:467 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e000 con 0x55e5bf149400 2023-11-17T06:33:11.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 174 ==== osd_op_reply(467 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-11-17T06:33:11.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 20 datascan.read_dentry: 88_head not found in result 2023-11-17T06:33:11.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000059 at 0x0x10000000000/88 with size=2 bytes 2023-11-17T06:33:11.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.483+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:468 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e380 con 0x55e5bf149400 2023-11-17T06:33:11.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 175 ==== osd_op_reply(468 10000000000.01000000 [omap-set-vals] v37'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x10000000059 2023-11-17T06:33:11.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:469 5.9 5:90000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf2a0800 2023-11-17T06:33:11.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 30 ==== osd_op_reply(469 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000005.00000000 2023-11-17T06:33:11.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000005.0 2023-11-17T06:33:11.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:470 5.9 5:9258b67d:::10000000005.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34ea80 con 0x55e5bf2a0800 2023-11-17T06:33:11.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 31 ==== osd_op_reply(470 10000000005.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000005 2023-11-17T06:33:11.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/4 2023-11-17T06:33:11.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=4 2023-11-17T06:33:11.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:471 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f180 con 0x55e5bf149000 2023-11-17T06:33:11.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 99 ==== osd_op_reply(471 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.487+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:472 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f500 con 0x55e5bf149400 2023-11-17T06:33:11.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 176 ==== osd_op_reply(472 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:473 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf149400 2023-11-17T06:33:11.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 177 ==== osd_op_reply(473 10000000000.01000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-11-17T06:33:11.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:474 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34fc00 con 0x55e5bf149400 2023-11-17T06:33:11.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 178 ==== osd_op_reply(474 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.496 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-11-17T06:33:11.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 20 datascan.read_dentry: 4_head not found in result 2023-11-17T06:33:11.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000005 at 0x0x10000000000/4 with size=1 bytes 2023-11-17T06:33:11.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.491+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:475 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf149400 2023-11-17T06:33:11.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 179 ==== osd_op_reply(475 10000000000.01000000 [omap-set-vals] v37'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x10000000005 2023-11-17T06:33:11.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:476 5.29 5:94000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2dac00 2023-11-17T06:33:11.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 3 ==== osd_op_reply(476 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004e.00000000 2023-11-17T06:33:11.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004e.0 2023-11-17T06:33:11.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.495+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:477 5.29 5:954bc910:::1000000004e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf2dac00 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 4 ==== osd_op_reply(477 1000000004e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004e 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/77 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=77 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:478 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149000 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 100 ==== osd_op_reply(478 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:479 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337500 con 0x55e5bf149400 2023-11-17T06:33:11.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 180 ==== osd_op_reply(479 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:480 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf149400 2023-11-17T06:33:11.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 181 ==== osd_op_reply(480 10000000000.01000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-11-17T06:33:11.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:481 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149400 2023-11-17T06:33:11.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 182 ==== osd_op_reply(481 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-11-17T06:33:11.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 20 datascan.read_dentry: 77_head not found in result 2023-11-17T06:33:11.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.499+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004e at 0x0x10000000000/77 with size=2 bytes 2023-11-17T06:33:11.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.503+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:482 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf149400 2023-11-17T06:33:11.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.503+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 183 ==== osd_op_reply(482 10000000000.01000000 [omap-set-vals] v37'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.503+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x1000000004e 2023-11-17T06:33:11.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.503+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:483 5.29 5:9752f43f::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2dac00 2023-11-17T06:33:11.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 5 ==== osd_op_reply(483 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000b.00000000 2023-11-17T06:33:11.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000b.0 2023-11-17T06:33:11.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:484 5.29 5:9752f43f:::1000000000b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2dac00 2023-11-17T06:33:11.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 6 ==== osd_op_reply(484 1000000000b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000b 2023-11-17T06:33:11.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/10 2023-11-17T06:33:11.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=10 2023-11-17T06:33:11.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:485 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149000 2023-11-17T06:33:11.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 101 ==== osd_op_reply(485 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:486 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf149400 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 184 ==== osd_op_reply(486 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:487 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 185 ==== osd_op_reply(487 10000000000.01000000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:488 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e000 con 0x55e5bf149400 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.507+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 186 ==== osd_op_reply(488 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 20 datascan.read_dentry: 10_head not found in result 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000b at 0x0x10000000000/10 with size=2 bytes 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:489 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e380 con 0x55e5bf149400 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 187 ==== osd_op_reply(489 10000000000.01000000 [omap-set-vals] v37'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x1000000000b 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.511+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:490 5.19 5:98000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f500 con 0x55e5bf2da000 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 20 ==== osd_op_reply(490 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000051.00000000 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000051.0 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:491 5.19 5:9ae7aaf4:::10000000051.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf2da000 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 21 ==== osd_op_reply(491 10000000051.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000051 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/80 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=80 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:492 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf149000 2023-11-17T06:33:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 102 ==== osd_op_reply(492 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:493 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 188 ==== osd_op_reply(493 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:494 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 189 ==== osd_op_reply(494 10000000000.01000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.515+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:495 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf149400 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 190 ==== osd_op_reply(495 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-11-17T06:33:11.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 20 datascan.read_dentry: 80_head not found in result 2023-11-17T06:33:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000051 at 0x0x10000000000/80 with size=2 bytes 2023-11-17T06:33:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:496 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 191 ==== osd_op_reply(496 10000000000.01000000 [omap-set-vals] v37'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000051 2023-11-17T06:33:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.519+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:497 5.39 5:9c000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf2a0800 2023-11-17T06:33:11.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 32 ==== osd_op_reply(497 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005b.00000000 2023-11-17T06:33:11.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005b.0 2023-11-17T06:33:11.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:498 5.39 5:9fc48627:::1000000005b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf2a0800 2023-11-17T06:33:11.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 33 ==== osd_op_reply(498 1000000005b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005b 2023-11-17T06:33:11.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/90 2023-11-17T06:33:11.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=90 2023-11-17T06:33:11.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:499 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149000 2023-11-17T06:33:11.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 103 ==== osd_op_reply(499 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:500 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 192 ==== osd_op_reply(500 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.523+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:501 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 193 ==== osd_op_reply(501 10000000000.01000000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-11-17T06:33:11.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:502 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf149400 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 194 ==== osd_op_reply(502 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 20 datascan.read_dentry: 90_head not found in result 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005b at 0x0x10000000000/90 with size=2 bytes 2023-11-17T06:33:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.527+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:503 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323180 con 0x55e5bf149400 2023-11-17T06:33:11.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 195 ==== osd_op_reply(503 10000000000.01000000 [omap-set-vals] v37'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000005b 2023-11-17T06:33:11.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:504 5.5 5:a0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf2dac00 2023-11-17T06:33:11.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 7 ==== osd_op_reply(504 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000004.00000000 2023-11-17T06:33:11.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000004.0 2023-11-17T06:33:11.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:505 5.5 5:a367a3e8:::10000000004.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323880 con 0x55e5bf2dac00 2023-11-17T06:33:11.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 8 ==== osd_op_reply(505 10000000004.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000004 2023-11-17T06:33:11.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/3 2023-11-17T06:33:11.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=3 2023-11-17T06:33:11.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:506 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323180 con 0x55e5bf149000 2023-11-17T06:33:11.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 104 ==== osd_op_reply(506 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.531+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:507 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf149400 2023-11-17T06:33:11.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 196 ==== osd_op_reply(507 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:508 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf149400 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 197 ==== osd_op_reply(508 10000000000.01000000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:509 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf149400 2023-11-17T06:33:11.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 198 ==== osd_op_reply(509 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-11-17T06:33:11.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 20 datascan.read_dentry: 3_head not found in result 2023-11-17T06:33:11.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000004 at 0x0x10000000000/3 with size=1 bytes 2023-11-17T06:33:11.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.535+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:510 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 199 ==== osd_op_reply(510 10000000000.01000000 [omap-set-vals] v37'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x10000000004 2023-11-17T06:33:11.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:511 5.25 5:a4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2da000 2023-11-17T06:33:11.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 22 ==== osd_op_reply(511 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000006.00000000 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000006.0 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:512 5.25 5:a5feb6f3:::10000000006.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf2da000 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 23 ==== osd_op_reply(512 10000000006.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000006 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/5 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=5 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:513 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337500 con 0x55e5bf149000 2023-11-17T06:33:11.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 105 ==== osd_op_reply(513 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.539+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:514 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf149400 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 200 ==== osd_op_reply(514 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:515 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf2a1000 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 110 ==== osd_op_reply(515 10000000000.01800000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:516 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 111 ==== osd_op_reply(516 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-11-17T06:33:11.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 20 datascan.read_dentry: 5_head not found in result 2023-11-17T06:33:11.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000006 at 0x0x10000000000/5 with size=1 bytes 2023-11-17T06:33:11.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.543+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:517 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 112 ==== osd_op_reply(517 10000000000.01800000 [omap-set-vals] v37'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x10000000006 2023-11-17T06:33:11.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:518 5.25 5:a622384a::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2da000 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 24 ==== osd_op_reply(518 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002c.00000000 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002c.0 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:519 5.25 5:a622384a:::1000000002c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf2da000 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 25 ==== osd_op_reply(519 1000000002c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002c 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/43 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=43 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:520 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149000 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 106 ==== osd_op_reply(520 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.547+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:521 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 201 ==== osd_op_reply(521 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:522 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e000 con 0x55e5bf149400 2023-11-17T06:33:11.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 202 ==== osd_op_reply(522 10000000000.01000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:523 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e380 con 0x55e5bf149400 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 203 ==== osd_op_reply(523 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 20 datascan.read_dentry: 43_head not found in result 2023-11-17T06:33:11.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002c at 0x0x10000000000/43 with size=2 bytes 2023-11-17T06:33:11.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.551+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:524 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 204 ==== osd_op_reply(524 10000000000.01000000 [omap-set-vals] v37'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x1000000002c 2023-11-17T06:33:11.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:525 5.15 5:a8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8e00 con 0x55e5bf2da800 2023-11-17T06:33:11.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 20 ==== osd_op_reply(525 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000011.00000000 2023-11-17T06:33:11.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000011.0 2023-11-17T06:33:11.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.555+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:526 5.15 5:ab5910e2:::10000000011.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf2da800 2023-11-17T06:33:11.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 21 ==== osd_op_reply(526 10000000011.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000011 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/16 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=16 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:527 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149000 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 107 ==== osd_op_reply(527 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:528 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 205 ==== osd_op_reply(528 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:529 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf2a1000 2023-11-17T06:33:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 113 ==== osd_op_reply(529 10000000000.01800000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-11-17T06:33:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:530 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322700 con 0x55e5bf2a1000 2023-11-17T06:33:11.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 114 ==== osd_op_reply(530 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 20 datascan.read_dentry: 16_head not found in result 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.559+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000011 at 0x0x10000000000/16 with size=2 bytes 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:531 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323500 con 0x55e5bf2a1000 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 115 ==== osd_op_reply(531 10000000000.01800000 [omap-set-vals] v37'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000011 2023-11-17T06:33:11.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:532 5.35 5:ac000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323c00 con 0x55e5bf2a0800 2023-11-17T06:33:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 34 ==== osd_op_reply(532 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.563+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:533 5.d 5:b0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a1400 2023-11-17T06:33:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 18 ==== osd_op_reply(533 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000027.00000000 2023-11-17T06:33:11.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000027.0 2023-11-17T06:33:11.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:534 5.d 5:b0d15537:::10000000027.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322a80 con 0x55e5bf2a1400 2023-11-17T06:33:11.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 19 ==== osd_op_reply(534 10000000027.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000027 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/38 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=38 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:535 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323180 con 0x55e5bf149000 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 108 ==== osd_op_reply(535 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:536 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 206 ==== osd_op_reply(536 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.567+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:537 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 207 ==== osd_op_reply(537 10000000000.01000000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:538 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 208 ==== osd_op_reply(538 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 20 datascan.read_dentry: 38_head not found in result 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000027 at 0x0x10000000000/38 with size=2 bytes 2023-11-17T06:33:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.571+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:539 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f180 con 0x55e5bf149400 2023-11-17T06:33:11.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 209 ==== osd_op_reply(539 10000000000.01000000 [omap-set-vals] v37'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x10000000027 2023-11-17T06:33:11.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:540 5.d 5:b185e6e8::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f500 con 0x55e5bf2a1400 2023-11-17T06:33:11.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 20 ==== osd_op_reply(540 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000012.00000000 2023-11-17T06:33:11.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000012.0 2023-11-17T06:33:11.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:541 5.d 5:b185e6e8:::10000000012.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34fc00 con 0x55e5bf2a1400 2023-11-17T06:33:11.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 21 ==== osd_op_reply(541 10000000012.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000012 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/17 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=17 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:542 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf149000 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 109 ==== osd_op_reply(542 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.575+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:543 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf149400 2023-11-17T06:33:11.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 210 ==== osd_op_reply(543 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:544 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2a1000 2023-11-17T06:33:11.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 116 ==== osd_op_reply(544 10000000000.01800000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-11-17T06:33:11.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:545 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 117 ==== osd_op_reply(545 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-11-17T06:33:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 20 datascan.read_dentry: 17_head not found in result 2023-11-17T06:33:11.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000012 at 0x0x10000000000/17 with size=2 bytes 2023-11-17T06:33:11.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.579+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:546 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf2a1000 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 118 ==== osd_op_reply(546 10000000000.01800000 [omap-set-vals] v37'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000012 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:547 5.2d 5:b4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf149000 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 110 ==== osd_op_reply(547 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000005d.00000000 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000005d.0 2023-11-17T06:33:11.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:548 5.2d 5:b5236558:::1000000005d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf149000 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 111 ==== osd_op_reply(548 1000000005d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005d 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/92 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=92 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:549 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338380 con 0x55e5bf149000 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 112 ==== osd_op_reply(549 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.583+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:550 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338700 con 0x55e5bf149400 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 211 ==== osd_op_reply(550 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:551 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338a80 con 0x55e5bf149400 2023-11-17T06:33:11.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 212 ==== osd_op_reply(551 10000000000.01000000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:552 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338e00 con 0x55e5bf149400 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 213 ==== osd_op_reply(552 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 20 datascan.read_dentry: 92_head not found in result 2023-11-17T06:33:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005d at 0x0x10000000000/92 with size=2 bytes 2023-11-17T06:33:11.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.587+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:553 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339180 con 0x55e5bf149400 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 214 ==== osd_op_reply(553 10000000000.01000000 [omap-set-vals] v37'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x1000000005d 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:554 5.1d 5:b8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339500 con 0x55e5bf2da000 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 26 ==== osd_op_reply(554 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000028.00000000 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000028.0 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:555 5.1d 5:ba3960b0:::10000000028.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339880 con 0x55e5bf2da000 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 27 ==== osd_op_reply(555 10000000028.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000028 2023-11-17T06:33:11.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/39 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=39 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:556 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338000 con 0x55e5bf149000 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 113 ==== osd_op_reply(556 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.591+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:557 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338380 con 0x55e5bf149400 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 215 ==== osd_op_reply(557 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:558 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339500 con 0x55e5bf149400 2023-11-17T06:33:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 216 ==== osd_op_reply(558 10000000000.01000000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-11-17T06:33:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:559 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339c00 con 0x55e5bf149400 2023-11-17T06:33:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 217 ==== osd_op_reply(559 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-11-17T06:33:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 20 datascan.read_dentry: 39_head not found in result 2023-11-17T06:33:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000028 at 0x0x10000000000/39 with size=2 bytes 2023-11-17T06:33:11.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.595+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:560 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339880 con 0x55e5bf149400 2023-11-17T06:33:11.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 218 ==== osd_op_reply(560 10000000000.01000000 [omap-set-vals] v37'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x10000000028 2023-11-17T06:33:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:561 5.1d 5:bbf5850a::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338700 con 0x55e5bf2da000 2023-11-17T06:33:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 28 ==== osd_op_reply(561 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000007.00000000 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000007.0 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:562 5.1d 5:bbf5850a:::10000000007.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c000 con 0x55e5bf2da000 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 29 ==== osd_op_reply(562 10000000007.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000007 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/6 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=6 2023-11-17T06:33:11.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.599+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:563 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149000 2023-11-17T06:33:11.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 114 ==== osd_op_reply(563 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:564 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 219 ==== osd_op_reply(564 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:565 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2a1000 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 119 ==== osd_op_reply(565 10000000000.01800000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:566 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 120 ==== osd_op_reply(566 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 20 datascan.read_dentry: 6_head not found in result 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000007 at 0x0x10000000000/6 with size=1 bytes 2023-11-17T06:33:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.603+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:567 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf2a1000 2023-11-17T06:33:11.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 121 ==== osd_op_reply(567 10000000000.01800000 [omap-set-vals] v37'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x10000000007 2023-11-17T06:33:11.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:568 5.3d 5:bc000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f180 con 0x55e5bf2da800 2023-11-17T06:33:11.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 22 ==== osd_op_reply(568 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000026.00000000 2023-11-17T06:33:11.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000026.0 2023-11-17T06:33:11.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:569 5.3d 5:be1922a8:::10000000026.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e380 con 0x55e5bf2da800 2023-11-17T06:33:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 23 ==== osd_op_reply(569 10000000026.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000026 2023-11-17T06:33:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/37 2023-11-17T06:33:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=37 2023-11-17T06:33:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.607+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:570 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338000 con 0x55e5bf149000 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 115 ==== osd_op_reply(570 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:571 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338700 con 0x55e5bf149400 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 220 ==== osd_op_reply(571 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:572 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f500 con 0x55e5bf2a1000 2023-11-17T06:33:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 122 ==== osd_op_reply(572 10000000000.01800000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-11-17T06:33:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:573 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf2a1000 2023-11-17T06:33:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 123 ==== osd_op_reply(573 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-11-17T06:33:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 20 datascan.read_dentry: 37_head not found in result 2023-11-17T06:33:11.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000026 at 0x0x10000000000/37 with size=2 bytes 2023-11-17T06:33:11.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.611+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:574 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34fc00 con 0x55e5bf2a1000 2023-11-17T06:33:11.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 124 ==== osd_op_reply(574 10000000000.01800000 [omap-set-vals] v37'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x10000000026 2023-11-17T06:33:11.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:575 5.3 5:c0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf2dac00 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 9 ==== osd_op_reply(575 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000060.00000000 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000060.0 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:576 5.3 5:c001b242:::10000000060.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2dac00 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 10 ==== osd_op_reply(576 10000000060.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000060 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/95 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=95 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:577 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149000 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 116 ==== osd_op_reply(577 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.615+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:578 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 221 ==== osd_op_reply(578 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:579 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 222 ==== osd_op_reply(579 10000000000.01000000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:580 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 223 ==== osd_op_reply(580 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 20 datascan.read_dentry: 95_head not found in result 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000060 at 0x0x10000000000/95 with size=2 bytes 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.619+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:581 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322380 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 224 ==== osd_op_reply(581 10000000000.01000000 [omap-set-vals] v37'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000060 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:582 5.3 5:c1adcc3d::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323880 con 0x55e5bf2dac00 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 11 ==== osd_op_reply(582 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000030.00000000 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000030.0 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:583 5.3 5:c1adcc3d:::10000000030.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322000 con 0x55e5bf2dac00 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.0 v2:172.21.15.100:6801/1609678627 12 ==== osd_op_reply(583 10000000030.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2dac00 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000030 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/47 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=47 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:584 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323180 con 0x55e5bf149000 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 117 ==== osd_op_reply(584 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:585 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323500 con 0x55e5bf149400 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 225 ==== osd_op_reply(585 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.623+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:586 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322700 con 0x55e5bf2a1000 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 125 ==== osd_op_reply(586 10000000000.01800000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:587 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a1000 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 126 ==== osd_op_reply(587 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 20 datascan.read_dentry: 47_head not found in result 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000030 at 0x0x10000000000/47 with size=2 bytes 2023-11-17T06:33:11.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.627+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:588 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2a1000 2023-11-17T06:33:11.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 127 ==== osd_op_reply(588 10000000000.01800000 [omap-set-vals] v37'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000030 2023-11-17T06:33:11.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:589 5.23 5:c4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf2a1000 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 128 ==== osd_op_reply(589 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000002f.00000000 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000002f.0 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.631+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:590 5.23 5:c550f404:::1000000002f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a1000 2023-11-17T06:33:11.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 129 ==== osd_op_reply(590 1000000002f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002f 2023-11-17T06:33:11.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/46 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=46 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:591 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf149000 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 118 ==== osd_op_reply(591 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:592 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149400 2023-11-17T06:33:11.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 226 ==== osd_op_reply(592 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:593 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:11.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 227 ==== osd_op_reply(593 10000000000.01000000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-11-17T06:33:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.635+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:594 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 228 ==== osd_op_reply(594 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-11-17T06:33:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 20 datascan.read_dentry: 46_head not found in result 2023-11-17T06:33:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002f at 0x0x10000000000/46 with size=2 bytes 2023-11-17T06:33:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:595 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf149400 2023-11-17T06:33:11.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 229 ==== osd_op_reply(595 10000000000.01000000 [omap-set-vals] v37'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x1000000002f 2023-11-17T06:33:11.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.639+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:596 5.23 5:c6a0a389::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2a1000 2023-11-17T06:33:11.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 130 ==== osd_op_reply(596 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.647 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000040.00000000 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000040.0 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:597 5.23 5:c6a0a389:::10000000040.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf2a1000 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 131 ==== osd_op_reply(597 10000000040.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000040 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/63 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=63 2023-11-17T06:33:11.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:598 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf149000 2023-11-17T06:33:11.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 119 ==== osd_op_reply(598 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:599 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149400 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 230 ==== osd_op_reply(599 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:600 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337500 con 0x55e5bf149400 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 231 ==== osd_op_reply(600 10000000000.01000000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-11-17T06:33:11.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.643+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:601 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf149400 2023-11-17T06:33:11.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.647+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 232 ==== osd_op_reply(601 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.647+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-11-17T06:33:11.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.647+0000 7fe2f9691840 20 datascan.read_dentry: 63_head not found in result 2023-11-17T06:33:11.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.647+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000040 at 0x0x10000000000/63 with size=2 bytes 2023-11-17T06:33:11.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.647+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:602 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf149400 2023-11-17T06:33:11.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 233 ==== osd_op_reply(602 10000000000.01000000 [omap-set-vals] v37'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000040 2023-11-17T06:33:11.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:603 5.13 5:c8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf149000 2023-11-17T06:33:11.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 120 ==== osd_op_reply(603 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000008.00000000 2023-11-17T06:33:11.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000008.0 2023-11-17T06:33:11.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:604 5.13 5:cabe77c1:::10000000008.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149000 2023-11-17T06:33:11.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 121 ==== osd_op_reply(604 10000000008.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000008 2023-11-17T06:33:11.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/7 2023-11-17T06:33:11.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=7 2023-11-17T06:33:11.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:605 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:11.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 122 ==== osd_op_reply(605 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.651+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:606 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9dc00 con 0x55e5bf149400 2023-11-17T06:33:11.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 234 ==== osd_op_reply(606 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:607 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf2a1000 2023-11-17T06:33:11.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 132 ==== osd_op_reply(607 10000000000.01800000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-11-17T06:33:11.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:608 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 133 ==== osd_op_reply(608 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-11-17T06:33:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 20 datascan.read_dentry: 7_head not found in result 2023-11-17T06:33:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000008 at 0x0x10000000000/7 with size=1 bytes 2023-11-17T06:33:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.655+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:609 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322380 con 0x55e5bf2a1000 2023-11-17T06:33:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 134 ==== osd_op_reply(609 10000000000.01800000 [omap-set-vals] v37'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x10000000008 2023-11-17T06:33:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:610 5.33 5:cc000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323880 con 0x55e5bf2a1400 2023-11-17T06:33:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 22 ==== osd_op_reply(610 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000001d.00000000 2023-11-17T06:33:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000001d.0 2023-11-17T06:33:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:611 5.33 5:cf746ac5:::1000000001d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322a80 con 0x55e5bf2a1400 2023-11-17T06:33:11.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 23 ==== osd_op_reply(611 1000000001d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001d 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/28 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=28 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:612 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323500 con 0x55e5bf149000 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 123 ==== osd_op_reply(612 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.659+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:613 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 235 ==== osd_op_reply(613 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:614 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 236 ==== osd_op_reply(614 10000000000.01000000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:615 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 237 ==== osd_op_reply(615 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 20 datascan.read_dentry: 28_head not found in result 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001d at 0x0x10000000000/28 with size=2 bytes 2023-11-17T06:33:11.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.663+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:616 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf149400 2023-11-17T06:33:11.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 238 ==== osd_op_reply(616 10000000000.01000000 [omap-set-vals] v37'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x1000000001d 2023-11-17T06:33:11.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:617 5.b 5:d0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf2a1400 2023-11-17T06:33:11.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 24 ==== osd_op_reply(617 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000022.00000000 2023-11-17T06:33:11.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000022.0 2023-11-17T06:33:11.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.667+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:618 5.b 5:d2626379:::10000000022.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338a80 con 0x55e5bf2a1400 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 25 ==== osd_op_reply(618 10000000022.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000022 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/33 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=33 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:619 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339180 con 0x55e5bf149000 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 124 ==== osd_op_reply(619 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:620 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338380 con 0x55e5bf149400 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 239 ==== osd_op_reply(620 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:621 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339500 con 0x55e5bf2a1000 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 135 ==== osd_op_reply(621 10000000000.01800000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.671+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:622 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 136 ==== osd_op_reply(622 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-11-17T06:33:11.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 20 datascan.read_dentry: 33_head not found in result 2023-11-17T06:33:11.680 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000022 at 0x0x10000000000/33 with size=2 bytes 2023-11-17T06:33:11.681 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:623 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339880 con 0x55e5bf2a1000 2023-11-17T06:33:11.681 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 137 ==== osd_op_reply(623 10000000000.01800000 [omap-set-vals] v37'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000022 2023-11-17T06:33:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.675+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:624 5.b 5:d30f9a54::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338700 con 0x55e5bf2a1400 2023-11-17T06:33:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 26 ==== osd_op_reply(624 [pgnls-filter start_epoch 37 out=101b] v37'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000052.00000000 2023-11-17T06:33:11.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000052.0 2023-11-17T06:33:11.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:625 5.b 5:d30f9a54:::10000000052.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf2a1400 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 27 ==== osd_op_reply(625 10000000052.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000052 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/81 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=81 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:626 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322700 con 0x55e5bf149000 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 125 ==== osd_op_reply(626 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:627 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf149400 2023-11-17T06:33:11.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 240 ==== osd_op_reply(627 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.679+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:628 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a1000 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 138 ==== osd_op_reply(628 10000000000.01800000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:629 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2a1000 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 139 ==== osd_op_reply(629 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 20 datascan.read_dentry: 81_head not found in result 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000052 at 0x0x10000000000/81 with size=2 bytes 2023-11-17T06:33:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.683+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:630 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf2a1000 2023-11-17T06:33:11.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 140 ==== osd_op_reply(630 10000000000.01800000 [omap-set-vals] v37'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000052 2023-11-17T06:33:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:631 5.b 5:d3d0d483::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf2a1400 2023-11-17T06:33:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 28 ==== osd_op_reply(631 [pgnls-filter start_epoch 37 out=81b] v37'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000021.00000000 2023-11-17T06:33:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000021.0 2023-11-17T06:33:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:632 5.b 5:d3d0d483:::10000000021.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf2a1400 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 29 ==== osd_op_reply(632 10000000021.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000021 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/32 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=32 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:633 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149000 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 126 ==== osd_op_reply(633 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:634 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149400 2023-11-17T06:33:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 241 ==== osd_op_reply(634 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:635 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf2a1000 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 141 ==== osd_op_reply(635 10000000000.01800000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.687+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:636 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 142 ==== osd_op_reply(636 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-11-17T06:33:11.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 20 datascan.read_dentry: 32_head not found in result 2023-11-17T06:33:11.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000021 at 0x0x10000000000/32 with size=2 bytes 2023-11-17T06:33:11.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:637 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf2a1000 2023-11-17T06:33:11.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 143 ==== osd_op_reply(637 10000000000.01800000 [omap-set-vals] v37'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000021 2023-11-17T06:33:11.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.691+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:638 5.2b 5:d4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 144 ==== osd_op_reply(638 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000041.00000000 2023-11-17T06:33:11.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000041.0 2023-11-17T06:33:11.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:639 5.2b 5:d4b9b687:::10000000041.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf2a1000 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 145 ==== osd_op_reply(639 10000000041.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000041 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/64 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=64 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:640 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf149000 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 127 ==== osd_op_reply(640 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:641 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf149400 2023-11-17T06:33:11.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 242 ==== osd_op_reply(641 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:642 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f500 con 0x55e5bf149400 2023-11-17T06:33:11.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 243 ==== osd_op_reply(642 10000000000.01000000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-11-17T06:33:11.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.695+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:643 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf149400 2023-11-17T06:33:11.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.699+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 244 ==== osd_op_reply(643 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.699+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-11-17T06:33:11.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.699+0000 7fe2f9691840 20 datascan.read_dentry: 64_head not found in result 2023-11-17T06:33:11.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.699+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000041 at 0x0x10000000000/64 with size=2 bytes 2023-11-17T06:33:11.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.699+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:644 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34fc00 con 0x55e5bf149400 2023-11-17T06:33:11.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 245 ==== osd_op_reply(644 10000000000.01000000 [omap-set-vals] v37'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000041 2023-11-17T06:33:11.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:645 5.2b 5:d747f723::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338000 con 0x55e5bf2a1000 2023-11-17T06:33:11.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 146 ==== osd_op_reply(645 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000036.00000000 2023-11-17T06:33:11.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000036.0 2023-11-17T06:33:11.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:646 5.2b 5:d747f723:::10000000036.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf2a1000 2023-11-17T06:33:11.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 147 ==== osd_op_reply(646 10000000036.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000036 2023-11-17T06:33:11.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/53 2023-11-17T06:33:11.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=53 2023-11-17T06:33:11.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:647 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149000 2023-11-17T06:33:11.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 128 ==== osd_op_reply(647 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.703+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:648 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf149400 2023-11-17T06:33:11.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 246 ==== osd_op_reply(648 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:649 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30dc00 con 0x55e5bf149400 2023-11-17T06:33:11.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 247 ==== osd_op_reply(649 10000000000.01000000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-11-17T06:33:11.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:650 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d500 con 0x55e5bf149400 2023-11-17T06:33:11.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 248 ==== osd_op_reply(650 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-11-17T06:33:11.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 20 datascan.read_dentry: 53_head not found in result 2023-11-17T06:33:11.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000036 at 0x0x10000000000/53 with size=2 bytes 2023-11-17T06:33:11.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.707+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:651 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d880 con 0x55e5bf149400 2023-11-17T06:33:11.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 249 ==== osd_op_reply(651 10000000000.01000000 [omap-set-vals] v37'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x10000000036 2023-11-17T06:33:11.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:652 5.1b 5:d8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2da800 2023-11-17T06:33:11.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 24 ==== osd_op_reply(652 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000031.00000000 2023-11-17T06:33:11.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000031.0 2023-11-17T06:33:11.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:653 5.1b 5:d88bb762:::10000000031.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf2da800 2023-11-17T06:33:11.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 25 ==== osd_op_reply(653 10000000031.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000031 2023-11-17T06:33:11.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/48 2023-11-17T06:33:11.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=48 2023-11-17T06:33:11.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.711+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:654 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf149000 2023-11-17T06:33:11.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 129 ==== osd_op_reply(654 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:655 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34fc00 con 0x55e5bf149400 2023-11-17T06:33:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 250 ==== osd_op_reply(655 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:656 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf2a1000 2023-11-17T06:33:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 148 ==== osd_op_reply(656 10000000000.01800000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-11-17T06:33:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:657 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf2a1000 2023-11-17T06:33:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 149 ==== osd_op_reply(657 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-11-17T06:33:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 20 datascan.read_dentry: 48_head not found in result 2023-11-17T06:33:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000031 at 0x0x10000000000/48 with size=2 bytes 2023-11-17T06:33:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.715+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:658 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf2a1000 2023-11-17T06:33:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 150 ==== osd_op_reply(658 10000000000.01800000 [omap-set-vals] v37'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000031 2023-11-17T06:33:11.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:659 5.3b 5:dc000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9500 con 0x55e5bf2a1400 2023-11-17T06:33:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 30 ==== osd_op_reply(659 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000010.00000000 2023-11-17T06:33:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000010.0 2023-11-17T06:33:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:660 5.3b 5:dde6a3df:::10000000010.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9c00 con 0x55e5bf2a1400 2023-11-17T06:33:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.2 v2:172.21.15.100:6824/177771602 31 ==== osd_op_reply(660 10000000010.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf2a1400 2023-11-17T06:33:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000010 2023-11-17T06:33:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/15 2023-11-17T06:33:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=15 2023-11-17T06:33:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:661 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bee9d880 con 0x55e5bf149000 2023-11-17T06:33:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 130 ==== osd_op_reply(661 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:662 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2caa80 con 0x55e5bf149400 2023-11-17T06:33:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 251 ==== osd_op_reply(662 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.723+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:663 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca000 con 0x55e5bf149400 2023-11-17T06:33:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 252 ==== osd_op_reply(663 10000000000.01000000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-11-17T06:33:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:664 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb500 con 0x55e5bf149400 2023-11-17T06:33:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 253 ==== osd_op_reply(664 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-11-17T06:33:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 20 datascan.read_dentry: 15_head not found in result 2023-11-17T06:33:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000010 at 0x0x10000000000/15 with size=2 bytes 2023-11-17T06:33:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.727+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:665 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323880 con 0x55e5bf149400 2023-11-17T06:33:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 254 ==== osd_op_reply(665 10000000000.01000000 [omap-set-vals] v37'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000010 2023-11-17T06:33:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:666 5.7 5:e0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322000 con 0x55e5bf2da800 2023-11-17T06:33:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 26 ==== osd_op_reply(666 [pgnls-filter start_epoch 37 out=101b] v37'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000049.00000000 2023-11-17T06:33:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000049.0 2023-11-17T06:33:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.731+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:667 5.7 5:e2d50132:::10000000049.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322a80 con 0x55e5bf2da800 2023-11-17T06:33:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 27 ==== osd_op_reply(667 10000000049.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000049 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/72 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=72 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:668 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf149000 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 131 ==== osd_op_reply(668 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:669 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338e00 con 0x55e5bf149400 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 255 ==== osd_op_reply(669 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:670 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 151 ==== osd_op_reply(670 10000000000.01800000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.735+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:671 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338380 con 0x55e5bf2a1000 2023-11-17T06:33:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 152 ==== osd_op_reply(671 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-11-17T06:33:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 20 datascan.read_dentry: 72_head not found in result 2023-11-17T06:33:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000049 at 0x0x10000000000/72 with size=2 bytes 2023-11-17T06:33:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:672 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338700 con 0x55e5bf2a1000 2023-11-17T06:33:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 153 ==== osd_op_reply(672 10000000000.01800000 [omap-set-vals] v37'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x10000000049 2023-11-17T06:33:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.739+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:673 5.7 5:e2e07930::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337880 con 0x55e5bf2da800 2023-11-17T06:33:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 28 ==== osd_op_reply(673 [pgnls-filter start_epoch 37 out=81b] v37'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-11-17T06:33:11.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000001.0 2023-11-17T06:33:11.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:674 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337c00 con 0x55e5bf2da800 2023-11-17T06:33:11.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 29 ==== osd_op_reply(674 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-11-17T06:33:11.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/0 2023-11-17T06:33:11.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=0 2023-11-17T06:33:11.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:675 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ca80 con 0x55e5bf149000 2023-11-17T06:33:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 132 ==== osd_op_reply(675 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:676 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30d180 con 0x55e5bf149400 2023-11-17T06:33:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 256 ==== osd_op_reply(676 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.743+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:677 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30ce00 con 0x55e5bf2a1000 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 154 ==== osd_op_reply(677 10000000000.01800000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:678 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cae00 con 0x55e5bf2a1000 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 155 ==== osd_op_reply(678 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-11-17T06:33:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 20 datascan.read_dentry: 0_head not found in result 2023-11-17T06:33:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/0 with size=1 bytes 2023-11-17T06:33:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.747+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:679 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb880 con 0x55e5bf2a1000 2023-11-17T06:33:11.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 156 ==== osd_op_reply(679 10000000000.01800000 [omap-set-vals] v37'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-11-17T06:33:11.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:680 5.27 5:e4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2ca700 con 0x55e5bf2da000 2023-11-17T06:33:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.1 v2:172.21.15.100:6804/897523512 30 ==== osd_op_reply(680 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2da000 2023-11-17T06:33:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f3644700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:681 5.17 5:e8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34f880 con 0x55e5bf149000 2023-11-17T06:33:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 133 ==== osd_op_reply(681 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000d.00000000 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000d.0 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.751+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:682 5.17 5:e9ecae36:::1000000000d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cb180 con 0x55e5bf149000 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 134 ==== osd_op_reply(682 1000000000d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000d 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/12 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=12 2023-11-17T06:33:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:683 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2cbc00 con 0x55e5bf149000 2023-11-17T06:33:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 135 ==== osd_op_reply(683 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:684 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8700 con 0x55e5bf149400 2023-11-17T06:33:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 257 ==== osd_op_reply(684 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:685 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8000 con 0x55e5bf149400 2023-11-17T06:33:11.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 258 ==== osd_op_reply(685 10000000000.01000000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-11-17T06:33:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:686 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9180 con 0x55e5bf149400 2023-11-17T06:33:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 259 ==== osd_op_reply(686 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-11-17T06:33:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 20 datascan.read_dentry: 12_head not found in result 2023-11-17T06:33:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000d at 0x0x10000000000/12 with size=2 bytes 2023-11-17T06:33:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.755+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:687 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a9880 con 0x55e5bf149400 2023-11-17T06:33:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 260 ==== osd_op_reply(687 10000000000.01000000 [omap-set-vals] v37'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x1000000000d 2023-11-17T06:33:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:688 5.17 5:eb6757d1::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8380 con 0x55e5bf149000 2023-11-17T06:33:11.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 136 ==== osd_op_reply(688 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000023.00000000 2023-11-17T06:33:11.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000023.0 2023-11-17T06:33:11.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.759+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:689 5.17 5:eb6757d1:::10000000023.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf2a8a80 con 0x55e5bf149000 2023-11-17T06:33:11.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 137 ==== osd_op_reply(689 10000000023.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000023 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/34 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=34 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:690 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339180 con 0x55e5bf149000 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 138 ==== osd_op_reply(690 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:691 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339500 con 0x55e5bf149400 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 261 ==== osd_op_reply(691 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:692 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339c00 con 0x55e5bf149400 2023-11-17T06:33:11.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 262 ==== osd_op_reply(692 10000000000.01000000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-11-17T06:33:11.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:693 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf339880 con 0x55e5bf149400 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 263 ==== osd_op_reply(693 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 20 datascan.read_dentry: 34_head not found in result 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000023 at 0x0x10000000000/34 with size=2 bytes 2023-11-17T06:33:11.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.763+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:694 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338000 con 0x55e5bf149400 2023-11-17T06:33:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 264 ==== osd_op_reply(694 10000000000.01000000 [omap-set-vals] v37'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000023 2023-11-17T06:33:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:695 5.37 5:ec000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338a80 con 0x55e5bf2a1000 2023-11-17T06:33:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 157 ==== osd_op_reply(695 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000000e.00000000 2023-11-17T06:33:11.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000000e.0 2023-11-17T06:33:11.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.767+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:696 5.37 5:eefe613f:::1000000000e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf338380 con 0x55e5bf2a1000 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 158 ==== osd_op_reply(696 1000000000e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000e 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/13 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=13 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:697 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336380 con 0x55e5bf149000 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 139 ==== osd_op_reply(697 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:698 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336a80 con 0x55e5bf149400 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 265 ==== osd_op_reply(698 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:699 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336700 con 0x55e5bf2a1000 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 159 ==== osd_op_reply(699 10000000000.01800000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.771+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:700 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.775+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 160 ==== osd_op_reply(700 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.775+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.775+0000 7fe2f9691840 20 datascan.read_dentry: 13_head not found in result 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.775+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000e at 0x0x10000000000/13 with size=2 bytes 2023-11-17T06:33:11.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.775+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:701 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337500 con 0x55e5bf2a1000 2023-11-17T06:33:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 161 ==== osd_op_reply(701 10000000000.01800000 [omap-set-vals] v37'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x1000000000e 2023-11-17T06:33:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:702 5.f 5:f0000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf336000 con 0x55e5bf2da800 2023-11-17T06:33:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 30 ==== osd_op_reply(702 [pgnls-filter start_epoch 37 out=81b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000003a.00000000 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000003a.0 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:703 5.f 5:f1a9c549:::1000000003a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf337180 con 0x55e5bf2da800 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.5 v2:172.21.15.119:6810/2475678651 31 ==== osd_op_reply(703 1000000003a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2da800 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003a 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/57 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=57 2023-11-17T06:33:11.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.779+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:704 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323500 con 0x55e5bf149000 2023-11-17T06:33:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 140 ==== osd_op_reply(704 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:705 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322700 con 0x55e5bf149400 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 266 ==== osd_op_reply(705 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:706 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322e00 con 0x55e5bf2a1000 2023-11-17T06:33:11.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 162 ==== osd_op_reply(706 10000000000.01800000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:707 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf323c00 con 0x55e5bf2a1000 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 163 ==== osd_op_reply(707 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 20 datascan.read_dentry: 57_head not found in result 2023-11-17T06:33:11.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003a at 0x0x10000000000/57 with size=2 bytes 2023-11-17T06:33:11.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.783+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:708 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf322000 con 0x55e5bf2a1000 2023-11-17T06:33:11.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 164 ==== osd_op_reply(708 10000000000.01800000 [omap-set-vals] v37'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000003a 2023-11-17T06:33:11.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:709 5.2f 5:f4000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e000 con 0x55e5bf2a0800 2023-11-17T06:33:11.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 35 ==== osd_op_reply(709 [pgnls-filter start_epoch 37 out=101b] v37'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 10000000024.00000000 2023-11-17T06:33:11.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f9691840 10 datascan.operator(): handling object 10000000024.0 2023-11-17T06:33:11.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.787+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:710 5.2f 5:f6ddf183:::10000000024.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e380 con 0x55e5bf2a0800 2023-11-17T06:33:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 36 ==== osd_op_reply(710 10000000024.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x10000000024 2023-11-17T06:33:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/35 2023-11-17T06:33:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=35 2023-11-17T06:33:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:711 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf34e700 con 0x55e5bf149000 2023-11-17T06:33:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 141 ==== osd_op_reply(711 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:712 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35a000 con 0x55e5bf149400 2023-11-17T06:33:11.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 267 ==== osd_op_reply(712 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:713 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35a380 con 0x55e5bf2a1000 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 165 ==== osd_op_reply(713 10000000000.01800000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-11-17T06:33:11.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:11.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:714 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35a700 con 0x55e5bf2a1000 2023-11-17T06:33:11.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.791+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 166 ==== osd_op_reply(714 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-11-17T06:33:11.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 20 datascan.read_dentry: 35_head not found in result 2023-11-17T06:33:11.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000024 at 0x0x10000000000/35 with size=2 bytes 2023-11-17T06:33:11.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:715 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35aa80 con 0x55e5bf2a1000 2023-11-17T06:33:11.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.4 v2:172.21.15.119:6824/3894860840 167 ==== osd_op_reply(715 10000000000.01800000 [omap-set-vals] v37'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf2a1000 2023-11-17T06:33:11.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000024 2023-11-17T06:33:11.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.795+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:716 5.2f 5:f7911ae7::::head [pgnls-filter start_epoch 37 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35ae00 con 0x55e5bf2a0800 2023-11-17T06:33:11.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 37 ==== osd_op_reply(716 [pgnls-filter start_epoch 37 out=81b] v37'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.forall_objects: OSD matched oid 1000000004a.00000000 2023-11-17T06:33:11.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 10 datascan.operator(): handling object 1000000004a.0 2023-11-17T06:33:11.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- osd_op(unknown.0.0:717 5.2f 5:f7911ae7:::1000000004a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35b180 con 0x55e5bf2a0800 2023-11-17T06:33:11.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 <== osd.7 v2:172.21.15.119:6808/609004044 38 ==== osd_op_reply(717 1000000004a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e5bfc3f440 con 0x55e5bf2a0800 2023-11-17T06:33:11.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004a 2023-11-17T06:33:11.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/73 2023-11-17T06:33:11.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=73 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:718 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35b880 con 0x55e5bf149000 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f764c700 1 -- 172.21.15.100:0/3123290970 <== osd.3 v2:172.21.15.100:6800/2990712957 142 ==== osd_op_reply(718 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e5bfc3eb40 con 0x55e5bf149000 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:719 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35bc00 con 0x55e5bf149400 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 268 ==== osd_op_reply(719 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.799+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:720 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35e000 con 0x55e5bf149400 2023-11-17T06:33:11.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 269 ==== osd_op_reply(720 10000000000.01000000 [omap-get-header out=274b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 10 datascan.find_or_create_dirfrag: read_version = 55 2023-11-17T06:33:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:721 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35e380 con 0x55e5bf149400 2023-11-17T06:33:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 270 ==== osd_op_reply(721 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-11-17T06:33:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 20 datascan.read_dentry: 73_head not found in result 2023-11-17T06:33:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004a at 0x0x10000000000/73 with size=2 bytes 2023-11-17T06:33:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.803+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:722 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35e700 con 0x55e5bf149400 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 271 ==== osd_op_reply(722 10000000000.01000000 [omap-set-vals] v37'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000004a 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:723 5.1f 5:f8000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf35ea80 con 0x55e5bf149400 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 272 ==== osd_op_reply(723 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f2e43700 1 -- 172.21.15.100:0/3123290970 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:724 5.3f 5:fc000000::::head [pgnls-filter start_epoch 37 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e5bf30c380 con 0x55e5bf149400 2023-11-17T06:33:11.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f864e700 1 -- 172.21.15.100:0/3123290970 <== osd.6 v2:172.21.15.119:6800/1264916422 273 ==== osd_op_reply(724 [pgnls-filter start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e5bfc3ed80 con 0x55e5bf149400 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x55e5bf2dac00 msgr2=0x55e5bf2c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x55e5bf2dac00 0x55e5bf2c1600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x55e5bf2da000 msgr2=0x55e5bf2c1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x55e5bf2da000 0x55e5bf2c1080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x55e5bf2a1400 msgr2=0x55e5bf2c0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x55e5bf2a1400 0x55e5bf2c0580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x55e5bf149000 msgr2=0x55e5beecc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x55e5bf149000 0x55e5beecc100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x55e5bf2a1000 msgr2=0x55e5bf2c0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 reap_dead start 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x55e5bf2a1000 0x55e5bf2c0000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x55e5bf2da800 msgr2=0x55e5bf2c0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x55e5bf2da800 0x55e5bf2c0b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55e5bf149400 msgr2=0x55e5beecbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55e5bf149400 0x55e5beecbb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x55e5bf2a0800 msgr2=0x55e5beecb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x55e5bf2a0800 0x55e5beecb600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x55e5bf2a0000 msgr2=0x55e5beecd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x55e5bf2a0000 0x55e5beecd700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55e5bee6fe30 tx=0x55e5bef29740 comp rx=0 tx=0).stop 2023-11-17T06:33:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f7e4d700 1 -- 172.21.15.100:0/3123290970 reap_dead start 2023-11-17T06:33:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 msgr2=0x55e5beeccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55e5bf1574a0 tx=0x55e5bf162e40 comp rx=0 tx=0).stop 2023-11-17T06:33:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 shutdown_connections 2023-11-17T06:33:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 --2- 172.21.15.100:0/3123290970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bf148800 0x55e5beeccc00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 >> 172.21.15.100:0/3123290970 conn(0x55e5bee56c00 msgr2=0x55e5bef21800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 shutdown_connections 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.807+0000 7fe2f9691840 1 -- 172.21.15.100:0/3123290970 wait complete. 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 msgr2=0x55e5beecab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55e5bfbc33b0 tx=0x55e5bf13e120 comp rx=0 tx=0).stop 2023-11-17T06:33:11.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 shutdown_connections 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e5bee57000 0x55e5beecb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e5bee57400 0x55e5beecab00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 --2- 172.21.15.100:0/2046282489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55e5bee57800 0x55e5beeca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 >> 172.21.15.100:0/2046282489 conn(0x55e5bee57c00 msgr2=0x55e5bef21000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 shutdown_connections 2023-11-17T06:33:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.811+0000 7fe2f9691840 1 -- 172.21.15.100:0/2046282489 wait complete. 2023-11-17T06:33:11.826 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:01.047463, result: 2023-11-17T06:33:11.827 DEBUG:teuthology.orchestra.run.smithi100:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-11-17T06:33:11.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.931+0000 7f39e158b840 1 -- start start 2023-11-17T06:33:11.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.931+0000 7f39e158b840 1 Processor -- start 2023-11-17T06:33:11.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a84813400 0x562a84886b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a84813000 0x562a84887080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a84849180 con 0x562a84813800 2023-11-17T06:33:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a84848000 con 0x562a84813400 2023-11-17T06:33:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a84848140 con 0x562a84813000 2023-11-17T06:33:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37172/0 (socket says 172.21.15.100:37172) 2023-11-17T06:33:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 -- 172.21.15.100:0/3177313067 learned_addr learned my addr 172.21.15.100:0/3177313067 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39df546700 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a84813400 0x562a84886b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e0548700 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a84813000 0x562a84887080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 -- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a84813000 msgr2=0x562a84887080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a84813000 0x562a84887080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 -- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a84813400 msgr2=0x562a84886b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a84813400 0x562a84886b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 -- 172.21.15.100:0/3177313067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a84834b60 con 0x562a84813800 2023-11-17T06:33:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x562a848e1410 tx=0x562a85694120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee03e3fccae787a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dd542700 1 -- 172.21.15.100:0/3177313067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a84847600 con 0x562a84813800 2023-11-17T06:33:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dd542700 1 -- 172.21.15.100:0/3177313067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a8485e480 con 0x562a84813800 2023-11-17T06:33:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dd542700 1 -- 172.21.15.100:0/3177313067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a848471e0 con 0x562a84813800 2023-11-17T06:33:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a84834340 con 0x562a84813800 2023-11-17T06:33:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562a84834000 con 0x562a84813800 2023-11-17T06:33:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 4 waiting for MDS map... 2023-11-17T06:33:11.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dd542700 1 -- 172.21.15.100:0/3177313067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x562a8484cc40 con 0x562a84813800 2023-11-17T06:33:11.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39dd542700 1 -- 172.21.15.100:0/3177313067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) v1 ==== 3298+0+0 (secure 0 0 0) 0x562a85690000 con 0x562a84813800 2023-11-17T06:33:11.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 4 Got MDS map 25 2023-11-17T06:33:11.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:11.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.935+0000 7f39e158b840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:11.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 Processor -- start 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 -- start start 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 0x562a84887b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a84848a00 con 0x562a8569a400 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8486d180 con 0x562a8569ac00 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a8486cdc0 con 0x562a8569a800 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37182/0 (socket says 172.21.15.100:37182) 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 -- 172.21.15.100:0/2515545737 learned_addr learned my addr 172.21.15.100:0/2515545737 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39df546700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39dfd47700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 0x562a84887b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 -- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 msgr2=0x562a84887b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 0x562a84887b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 -- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 msgr2=0x562a84888100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 -- 172.21.15.100:0/2515545737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a84834ea0 con 0x562a8569a400 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39df546700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39dfd47700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 0x562a84887b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39e0548700 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x562a84b068a0 tx=0x562a84b0ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f47d31a2bcaab6f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.939+0000 7f39db53e700 1 -- 172.21.15.100:0/2515545737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a84847600 con 0x562a8569a400 2023-11-17T06:33:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39db53e700 1 -- 172.21.15.100:0/2515545737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a8485e480 con 0x562a8569a400 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39db53e700 1 -- 172.21.15.100:0/2515545737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a848471e0 con 0x562a8569a400 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- 172.21.15.100:0/2515545737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 msgr2=0x562a84887600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x562a84b068a0 tx=0x562a84b0ec00 comp rx=0 tx=0).stop 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- 172.21.15.100:0/2515545737 shutdown_connections 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a800 0x562a84887b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- 172.21.15.100:0/2515545737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a400 0x562a84887600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- 172.21.15.100:0/2515545737 >> 172.21.15.100:0/2515545737 conn(0x562a84812c00 msgr2=0x562a848ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- 172.21.15.100:0/2515545737 shutdown_connections 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- 172.21.15.100:0/2515545737 wait complete. 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 Processor -- start 2023-11-17T06:33:11.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- start start 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a400 0x562a84889180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a8486cc80 con 0x562a8569a800 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a84848000 con 0x562a8569ac00 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39e158b840 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a84848b40 con 0x562a8569a400 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.943+0000 7f39dfd47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37186/0 (socket says 172.21.15.100:37186) 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 learned_addr learned my addr 172.21.15.100:0/3320383600 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a400 0x562a84889180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a400 msgr2=0x562a84889180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a8569a400 0x562a84889180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 msgr2=0x562a84888680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a8569ac00 0x562a84888680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a84834b60 con 0x562a8569a800 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x562a84b07560 tx=0x562a848e4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39d9d3b700 1 -- 172.21.15.100:0/3320383600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a84846f20 con 0x562a8569a800 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39d9d3b700 1 -- 172.21.15.100:0/3320383600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a855fc780 con 0x562a8569a800 2023-11-17T06:33:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a84834340 con 0x562a8569a800 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39d9d3b700 1 -- 172.21.15.100:0/3320383600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a84847600 con 0x562a8569a800 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a84835520 con 0x562a8569a800 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.947+0000 7f39e158b840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39d9d3b700 1 -- 172.21.15.100:0/3320383600 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x562a84860840 con 0x562a8569a800 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39d9d3b700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x562a84c5e000 0x562a84889700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39d9d3b700 1 -- 172.21.15.100:0/3320383600 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x562a8484ca80 con 0x562a8569a800 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e158b840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e158b840 4 datascan.main: resolving metadata pool 4 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x562a8569b000 0x562a84888100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:1 4.0 4:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x562a84c5e000 0x562a84889700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x562a8569b000 0x562a84888100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x562a84c5e000 0x562a84889700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x562a84b068a0 tx=0x562a85694060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.951+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x562a8569b000 0x562a84888100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 1 ==== osd_op_reply(1 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:2 4.10 4:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 2 ==== osd_op_reply(2 [pgnls start_epoch 37 out=177b] v36'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x562a84c5e400 0x562a84c66000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:3 4.8 4:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e400 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x562a84c5e400 0x562a84c66000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x562a84c5e400 0x562a84c66000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 1 ==== osd_op_reply(3 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x562a84c5e800 0x562a84c66580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.955+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:4 4.18 4:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x562a84c5e800 0x562a84c66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x562a84c5e800 0x562a84c66580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 1 ==== osd_op_reply(4 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x562a84c5ec00 0x562a84c66b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:5 4.4 4:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5ec00 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x562a84c5ec00 0x562a84c66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.959+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x562a84c5ec00 0x562a84c66b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 1 ==== osd_op_reply(5 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:6 4.14 4:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 3 ==== osd_op_reply(6 [pgnls start_epoch 37 out=149b] v36'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:7 4.c 4:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x562a84c5f000 0x562a84c67080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:8 4.1c 4:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f000 2023-11-17T06:33:11.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x562a84c5f000 0x562a84c67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.963+0000 7f39e0548700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x562a84c5f000 0x562a84c67080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.2 v2:172.21.15.100:6824/177771602 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5f000 2023-11-17T06:33:11.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:9 4.2 4:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5ec00 2023-11-17T06:33:11.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:10 4.12 4:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5ec00 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 3 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x562a84c5f800 0x562a84c67b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:11 4.a 4:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f800 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x562a84c5f800 0x562a84c67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.967+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x562a84c5f800 0x562a84c67b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:11.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:12 4.1a 4:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v36'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39dfd47700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x562a84c5f400 0x562a84c67600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:13 4.6 4:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x562a84c5f400 0x562a84c67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39df546700 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x562a84c5f400 0x562a84c67600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 1 ==== osd_op_reply(13 [pgnls start_epoch 37 out=77b] v36'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.971+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:14 4.16 4:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:15 4.e 4:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 4 ==== osd_op_reply(15 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:16 4.1e 4:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v36'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:11.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:17 4.1 4:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 5 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.975+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:18 4.11 4:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:19 4.9 4:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 6 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:20 4.19 4:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:21 4.5 4:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f800 2023-11-17T06:33:11.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 2 ==== osd_op_reply(21 [pgnls start_epoch 37 out=81b] v37'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:11.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.979+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:22 4.15 4:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e400 2023-11-17T06:33:11.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 2 ==== osd_op_reply(22 [pgnls start_epoch 37 out=97b] v34'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:11.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:23 4.d 4:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=74b] v34'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:24 4.1d 4:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 6 ==== osd_op_reply(24 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:25 4.3 4:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f400 2023-11-17T06:33:11.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 4 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:11.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.983+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:26 4.13 4:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 8 ==== osd_op_reply(26 [pgnls start_epoch 37 out=98b] v35'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:27 4.b 4:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f400 2023-11-17T06:33:11.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 5 ==== osd_op_reply(27 [pgnls start_epoch 37 out=76b] v36'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:11.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:28 4.1b 4:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e800 2023-11-17T06:33:11.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 9 ==== osd_op_reply(28 [pgnls start_epoch 37 out=81b] v37'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:11.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:29 4.7 4:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5ec00 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 4 ==== osd_op_reply(29 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.987+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:30 4.17 4:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:31 4.f 4:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5ec00 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 5 ==== osd_op_reply(31 [pgnls start_epoch 37 out=73b] v34'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:32 4.1f 4:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5f800 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 3 ==== osd_op_reply(32 [pgnls start_epoch 37 out=101b] v36'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:11.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 601.00000000 2023-11-17T06:33:11.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:33 4.10 4:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859c00 con 0x562a8569b000 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 602.00000000 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:34 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a000 con 0x562a8569b000 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-11-17T06:33:11.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.991+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:35 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a8569b000 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 600.00000000 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:36 4.10 4:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a700 con 0x562a8569b000 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 603.00000000 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:37 4.10 4:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8aa80 con 0x562a8569b000 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 606.00000000 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.995+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:38 4.14 4:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859c00 con 0x562a8569b000 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 13 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 607.00000000 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:39 4.1c 4:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a000 con 0x562a84c5f000 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.2 v2:172.21.15.100:6824/177771602 2 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5f000 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 608.00000000 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:40 4.e 4:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 10 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 10000000000.01000000 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:11.999+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:41 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a700 con 0x562a84c5f800 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 4 ==== osd_op_reply(41 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 604.00000000 2023-11-17T06:33:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:42 4.15 4:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8aa80 con 0x562a84c5e400 2023-11-17T06:33:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 3 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-11-17T06:33:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-17T06:33:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-11-17T06:33:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-17T06:33:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 605.00000000 2023-11-17T06:33:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:43 4.1d 4:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a8569b000 2023-11-17T06:33:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 14 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-11-17T06:33:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-17T06:33:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-11-17T06:33:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:44 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.003+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 11 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-11-17T06:33:12.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-17T06:33:12.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 10000000000.01800000 2023-11-17T06:33:12.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:45 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a000 con 0x562a84c5e800 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 12 ==== osd_op_reply(45 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 609.00000000 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:46 4.7 4:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8aa80 con 0x562a84c5ec00 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 6 ==== osd_op_reply(46 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-11-17T06:33:12.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-17T06:33:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-11-17T06:33:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-17T06:33:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-11-17T06:33:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.007+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:47 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:48 4.0 4:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a700 con 0x562a8569b000 2023-11-17T06:33:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 15 ==== osd_op_reply(48 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:49 4.10 4:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a8569b000 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 16 ==== osd_op_reply(49 [pgnls start_epoch 37 out=177b] v36'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:50 4.8 4:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e400 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 4 ==== osd_op_reply(50 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.011+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:51 4.18 4:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 13 ==== osd_op_reply(51 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:52 4.4 4:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5ec00 2023-11-17T06:33:12.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 7 ==== osd_op_reply(52 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:53 4.14 4:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a8569b000 2023-11-17T06:33:12.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 17 ==== osd_op_reply(53 [pgnls start_epoch 37 out=149b] v36'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:54 4.c 4:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 14 ==== osd_op_reply(54 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:55 4.1c 4:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f000 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.2 v2:172.21.15.100:6824/177771602 3 ==== osd_op_reply(55 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5f000 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.015+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:56 4.2 4:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5ec00 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 8 ==== osd_op_reply(56 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:57 4.12 4:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5ec00 2023-11-17T06:33:12.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 9 ==== osd_op_reply(57 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:58 4.a 4:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 6 ==== osd_op_reply(58 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:59 4.1a 4:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 15 ==== osd_op_reply(59 [pgnls start_epoch 37 out=49b] v36'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.019+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:60 4.6 4:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f400 2023-11-17T06:33:12.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 6 ==== osd_op_reply(60 [pgnls start_epoch 37 out=77b] v36'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:12.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:61 4.16 4:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f400 2023-11-17T06:33:12.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 7 ==== osd_op_reply(61 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:12.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:62 4.e 4:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 16 ==== osd_op_reply(62 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:63 4.1e 4:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f400 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 8 ==== osd_op_reply(63 [pgnls start_epoch 37 out=49b] v36'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.023+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:64 4.1 4:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 17 ==== osd_op_reply(64 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:65 4.11 4:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a8569b000 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 18 ==== osd_op_reply(65 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:66 4.9 4:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 18 ==== osd_op_reply(66 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:67 4.19 4:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a8569b000 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 19 ==== osd_op_reply(67 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.027+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:68 4.5 4:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 7 ==== osd_op_reply(68 [pgnls start_epoch 37 out=81b] v37'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:69 4.15 4:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 5 ==== osd_op_reply(69 [pgnls start_epoch 37 out=97b] v34'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:70 4.d 4:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 19 ==== osd_op_reply(70 [pgnls start_epoch 37 out=74b] v34'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:71 4.1d 4:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a8569b000 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 20 ==== osd_op_reply(71 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:72 4.3 4:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 9 ==== osd_op_reply(72 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.031+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:73 4.13 4:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 20 ==== osd_op_reply(73 [pgnls start_epoch 37 out=98b] v35'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- osd_op(unknown.0.0:74 4.b 4:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.0 v2:172.21.15.100:6801/1609678627 10 ==== osd_op_reply(74 [pgnls start_epoch 37 out=76b] v36'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5f400 2023-11-17T06:33:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:75 4.1b 4:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 21 ==== osd_op_reply(75 [pgnls start_epoch 37 out=81b] v37'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:76 4.7 4:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5ec00 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 10 ==== osd_op_reply(76 [pgnls start_epoch 37 out=73b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.035+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:77 4.17 4:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a8569b000 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 21 ==== osd_op_reply(77 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:78 4.f 4:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5ec00 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 11 ==== osd_op_reply(78 [pgnls start_epoch 37 out=73b] v34'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:79 4.1f 4:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 8 ==== osd_op_reply(79 [pgnls start_epoch 37 out=101b] v36'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 601.00000000 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:80 4.10 4:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b500 con 0x562a8569b000 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 22 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 602.00000000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:81 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b880 con 0x562a8569b000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 23 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.039+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:82 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a8569b000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 24 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 600.00000000 2023-11-17T06:33:12.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:83 4.10 4:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a700 con 0x562a8569b000 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 25 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 603.00000000 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.043+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:84 4.10 4:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8aa80 con 0x562a8569b000 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 26 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-17T06:33:12.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 606.00000000 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:85 4.14 4:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b500 con 0x562a8569b000 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 27 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 607.00000000 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- osd_op(unknown.0.0:86 4.1c 4:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b880 con 0x562a84c5f000 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.2 v2:172.21.15.100:6824/177771602 4 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5f000 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 608.00000000 2023-11-17T06:33:12.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:87 4.e 4:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 22 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 10000000000.01000000 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.047+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:88 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859c00 con 0x562a84c5f800 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 9 ==== osd_op_reply(88 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000b for future processing to fix dnfirst 2023-11-17T06:33:12.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000c for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000d for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000010 for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000014 for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000002 for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000015 for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000016 for future processing to fix dnfirst 2023-11-17T06:33:12.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001c for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001d for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000020 for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000023 for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000025 for future processing to fix dnfirst 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000027 for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000028 for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000004 for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002b for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002c for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002f for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000005 for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000033 for future processing to fix dnfirst 2023-11-17T06:33:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000035 for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000036 for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000038 for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003c for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003e for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000040 for future processing to fix dnfirst 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000041 for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000042 for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000043 for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000046 for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000047 for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004a for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004b for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004c for future processing to fix dnfirst 2023-11-17T06:33:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004e for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000051 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000054 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000055 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000056 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000057 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000058 for future processing to fix dnfirst 2023-11-17T06:33:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000059 for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000009 for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005b for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005d for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000060 for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000061 for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000062 for future processing to fix dnfirst 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000a for future processing to fix dnfirst 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 604.00000000 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- osd_op(unknown.0.0:89 4.15 4:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859880 con 0x562a84c5e400 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e0548700 1 -- 172.21.15.100:0/3320383600 <== osd.5 v2:172.21.15.119:6810/2475678651 6 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6d80 con 0x562a84c5e400 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 605.00000000 2023-11-17T06:33:12.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- osd_op(unknown.0.0:90 4.1d 4:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84859c00 con 0x562a8569b000 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.3 v2:172.21.15.100:6800/2990712957 28 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a8569b000 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.051+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:91 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 23 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 10000000000.01800000 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:92 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 24 ==== osd_op_reply(92 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000e for future processing to fix dnfirst 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000000f for future processing to fix dnfirst 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000011 for future processing to fix dnfirst 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000012 for future processing to fix dnfirst 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000013 for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000017 for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000018 for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000019 for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001a for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001b for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001e for future processing to fix dnfirst 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000001f for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000021 for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000022 for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000024 for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000026 for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000029 for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002a for future processing to fix dnfirst 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002d for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000002e for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000030 for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000031 for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000032 for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000034 for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000037 for future processing to fix dnfirst 2023-11-17T06:33:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000039 for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003a for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003b for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000006 for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003d for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000003f for future processing to fix dnfirst 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000044 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000045 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000007 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000048 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000049 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004d for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000004f for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000050 for future processing to fix dnfirst 2023-11-17T06:33:12.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000008 for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000052 for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000053 for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005a for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005c for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005e for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x1000000005f for future processing to fix dnfirst 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000063 for future processing to fix dnfirst 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 20 datascan.scan_links: adding 0x10000000064 for future processing to fix dnfirst 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 609.00000000 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.055+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- osd_op(unknown.0.0:93 4.7 4:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a000 con 0x562a84c5ec00 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 <== osd.1 v2:172.21.15.100:6804/897523512 12 ==== osd_op_reply(93 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x562a855f6b40 con 0x562a84c5ec00 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:94 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: processing 99 dup_primaries, 0 remote_links 2023-11-17T06:33:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000001 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000002 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000003 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000004 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000005 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000006 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000007 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000008 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000009 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000a 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000b 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000c 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000d 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000e 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000000f 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000010 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000011 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000012 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000013 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000014 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000015 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000017 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000018 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000019 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001a 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001b 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001c 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001d 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001e 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000001f 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000020 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000021 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000022 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000023 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000024 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000025 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000026 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000027 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000028 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000029 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002a 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002b 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002c 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002d 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002e 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000002f 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000030 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000031 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000032 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000033 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000034 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000035 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000036 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000037 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000038 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000039 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003a 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003b 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003c 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003d 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003e 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000003f 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000040 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000041 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000042 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000043 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000044 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000045 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000046 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000047 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000048 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000049 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004a 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004b 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004c 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004d 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004e 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000004f 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000050 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000051 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000052 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000053 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000054 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000055 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000056 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000057 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000058 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000059 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005a 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005b 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005c 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005d 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005e 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x1000000005f 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000060 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000061 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000062 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000063 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling dup 0x10000000064 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: processing 100 injected_inos 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:0 2023-11-17T06:33:12.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:95 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 25 ==== osd_op_reply(95 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.059+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:96 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 26 ==== osd_op_reply(96 10000000000.01800000 [omap-set-vals] v37'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000002 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:1 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:97 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5f800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 11 ==== osd_op_reply(97 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.063+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:98 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5f800 2023-11-17T06:33:12.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 12 ==== osd_op_reply(98 10000000000.01000000 [omap-set-vals] v37'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x10000000002 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000003 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:2 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:99 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 13 ==== osd_op_reply(99 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.067+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:100 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 14 ==== osd_op_reply(100 10000000000.01000000 [omap-set-vals] v37'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x10000000003 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000004 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:3 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:101 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5f800 2023-11-17T06:33:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 15 ==== osd_op_reply(101 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-11-17T06:33:12.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.071+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:102 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 16 ==== osd_op_reply(102 10000000000.01000000 [omap-set-vals] v37'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x10000000004 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000005 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:4 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:103 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27880 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 17 ==== osd_op_reply(103 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.075+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:104 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27c00 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 18 ==== osd_op_reply(104 10000000000.01000000 [omap-set-vals] v37'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x10000000005 2023-11-17T06:33:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000006 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:5 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:105 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 27 ==== osd_op_reply(105 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.079+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:106 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 28 ==== osd_op_reply(106 10000000000.01800000 [omap-set-vals] v37'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x10000000006 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000007 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:6 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:107 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 29 ==== osd_op_reply(107 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.083+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:108 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 30 ==== osd_op_reply(108 10000000000.01800000 [omap-set-vals] v37'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x10000000007 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000008 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:7 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:109 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 31 ==== osd_op_reply(109 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.087+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:110 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 32 ==== osd_op_reply(110 10000000000.01800000 [omap-set-vals] v37'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x10000000008 2023-11-17T06:33:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000009 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:8 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:111 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5f800 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 19 ==== osd_op_reply(111 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.091+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:112 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5f800 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 20 ==== osd_op_reply(112 10000000000.01000000 [omap-set-vals] v37'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x10000000009 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000a 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:9 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:113 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5f800 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 21 ==== osd_op_reply(113 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.095+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:114 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5f800 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.099+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 22 ==== osd_op_reply(114 10000000000.01000000 [omap-set-vals] v37'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.099+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x1000000000a 2023-11-17T06:33:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.099+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000b 2023-11-17T06:33:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.099+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:10 2023-11-17T06:33:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.099+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:115 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5f800 2023-11-17T06:33:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 23 ==== osd_op_reply(115 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-11-17T06:33:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:116 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27880 con 0x562a84c5f800 2023-11-17T06:33:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 24 ==== osd_op_reply(116 10000000000.01000000 [omap-set-vals] v37'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x1000000000b 2023-11-17T06:33:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000c 2023-11-17T06:33:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:11 2023-11-17T06:33:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.103+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:117 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27c00 con 0x562a84c5f800 2023-11-17T06:33:12.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 25 ==== osd_op_reply(117 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-11-17T06:33:12.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:118 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5f800 2023-11-17T06:33:12.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 26 ==== osd_op_reply(118 10000000000.01000000 [omap-set-vals] v37'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x1000000000c 2023-11-17T06:33:12.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000d 2023-11-17T06:33:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:12 2023-11-17T06:33:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.107+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:119 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5f800 2023-11-17T06:33:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 27 ==== osd_op_reply(119 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-11-17T06:33:12.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:120 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5f800 2023-11-17T06:33:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 28 ==== osd_op_reply(120 10000000000.01000000 [omap-set-vals] v37'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x1000000000d 2023-11-17T06:33:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000e 2023-11-17T06:33:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:13 2023-11-17T06:33:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.111+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:121 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5e800 2023-11-17T06:33:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.115+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 33 ==== osd_op_reply(121 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.115+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-11-17T06:33:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.115+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.115+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:122 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5e800 2023-11-17T06:33:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 34 ==== osd_op_reply(122 10000000000.01800000 [omap-set-vals] v37'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x1000000000e 2023-11-17T06:33:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000000f 2023-11-17T06:33:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:14 2023-11-17T06:33:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:123 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5e800 2023-11-17T06:33:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 35 ==== osd_op_reply(123 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-11-17T06:33:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.119+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:124 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5e800 2023-11-17T06:33:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 36 ==== osd_op_reply(124 10000000000.01800000 [omap-set-vals] v37'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x1000000000f 2023-11-17T06:33:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000010 2023-11-17T06:33:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:15 2023-11-17T06:33:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:125 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 29 ==== osd_op_reply(125 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-11-17T06:33:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:126 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 30 ==== osd_op_reply(126 10000000000.01000000 [omap-set-vals] v37'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000010 2023-11-17T06:33:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000011 2023-11-17T06:33:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:16 2023-11-17T06:33:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.123+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:127 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.127+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 37 ==== osd_op_reply(127 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.127+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-11-17T06:33:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.127+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.127+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:128 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 38 ==== osd_op_reply(128 10000000000.01800000 [omap-set-vals] v37'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000011 2023-11-17T06:33:12.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000012 2023-11-17T06:33:12.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:17 2023-11-17T06:33:12.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:129 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 39 ==== osd_op_reply(129 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-11-17T06:33:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.131+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:130 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 40 ==== osd_op_reply(130 10000000000.01800000 [omap-set-vals] v37'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000012 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000013 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:18 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:131 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5e800 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 41 ==== osd_op_reply(131 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-11-17T06:33:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:132 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5e800 2023-11-17T06:33:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 42 ==== osd_op_reply(132 10000000000.01800000 [omap-set-vals] v37'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.135+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000013 2023-11-17T06:33:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000014 2023-11-17T06:33:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:19 2023-11-17T06:33:12.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:133 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5f800 2023-11-17T06:33:12.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 31 ==== osd_op_reply(133 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-11-17T06:33:12.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:134 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5f800 2023-11-17T06:33:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 32 ==== osd_op_reply(134 10000000000.01000000 [omap-set-vals] v37'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000014 2023-11-17T06:33:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000015 2023-11-17T06:33:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:20 2023-11-17T06:33:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.139+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:135 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5f800 2023-11-17T06:33:12.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 33 ==== osd_op_reply(135 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-11-17T06:33:12.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:136 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5f800 2023-11-17T06:33:12.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 34 ==== osd_op_reply(136 10000000000.01000000 [omap-set-vals] v37'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000015 2023-11-17T06:33:12.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000016 2023-11-17T06:33:12.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:21 2023-11-17T06:33:12.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.143+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:137 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27880 con 0x562a84c5f800 2023-11-17T06:33:12.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 35 ==== osd_op_reply(137 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-11-17T06:33:12.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:138 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27c00 con 0x562a84c5f800 2023-11-17T06:33:12.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 36 ==== osd_op_reply(138 10000000000.01000000 [omap-set-vals] v37'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x10000000016 2023-11-17T06:33:12.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000017 2023-11-17T06:33:12.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:22 2023-11-17T06:33:12.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.147+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:139 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 43 ==== osd_op_reply(139 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-11-17T06:33:12.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:140 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5e800 2023-11-17T06:33:12.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 44 ==== osd_op_reply(140 10000000000.01800000 [omap-set-vals] v37'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x10000000017 2023-11-17T06:33:12.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000018 2023-11-17T06:33:12.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:23 2023-11-17T06:33:12.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.151+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:141 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5e800 2023-11-17T06:33:12.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 45 ==== osd_op_reply(141 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-11-17T06:33:12.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:142 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5e800 2023-11-17T06:33:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 46 ==== osd_op_reply(142 10000000000.01800000 [omap-set-vals] v37'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x10000000018 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000019 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:24 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.155+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:143 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5e800 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.159+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 47 ==== osd_op_reply(143 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.159+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-11-17T06:33:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.159+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.159+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:144 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5e800 2023-11-17T06:33:12.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 48 ==== osd_op_reply(144 10000000000.01800000 [omap-set-vals] v37'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x10000000019 2023-11-17T06:33:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001a 2023-11-17T06:33:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:25 2023-11-17T06:33:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:145 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5e800 2023-11-17T06:33:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 49 ==== osd_op_reply(145 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-11-17T06:33:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.163+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:146 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 50 ==== osd_op_reply(146 10000000000.01800000 [omap-set-vals] v37'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000001a 2023-11-17T06:33:12.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001b 2023-11-17T06:33:12.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:26 2023-11-17T06:33:12.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:147 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 51 ==== osd_op_reply(147 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-11-17T06:33:12.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.167+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:148 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 52 ==== osd_op_reply(148 10000000000.01800000 [omap-set-vals] v37'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000001b 2023-11-17T06:33:12.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001c 2023-11-17T06:33:12.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:27 2023-11-17T06:33:12.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:149 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 37 ==== osd_op_reply(149 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-11-17T06:33:12.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:150 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 38 ==== osd_op_reply(150 10000000000.01000000 [omap-set-vals] v37'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x1000000001c 2023-11-17T06:33:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001d 2023-11-17T06:33:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:28 2023-11-17T06:33:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.171+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:151 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 39 ==== osd_op_reply(151 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-11-17T06:33:12.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:152 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5f800 2023-11-17T06:33:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 40 ==== osd_op_reply(152 10000000000.01000000 [omap-set-vals] v37'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x1000000001d 2023-11-17T06:33:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001e 2023-11-17T06:33:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:29 2023-11-17T06:33:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.175+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:153 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.179+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 53 ==== osd_op_reply(153 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.179+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-11-17T06:33:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.179+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.179+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:154 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5e800 2023-11-17T06:33:12.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 54 ==== osd_op_reply(154 10000000000.01800000 [omap-set-vals] v37'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x1000000001e 2023-11-17T06:33:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000001f 2023-11-17T06:33:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:30 2023-11-17T06:33:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:155 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5e800 2023-11-17T06:33:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 55 ==== osd_op_reply(155 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-11-17T06:33:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.183+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:156 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5e800 2023-11-17T06:33:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 56 ==== osd_op_reply(156 10000000000.01800000 [omap-set-vals] v37'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x1000000001f 2023-11-17T06:33:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000020 2023-11-17T06:33:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:31 2023-11-17T06:33:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:157 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5f800 2023-11-17T06:33:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 41 ==== osd_op_reply(157 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-11-17T06:33:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.187+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:158 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5f800 2023-11-17T06:33:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 42 ==== osd_op_reply(158 10000000000.01000000 [omap-set-vals] v37'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000020 2023-11-17T06:33:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000021 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:32 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:159 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5e800 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 57 ==== osd_op_reply(159 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.191+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:160 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27880 con 0x562a84c5e800 2023-11-17T06:33:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 58 ==== osd_op_reply(160 10000000000.01800000 [omap-set-vals] v37'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000021 2023-11-17T06:33:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000022 2023-11-17T06:33:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:33 2023-11-17T06:33:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:161 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27c00 con 0x562a84c5e800 2023-11-17T06:33:12.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 59 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-11-17T06:33:12.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.195+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:162 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 60 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v37'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000022 2023-11-17T06:33:12.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000023 2023-11-17T06:33:12.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:34 2023-11-17T06:33:12.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:163 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 43 ==== osd_op_reply(163 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-11-17T06:33:12.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.199+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:164 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.203+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 44 ==== osd_op_reply(164 10000000000.01000000 [omap-set-vals] v37'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.203+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000023 2023-11-17T06:33:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.203+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000024 2023-11-17T06:33:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.203+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:35 2023-11-17T06:33:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.203+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:165 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 61 ==== osd_op_reply(165 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-11-17T06:33:12.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:166 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26000 con 0x562a84c5e800 2023-11-17T06:33:12.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 62 ==== osd_op_reply(166 10000000000.01800000 [omap-set-vals] v37'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000024 2023-11-17T06:33:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000025 2023-11-17T06:33:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:36 2023-11-17T06:33:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.207+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:167 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26380 con 0x562a84c5f800 2023-11-17T06:33:12.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 45 ==== osd_op_reply(167 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-11-17T06:33:12.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:168 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26700 con 0x562a84c5f800 2023-11-17T06:33:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 46 ==== osd_op_reply(168 10000000000.01000000 [omap-set-vals] v37'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000025 2023-11-17T06:33:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000026 2023-11-17T06:33:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:37 2023-11-17T06:33:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.211+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:169 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26a80 con 0x562a84c5e800 2023-11-17T06:33:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.215+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 63 ==== osd_op_reply(169 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.215+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-11-17T06:33:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.215+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.215+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:170 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d26e00 con 0x562a84c5e800 2023-11-17T06:33:12.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 64 ==== osd_op_reply(170 10000000000.01800000 [omap-set-vals] v37'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x10000000026 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000027 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:38 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:171 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27180 con 0x562a84c5f800 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 47 ==== osd_op_reply(171 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-11-17T06:33:12.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.219+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:172 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27500 con 0x562a84c5f800 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 48 ==== osd_op_reply(172 10000000000.01000000 [omap-set-vals] v37'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x10000000027 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000028 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:39 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:173 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27880 con 0x562a84c5f800 2023-11-17T06:33:12.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 49 ==== osd_op_reply(173 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-11-17T06:33:12.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.223+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:174 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d27c00 con 0x562a84c5f800 2023-11-17T06:33:12.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 50 ==== osd_op_reply(174 10000000000.01000000 [omap-set-vals] v37'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x10000000028 2023-11-17T06:33:12.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000029 2023-11-17T06:33:12.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:40 2023-11-17T06:33:12.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:175 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5e800 2023-11-17T06:33:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 65 ==== osd_op_reply(175 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-11-17T06:33:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.227+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:176 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c380 con 0x562a84c5e800 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 66 ==== osd_op_reply(176 10000000000.01800000 [omap-set-vals] v37'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x10000000029 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002a 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:41 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:177 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c700 con 0x562a84c5e800 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 67 ==== osd_op_reply(177 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.235+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:178 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ca80 con 0x562a84c5e800 2023-11-17T06:33:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 68 ==== osd_op_reply(178 10000000000.01800000 [omap-set-vals] v37'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000002a 2023-11-17T06:33:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002b 2023-11-17T06:33:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:42 2023-11-17T06:33:12.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:179 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ce00 con 0x562a84c5f800 2023-11-17T06:33:12.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 51 ==== osd_op_reply(179 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-11-17T06:33:12.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.239+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:180 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d180 con 0x562a84c5f800 2023-11-17T06:33:12.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 52 ==== osd_op_reply(180 10000000000.01000000 [omap-set-vals] v37'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000002b 2023-11-17T06:33:12.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002c 2023-11-17T06:33:12.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:43 2023-11-17T06:33:12.246 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:181 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d500 con 0x562a84c5f800 2023-11-17T06:33:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 53 ==== osd_op_reply(181 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-11-17T06:33:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.243+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:182 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d880 con 0x562a84c5f800 2023-11-17T06:33:12.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 54 ==== osd_op_reply(182 10000000000.01000000 [omap-set-vals] v37'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x1000000002c 2023-11-17T06:33:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002d 2023-11-17T06:33:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:44 2023-11-17T06:33:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:183 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4dc00 con 0x562a84c5e800 2023-11-17T06:33:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 69 ==== osd_op_reply(183 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-11-17T06:33:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:184 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5e800 2023-11-17T06:33:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 70 ==== osd_op_reply(184 10000000000.01800000 [omap-set-vals] v37'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x1000000002d 2023-11-17T06:33:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002e 2023-11-17T06:33:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:45 2023-11-17T06:33:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.247+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:185 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.251+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 71 ==== osd_op_reply(185 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.251+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-11-17T06:33:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.251+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.251+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:186 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 72 ==== osd_op_reply(186 10000000000.01800000 [omap-set-vals] v37'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x1000000002e 2023-11-17T06:33:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000002f 2023-11-17T06:33:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:46 2023-11-17T06:33:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:187 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 55 ==== osd_op_reply(187 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-11-17T06:33:12.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.255+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:188 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5f800 2023-11-17T06:33:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 56 ==== osd_op_reply(188 10000000000.01000000 [omap-set-vals] v37'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x1000000002f 2023-11-17T06:33:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000030 2023-11-17T06:33:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:47 2023-11-17T06:33:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:189 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54000 con 0x562a84c5e800 2023-11-17T06:33:12.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 73 ==== osd_op_reply(189 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-11-17T06:33:12.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.259+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:190 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54380 con 0x562a84c5e800 2023-11-17T06:33:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.263+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 74 ==== osd_op_reply(190 10000000000.01800000 [omap-set-vals] v37'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.263+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000030 2023-11-17T06:33:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.263+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000031 2023-11-17T06:33:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.263+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:48 2023-11-17T06:33:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.263+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:191 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54700 con 0x562a84c5e800 2023-11-17T06:33:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 75 ==== osd_op_reply(191 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-11-17T06:33:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:192 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54a80 con 0x562a84c5e800 2023-11-17T06:33:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 76 ==== osd_op_reply(192 10000000000.01800000 [omap-set-vals] v37'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000031 2023-11-17T06:33:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000032 2023-11-17T06:33:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:49 2023-11-17T06:33:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.267+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:193 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54e00 con 0x562a84c5e800 2023-11-17T06:33:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 77 ==== osd_op_reply(193 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-11-17T06:33:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:194 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d55180 con 0x562a84c5e800 2023-11-17T06:33:12.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 78 ==== osd_op_reply(194 10000000000.01800000 [omap-set-vals] v37'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000032 2023-11-17T06:33:12.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000033 2023-11-17T06:33:12.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:50 2023-11-17T06:33:12.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.271+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:195 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d55500 con 0x562a84c5f800 2023-11-17T06:33:12.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 57 ==== osd_op_reply(195 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-11-17T06:33:12.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:196 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d55880 con 0x562a84c5f800 2023-11-17T06:33:12.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 58 ==== osd_op_reply(196 10000000000.01000000 [omap-set-vals] v37'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000033 2023-11-17T06:33:12.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000034 2023-11-17T06:33:12.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:51 2023-11-17T06:33:12.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.275+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:197 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d55c00 con 0x562a84c5e800 2023-11-17T06:33:12.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 79 ==== osd_op_reply(197 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-11-17T06:33:12.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:198 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54000 con 0x562a84c5e800 2023-11-17T06:33:12.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 80 ==== osd_op_reply(198 10000000000.01800000 [omap-set-vals] v37'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000034 2023-11-17T06:33:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000035 2023-11-17T06:33:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:52 2023-11-17T06:33:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.279+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:199 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d54380 con 0x562a84c5f800 2023-11-17T06:33:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 59 ==== osd_op_reply(199 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-11-17T06:33:12.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:200 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 60 ==== osd_op_reply(200 10000000000.01000000 [omap-set-vals] v37'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000035 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000036 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:53 2023-11-17T06:33:12.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:201 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 61 ==== osd_op_reply(201 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-11-17T06:33:12.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.283+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:202 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 62 ==== osd_op_reply(202 10000000000.01000000 [omap-set-vals] v37'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x10000000036 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000037 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:54 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:203 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 81 ==== osd_op_reply(203 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.287+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:204 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5e800 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 82 ==== osd_op_reply(204 10000000000.01800000 [omap-set-vals] v37'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x10000000037 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000038 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:55 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:205 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c380 con 0x562a84c5f800 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.291+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 63 ==== osd_op_reply(205 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-11-17T06:33:12.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:206 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c700 con 0x562a84c5f800 2023-11-17T06:33:12.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 64 ==== osd_op_reply(206 10000000000.01000000 [omap-set-vals] v37'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x10000000038 2023-11-17T06:33:12.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000039 2023-11-17T06:33:12.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:56 2023-11-17T06:33:12.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:207 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ca80 con 0x562a84c5e800 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 83 ==== osd_op_reply(207 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.295+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:208 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ce00 con 0x562a84c5e800 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 84 ==== osd_op_reply(208 10000000000.01800000 [omap-set-vals] v37'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x10000000039 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003a 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:57 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:209 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d180 con 0x562a84c5e800 2023-11-17T06:33:12.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 85 ==== osd_op_reply(209 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-11-17T06:33:12.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.299+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:210 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d500 con 0x562a84c5e800 2023-11-17T06:33:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 86 ==== osd_op_reply(210 10000000000.01800000 [omap-set-vals] v37'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000003a 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003b 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:58 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:211 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d880 con 0x562a84c5e800 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 87 ==== osd_op_reply(211 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-11-17T06:33:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.303+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:212 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4dc00 con 0x562a84c5e800 2023-11-17T06:33:12.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.307+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 88 ==== osd_op_reply(212 10000000000.01800000 [omap-set-vals] v37'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.307+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000003b 2023-11-17T06:33:12.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.307+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003c 2023-11-17T06:33:12.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.307+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:59 2023-11-17T06:33:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.307+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:213 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5f800 2023-11-17T06:33:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 65 ==== osd_op_reply(213 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-11-17T06:33:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:214 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c380 con 0x562a84c5f800 2023-11-17T06:33:12.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 66 ==== osd_op_reply(214 10000000000.01000000 [omap-set-vals] v37'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x1000000003c 2023-11-17T06:33:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003d 2023-11-17T06:33:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:60 2023-11-17T06:33:12.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.311+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:215 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c700 con 0x562a84c5e800 2023-11-17T06:33:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 89 ==== osd_op_reply(215 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-11-17T06:33:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:216 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 90 ==== osd_op_reply(216 10000000000.01800000 [omap-set-vals] v37'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x1000000003d 2023-11-17T06:33:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003e 2023-11-17T06:33:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:61 2023-11-17T06:33:12.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.315+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:217 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 67 ==== osd_op_reply(217 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-11-17T06:33:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:218 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 68 ==== osd_op_reply(218 10000000000.01000000 [omap-set-vals] v37'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x1000000003e 2023-11-17T06:33:12.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000003f 2023-11-17T06:33:12.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:62 2023-11-17T06:33:12.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.319+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:219 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.323+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 91 ==== osd_op_reply(219 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.323+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-11-17T06:33:12.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.323+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.323+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:220 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40000 con 0x562a84c5e800 2023-11-17T06:33:12.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 92 ==== osd_op_reply(220 10000000000.01800000 [omap-set-vals] v37'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x1000000003f 2023-11-17T06:33:12.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000040 2023-11-17T06:33:12.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:63 2023-11-17T06:33:12.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:221 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40380 con 0x562a84c5f800 2023-11-17T06:33:12.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 69 ==== osd_op_reply(221 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-11-17T06:33:12.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:222 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40700 con 0x562a84c5f800 2023-11-17T06:33:12.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 70 ==== osd_op_reply(222 10000000000.01000000 [omap-set-vals] v37'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000040 2023-11-17T06:33:12.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000041 2023-11-17T06:33:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.327+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:64 2023-11-17T06:33:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:223 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40a80 con 0x562a84c5f800 2023-11-17T06:33:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 71 ==== osd_op_reply(223 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-11-17T06:33:12.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:224 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40e00 con 0x562a84c5f800 2023-11-17T06:33:12.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 72 ==== osd_op_reply(224 10000000000.01000000 [omap-set-vals] v37'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000041 2023-11-17T06:33:12.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000042 2023-11-17T06:33:12.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:65 2023-11-17T06:33:12.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.331+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:225 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d41180 con 0x562a84c5f800 2023-11-17T06:33:12.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 73 ==== osd_op_reply(225 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-11-17T06:33:12.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:226 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d41500 con 0x562a84c5f800 2023-11-17T06:33:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 74 ==== osd_op_reply(226 10000000000.01000000 [omap-set-vals] v37'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000042 2023-11-17T06:33:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000043 2023-11-17T06:33:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:66 2023-11-17T06:33:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.335+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:227 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d41880 con 0x562a84c5f800 2023-11-17T06:33:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 75 ==== osd_op_reply(227 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-11-17T06:33:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:228 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d41c00 con 0x562a84c5f800 2023-11-17T06:33:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 76 ==== osd_op_reply(228 10000000000.01000000 [omap-set-vals] v37'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000043 2023-11-17T06:33:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000044 2023-11-17T06:33:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:67 2023-11-17T06:33:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.339+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:229 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40000 con 0x562a84c5e800 2023-11-17T06:33:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 93 ==== osd_op_reply(229 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-11-17T06:33:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:230 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40380 con 0x562a84c5e800 2023-11-17T06:33:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 94 ==== osd_op_reply(230 10000000000.01800000 [omap-set-vals] v37'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000044 2023-11-17T06:33:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000045 2023-11-17T06:33:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:68 2023-11-17T06:33:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.343+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:231 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40700 con 0x562a84c5e800 2023-11-17T06:33:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 95 ==== osd_op_reply(231 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-11-17T06:33:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:232 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d40a80 con 0x562a84c5e800 2023-11-17T06:33:12.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 96 ==== osd_op_reply(232 10000000000.01800000 [omap-set-vals] v37'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000045 2023-11-17T06:33:12.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000046 2023-11-17T06:33:12.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:69 2023-11-17T06:33:12.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.347+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:233 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 77 ==== osd_op_reply(233 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-11-17T06:33:12.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:234 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 78 ==== osd_op_reply(234 10000000000.01000000 [omap-set-vals] v37'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x10000000046 2023-11-17T06:33:12.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000047 2023-11-17T06:33:12.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:70 2023-11-17T06:33:12.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.351+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:235 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 79 ==== osd_op_reply(235 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-11-17T06:33:12.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:236 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5f800 2023-11-17T06:33:12.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 80 ==== osd_op_reply(236 10000000000.01000000 [omap-set-vals] v37'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x10000000047 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000048 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:71 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:237 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5e800 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.355+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 97 ==== osd_op_reply(237 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-11-17T06:33:12.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:238 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c380 con 0x562a84c5e800 2023-11-17T06:33:12.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 98 ==== osd_op_reply(238 10000000000.01800000 [omap-set-vals] v37'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x10000000048 2023-11-17T06:33:12.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000049 2023-11-17T06:33:12.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:72 2023-11-17T06:33:12.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:239 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c700 con 0x562a84c5e800 2023-11-17T06:33:12.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.359+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 99 ==== osd_op_reply(239 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-11-17T06:33:12.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:240 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ca80 con 0x562a84c5e800 2023-11-17T06:33:12.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 100 ==== osd_op_reply(240 10000000000.01800000 [omap-set-vals] v37'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x10000000049 2023-11-17T06:33:12.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004a 2023-11-17T06:33:12.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:73 2023-11-17T06:33:12.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.363+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:241 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ce00 con 0x562a84c5f800 2023-11-17T06:33:12.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 81 ==== osd_op_reply(241 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-11-17T06:33:12.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:242 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d180 con 0x562a84c5f800 2023-11-17T06:33:12.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 82 ==== osd_op_reply(242 10000000000.01000000 [omap-set-vals] v37'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000004a 2023-11-17T06:33:12.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004b 2023-11-17T06:33:12.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:74 2023-11-17T06:33:12.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:243 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d500 con 0x562a84c5f800 2023-11-17T06:33:12.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.367+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 83 ==== osd_op_reply(243 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-11-17T06:33:12.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:244 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4d880 con 0x562a84c5f800 2023-11-17T06:33:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 84 ==== osd_op_reply(244 10000000000.01000000 [omap-set-vals] v37'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000004b 2023-11-17T06:33:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004c 2023-11-17T06:33:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:75 2023-11-17T06:33:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.371+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:245 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4dc00 con 0x562a84c5f800 2023-11-17T06:33:12.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 85 ==== osd_op_reply(245 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-11-17T06:33:12.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:246 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c000 con 0x562a84c5f800 2023-11-17T06:33:12.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 86 ==== osd_op_reply(246 10000000000.01000000 [omap-set-vals] v37'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x1000000004c 2023-11-17T06:33:12.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004d 2023-11-17T06:33:12.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:76 2023-11-17T06:33:12.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:247 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c380 con 0x562a84c5e800 2023-11-17T06:33:12.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 101 ==== osd_op_reply(247 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-11-17T06:33:12.381 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.375+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:248 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4c700 con 0x562a84c5e800 2023-11-17T06:33:12.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 102 ==== osd_op_reply(248 10000000000.01800000 [omap-set-vals] v37'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x1000000004d 2023-11-17T06:33:12.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004e 2023-11-17T06:33:12.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:77 2023-11-17T06:33:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:249 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ca80 con 0x562a84c5f800 2023-11-17T06:33:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 87 ==== osd_op_reply(249 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-11-17T06:33:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.379+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:250 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84d4ce00 con 0x562a84c5f800 2023-11-17T06:33:12.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 88 ==== osd_op_reply(250 10000000000.01000000 [omap-set-vals] v37'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x1000000004e 2023-11-17T06:33:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000004f 2023-11-17T06:33:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:78 2023-11-17T06:33:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:251 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5e800 2023-11-17T06:33:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 103 ==== osd_op_reply(251 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-11-17T06:33:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.383+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:252 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 104 ==== osd_op_reply(252 10000000000.01800000 [omap-set-vals] v37'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x1000000004f 2023-11-17T06:33:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000050 2023-11-17T06:33:12.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:79 2023-11-17T06:33:12.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:253 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 105 ==== osd_op_reply(253 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-11-17T06:33:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.387+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:254 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 106 ==== osd_op_reply(254 10000000000.01800000 [omap-set-vals] v37'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000050 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000051 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:80 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:255 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2000 con 0x562a84c5f800 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 89 ==== osd_op_reply(255 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.391+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:256 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2380 con 0x562a84c5f800 2023-11-17T06:33:12.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 90 ==== osd_op_reply(256 10000000000.01000000 [omap-set-vals] v37'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000051 2023-11-17T06:33:12.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000052 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:81 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:257 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2700 con 0x562a84c5e800 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 107 ==== osd_op_reply(257 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.395+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:258 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2a80 con 0x562a84c5e800 2023-11-17T06:33:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 108 ==== osd_op_reply(258 10000000000.01800000 [omap-set-vals] v37'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000052 2023-11-17T06:33:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000053 2023-11-17T06:33:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:82 2023-11-17T06:33:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:259 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2e00 con 0x562a84c5e800 2023-11-17T06:33:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 109 ==== osd_op_reply(259 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-11-17T06:33:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.399+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:260 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb3180 con 0x562a84c5e800 2023-11-17T06:33:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 110 ==== osd_op_reply(260 10000000000.01800000 [omap-set-vals] v37'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000053 2023-11-17T06:33:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000054 2023-11-17T06:33:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:83 2023-11-17T06:33:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:261 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb3500 con 0x562a84c5f800 2023-11-17T06:33:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 91 ==== osd_op_reply(261 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-11-17T06:33:12.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.403+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:262 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb3880 con 0x562a84c5f800 2023-11-17T06:33:12.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 92 ==== osd_op_reply(262 10000000000.01000000 [omap-set-vals] v37'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000054 2023-11-17T06:33:12.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000055 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:84 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:263 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb3c00 con 0x562a84c5f800 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 93 ==== osd_op_reply(263 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.407+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:264 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2000 con 0x562a84c5f800 2023-11-17T06:33:12.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 94 ==== osd_op_reply(264 10000000000.01000000 [omap-set-vals] v37'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000055 2023-11-17T06:33:12.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000056 2023-11-17T06:33:12.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:85 2023-11-17T06:33:12.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:265 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2380 con 0x562a84c5f800 2023-11-17T06:33:12.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 95 ==== osd_op_reply(265 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-11-17T06:33:12.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.411+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:266 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2700 con 0x562a84c5f800 2023-11-17T06:33:12.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 96 ==== osd_op_reply(266 10000000000.01000000 [omap-set-vals] v37'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x10000000056 2023-11-17T06:33:12.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000057 2023-11-17T06:33:12.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:86 2023-11-17T06:33:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:267 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2a80 con 0x562a84c5f800 2023-11-17T06:33:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 97 ==== osd_op_reply(267 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-11-17T06:33:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.415+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:268 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2e00 con 0x562a84c5f800 2023-11-17T06:33:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 98 ==== osd_op_reply(268 10000000000.01000000 [omap-set-vals] v37'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x10000000057 2023-11-17T06:33:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000058 2023-11-17T06:33:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:87 2023-11-17T06:33:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:269 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb3180 con 0x562a84c5f800 2023-11-17T06:33:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 99 ==== osd_op_reply(269 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-11-17T06:33:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.419+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:270 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 100 ==== osd_op_reply(270 10000000000.01000000 [omap-set-vals] v37'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x10000000058 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000059 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:88 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:271 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5f800 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 101 ==== osd_op_reply(271 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:272 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5f800 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.423+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 102 ==== osd_op_reply(272 10000000000.01000000 [omap-set-vals] v37'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x10000000059 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005a 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:89 2023-11-17T06:33:12.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:273 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 111 ==== osd_op_reply(273 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.427+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:274 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574000 con 0x562a84c5e800 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 112 ==== osd_op_reply(274 10000000000.01800000 [omap-set-vals] v37'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000005a 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005b 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:90 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:275 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574380 con 0x562a84c5f800 2023-11-17T06:33:12.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 103 ==== osd_op_reply(275 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.431+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:276 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574700 con 0x562a84c5f800 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 104 ==== osd_op_reply(276 10000000000.01000000 [omap-set-vals] v37'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000005b 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005c 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:91 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:277 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574a80 con 0x562a84c5e800 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 113 ==== osd_op_reply(277 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.435+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:278 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574e00 con 0x562a84c5e800 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 114 ==== osd_op_reply(278 10000000000.01800000 [omap-set-vals] v37'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x1000000005c 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005d 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:92 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:279 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575180 con 0x562a84c5f800 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 105 ==== osd_op_reply(279 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.439+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:280 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575500 con 0x562a84c5f800 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 106 ==== osd_op_reply(280 10000000000.01000000 [omap-set-vals] v37'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x1000000005d 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005e 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:93 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:281 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575880 con 0x562a84c5e800 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 115 ==== osd_op_reply(281 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.443+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:282 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575c00 con 0x562a84c5e800 2023-11-17T06:33:12.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 116 ==== osd_op_reply(282 10000000000.01800000 [omap-set-vals] v37'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x1000000005e 2023-11-17T06:33:12.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x1000000005f 2023-11-17T06:33:12.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:94 2023-11-17T06:33:12.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:283 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574000 con 0x562a84c5e800 2023-11-17T06:33:12.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 117 ==== osd_op_reply(283 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-11-17T06:33:12.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.447+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:284 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574380 con 0x562a84c5e800 2023-11-17T06:33:12.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 118 ==== osd_op_reply(284 10000000000.01800000 [omap-set-vals] v37'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x1000000005f 2023-11-17T06:33:12.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000060 2023-11-17T06:33:12.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:95 2023-11-17T06:33:12.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:285 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574700 con 0x562a84c5f800 2023-11-17T06:33:12.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 107 ==== osd_op_reply(285 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv104 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-11-17T06:33:12.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.451+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:286 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574a80 con 0x562a84c5f800 2023-11-17T06:33:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 108 ==== osd_op_reply(286 10000000000.01000000 [omap-set-vals] v37'105 uv105 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000060 2023-11-17T06:33:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000061 2023-11-17T06:33:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:96 2023-11-17T06:33:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:287 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85574e00 con 0x562a84c5f800 2023-11-17T06:33:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 109 ==== osd_op_reply(287 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv105 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-11-17T06:33:12.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.455+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:288 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575180 con 0x562a84c5f800 2023-11-17T06:33:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 110 ==== osd_op_reply(288 10000000000.01000000 [omap-set-vals] v37'106 uv106 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000061 2023-11-17T06:33:12.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000062 2023-11-17T06:33:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:97 2023-11-17T06:33:12.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:289 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a85575500 con 0x562a84c5f800 2023-11-17T06:33:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 111 ==== osd_op_reply(289 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv106 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-11-17T06:33:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.459+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:290 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8ae00 con 0x562a84c5f800 2023-11-17T06:33:12.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.6 v2:172.21.15.119:6800/1264916422 112 ==== osd_op_reply(290 10000000000.01000000 [omap-set-vals] v37'107 uv107 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5f800 2023-11-17T06:33:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000062 2023-11-17T06:33:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000063 2023-11-17T06:33:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:98 2023-11-17T06:33:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:291 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8a380 con 0x562a84c5e800 2023-11-17T06:33:12.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 119 ==== osd_op_reply(291 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-11-17T06:33:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.463+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:292 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8b180 con 0x562a84c5e800 2023-11-17T06:33:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 120 ==== osd_op_reply(292 10000000000.01800000 [omap-set-vals] v37'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000063 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 10 datascan.scan_links: handling injected_ino 0x10000000064 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:99 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:293 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84c8bc00 con 0x562a84c5e800 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 121 ==== osd_op_reply(293 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-11-17T06:33:12.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:294 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2000 con 0x562a84c5e800 2023-11-17T06:33:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 122 ==== osd_op_reply(294 10000000000.01800000 [omap-set-vals] v37'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000064 2023-11-17T06:33:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 10 datascan.scan_links: updating inotable 2023-11-17T06:33:12.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.467+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:295 4.13 4:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2380 con 0x562a84c5e800 2023-11-17T06:33:12.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 123 ==== osd_op_reply(295 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 10 datascan.scan_links: updating snaptable 2023-11-17T06:33:12.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- osd_op(unknown.0.0:296 4.d 4:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x562a84cb2700 con 0x562a84c5e800 2023-11-17T06:33:12.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39dfd47700 1 -- 172.21.15.100:0/3320383600 <== osd.4 v2:172.21.15.119:6824/3894860840 124 ==== osd_op_reply(296 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x562a855f6fc0 con 0x562a84c5e800 2023-11-17T06:33:12.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x562a84c5f400 msgr2=0x562a84c67600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x562a84c5f400 0x562a84c67600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x562a84c5ec00 msgr2=0x562a84c66b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x562a84c5ec00 0x562a84c66b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x562a84c5f000 msgr2=0x562a84c67080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x562a84c5f000 0x562a84c67080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x562a8569b000 msgr2=0x562a84888100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x562a8569b000 0x562a84888100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x562a84c5e800 msgr2=0x562a84c66580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x562a84c5e800 0x562a84c66580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x562a84c5e400 msgr2=0x562a84c66000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x562a84c5e400 0x562a84c66000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x562a84c5f800 msgr2=0x562a84c67b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x562a84c5f800 0x562a84c67b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 reap_dead start 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 reap_dead start 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x562a84c5e000 msgr2=0x562a84889700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x562a84c5e000 0x562a84889700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x562a84b068a0 tx=0x562a85694060 comp rx=0 tx=0).stop 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39df546700 1 -- 172.21.15.100:0/3320383600 reap_dead start 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 msgr2=0x562a84888c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.477 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x562a84b07560 tx=0x562a848e4000 comp rx=0 tx=0).stop 2023-11-17T06:33:12.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 shutdown_connections 2023-11-17T06:33:12.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3320383600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a8569a800 0x562a84888c00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 >> 172.21.15.100:0/3320383600 conn(0x562a84812c00 msgr2=0x562a848ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 shutdown_connections 2023-11-17T06:33:12.478 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3320383600 wait complete. 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 msgr2=0x562a84886580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x562a848e1410 tx=0x562a85694120 comp rx=0 tx=0).stop 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 shutdown_connections 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x562a84813000 0x562a84887080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a84813400 0x562a84886b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.479 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 --2- 172.21.15.100:0/3177313067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a84813800 0x562a84886580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.471+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 >> 172.21.15.100:0/3177313067 conn(0x562a84813c00 msgr2=0x562a848ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.475+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 shutdown_connections 2023-11-17T06:33:12.480 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.475+0000 7f39e158b840 1 -- 172.21.15.100:0/3177313067 wait complete. 2023-11-17T06:33:12.486 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.659269, result: 2023-11-17T06:33:12.486 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-11-17T06:33:12.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.595+0000 7fefd054b140 1 Processor -- start 2023-11-17T06:33:12.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.595+0000 7fefd054b140 1 -- start start 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefbc0023f0 0x55ee504d7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee504a9de0 0x55ee504a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50439d40 con 0x55ee5057e650 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee503f7ba0 con 0x55ee504a9de0 2023-11-17T06:33:12.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee503f64e0 con 0x7fefbc0023f0 2023-11-17T06:33:12.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37210/0 (socket says 172.21.15.100:37210) 2023-11-17T06:33:12.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 -- 172.21.15.100:0/4035108492 learned_addr learned my addr 172.21.15.100:0/4035108492 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce085700 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefbc0023f0 0x55ee504d7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefc7fff700 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee504a9de0 0x55ee504a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 -- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefbc0023f0 msgr2=0x55ee504d7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefbc0023f0 0x55ee504d7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 -- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee504a9de0 msgr2=0x55ee504a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee504a9de0 0x55ee504a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 -- 172.21.15.100:0/4035108492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee503d4550 con 0x55ee5057e650 2023-11-17T06:33:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefce886700 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefbc003030 tx=0x7fefc80067e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c90e02f04d0efb server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefcd083700 1 -- 172.21.15.100:0/4035108492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8016070 con 0x55ee5057e650 2023-11-17T06:33:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefcd083700 1 -- 172.21.15.100:0/4035108492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8012420 con 0x55ee5057e650 2023-11-17T06:33:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefcd083700 1 -- 172.21.15.100:0/4035108492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80125b0 con 0x55ee5057e650 2023-11-17T06:33:12.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- 172.21.15.100:0/4035108492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 msgr2=0x55ee504a2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefbc003030 tx=0x7fefc80067e0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- 172.21.15.100:0/4035108492 shutdown_connections 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ee5057e650 0x55ee504a2810 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee504a9de0 0x55ee504a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 --2- 172.21.15.100:0/4035108492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefbc0023f0 0x55ee504d7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.599+0000 7fefd054b140 1 -- 172.21.15.100:0/4035108492 >> 172.21.15.100:0/4035108492 conn(0x55ee504a9a00 msgr2=0x55ee504d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- 172.21.15.100:0/4035108492 shutdown_connections 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- 172.21.15.100:0/4035108492 wait complete. 2023-11-17T06:33:12.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 Processor -- start 2023-11-17T06:33:12.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- start start 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ee504a9de0 0x55ee5057c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee5057e650 0x55ee5057d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 0x55ee5057dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee503c9240 con 0x7fefbc0023f0 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee504ebf80 con 0x55ee5057e650 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefd054b140 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee504ea340 con 0x55ee504a9de0 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefce886700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 0x55ee5057dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefce886700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 0x55ee5057dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37224/0 (socket says 172.21.15.100:37224) 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefce886700 1 -- 172.21.15.100:0/4080943501 learned_addr learned my addr 172.21.15.100:0/4080943501 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:12.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefce085700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ee504a9de0 0x55ee5057c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.610 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.603+0000 7fefc7fff700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee5057e650 0x55ee5057d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 -- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ee504a9de0 msgr2=0x55ee5057c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ee504a9de0 0x55ee5057c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 -- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee5057e650 msgr2=0x55ee5057d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee5057e650 0x55ee5057d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 -- 172.21.15.100:0/4080943501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc800e040 con 0x7fefbc0023f0 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefc7fff700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ee5057e650 0x55ee5057d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce085700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55ee504a9de0 0x55ee5057c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefce886700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 0x55ee5057dcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fefc8004290 tx=0x7fefc8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefc77fe700 1 -- 172.21.15.100:0/4080943501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8016050 con 0x7fefbc0023f0 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefc77fe700 1 -- 172.21.15.100:0/4080943501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc801d480 con 0x7fefbc0023f0 2023-11-17T06:33:12.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee503d3fb0 con 0x7fefbc0023f0 2023-11-17T06:33:12.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefc77fe700 1 -- 172.21.15.100:0/4080943501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc801d810 con 0x7fefbc0023f0 2023-11-17T06:33:12.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.607+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee504ea880 con 0x7fefbc0023f0 2023-11-17T06:33:12.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefc77fe700 1 -- 172.21.15.100:0/4080943501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefc801d970 con 0x7fefbc0023f0 2023-11-17T06:33:12.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefc77fe700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fefb0064e40 0x7fefb0067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefc77fe700 1 -- 172.21.15.100:0/4080943501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fefc8083a20 con 0x7fefbc0023f0 2023-11-17T06:33:12.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefce085700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fefb0064e40 0x7fefb0067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefd054b140 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ee504ec4c0 0x55ee504ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ee504ece10 con 0x55ee504ec4c0 2023-11-17T06:33:12.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefce085700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fefb0064e40 0x7fefb0067300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009760 tx=0x7fefc001f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.611+0000 7fefc7fff700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ee504ec4c0 0x55ee504ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefc7fff700 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ee504ec4c0 0x55ee504ec8d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefc7fff700 1 -- 172.21.15.100:0/4080943501 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv107 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7fefb80097b0 con 0x55ee504ec4c0 2023-11-17T06:33:12.619 INFO:teuthology.orchestra.run.smithi100.stdout:10_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:11_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:12_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:15_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:19_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:1_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:20_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:21_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:27_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:28_head 2023-11-17T06:33:12.620 INFO:teuthology.orchestra.run.smithi100.stdout:2_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:31_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:34_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:36_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:38_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:39_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:3_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:42_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:43_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:46_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:4_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:50_head 2023-11-17T06:33:12.621 INFO:teuthology.orchestra.run.smithi100.stdout:52_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:53_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:55_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:59_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:61_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:63_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:64_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:65_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:66_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:69_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:70_head 2023-11-17T06:33:12.622 INFO:teuthology.orchestra.run.smithi100.stdout:73_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:74_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:75_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:77_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:80_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:83_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:84_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:85_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:86_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:87_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:88_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:8_head 2023-11-17T06:33:12.623 INFO:teuthology.orchestra.run.smithi100.stdout:90_head 2023-11-17T06:33:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:92_head 2023-11-17T06:33:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:95_head 2023-11-17T06:33:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:96_head 2023-11-17T06:33:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:97_head 2023-11-17T06:33:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:9_head 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ee504ec4c0 msgr2=0x55ee504ec8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x55ee504ec4c0 0x55ee504ec8d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fefb0064e40 msgr2=0x7fefb0067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fefb0064e40 0x7fefb0067300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009760 tx=0x7fefc001f040 comp rx=0 tx=0).stop 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 msgr2=0x55ee5057dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 --2- 172.21.15.100:0/4080943501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0023f0 0x55ee5057dcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fefc8004290 tx=0x7fefc8001650 comp rx=0 tx=0).stop 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefce886700 1 -- 172.21.15.100:0/4080943501 reap_dead start 2023-11-17T06:33:12.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 shutdown_connections 2023-11-17T06:33:12.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 >> 172.21.15.100:0/4080943501 conn(0x55ee504a9a00 msgr2=0x55ee504d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 shutdown_connections 2023-11-17T06:33:12.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.615+0000 7fefd054b140 1 -- 172.21.15.100:0/4080943501 wait complete. 2023-11-17T06:33:12.628 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-17T06:33:12.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.811+0000 7f395359e700 1 Processor -- start 2023-11-17T06:33:12.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.811+0000 7f395359e700 1 -- start start 2023-11-17T06:33:12.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3954159fc0 0x7f39540ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39540ae520 con 0x7f39540714b0 2023-11-17T06:33:12.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39540ce940 con 0x7f39540ce4b0 2023-11-17T06:33:12.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395406f320 con 0x7f3954159fc0 2023-11-17T06:33:12.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3954159fc0 0x7f39540ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3954159fc0 0x7f39540ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37238/0 (socket says 172.21.15.100:37238) 2023-11-17T06:33:12.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f3952d9d700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f39540714b0 0x7f39540ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51382/0 (socket says 172.21.15.100:51382) 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 -- 172.21.15.100:0/1236741965 learned_addr learned my addr 172.21.15.100:0/1236741965 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 -- 172.21.15.100:0/1236741965 >> v1:172.21.15.119:6789/0 conn(0x7f39540ce4b0 legacy=0x7f3954070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 -- 172.21.15.100:0/1236741965 >> v1:172.21.15.100:6789/0 conn(0x7f39540714b0 legacy=0x7f39540ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 -- 172.21.15.100:0/1236741965 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540aded0 con 0x7f3954159fc0 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395159a700 1 -- 172.21.15.100:0/1236741965 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883034539 0 0) 0x7f39540ae520 con 0x7f39540714b0 2023-11-17T06:33:12.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395259c700 1 --2- 172.21.15.100:0/1236741965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3954159fc0 0x7f39540ca520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f394400bbe0 tx=0x7f394400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47e4ee46ee51598 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395159a700 1 -- 172.21.15.100:0/1236741965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400dda0 con 0x7f3954159fc0 2023-11-17T06:33:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395159a700 1 -- 172.21.15.100:0/1236741965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944010470 con 0x7f3954159fc0 2023-11-17T06:33:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395159a700 1 -- 172.21.15.100:0/1236741965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944010800 con 0x7f3954159fc0 2023-11-17T06:33:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- 172.21.15.100:0/1236741965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3954159fc0 msgr2=0x7f39540ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 --2- 172.21.15.100:0/1236741965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3954159fc0 0x7f39540ca520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f394400bbe0 tx=0x7f394400bef0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- 172.21.15.100:0/1236741965 shutdown_connections 2023-11-17T06:33:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 --2- 172.21.15.100:0/1236741965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3954159fc0 0x7f39540ca520 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.815+0000 7f395359e700 1 -- 172.21.15.100:0/1236741965 >> 172.21.15.100:0/1236741965 conn(0x7f39540cfed0 msgr2=0x7f39540d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.819+0000 7f395359e700 1 -- 172.21.15.100:0/1236741965 shutdown_connections 2023-11-17T06:33:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.819+0000 7f395359e700 1 -- 172.21.15.100:0/1236741965 wait complete. 2023-11-17T06:33:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.819+0000 7f395359e700 1 Processor -- start 2023-11-17T06:33:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.819+0000 7f395359e700 1 -- start start 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 0x7f3954155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 0x7f39540b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3954153cf0 con 0x7f39540714b0 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540b0450 con 0x7f39540ce4b0 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39541f2540 con 0x7f3954159fc0 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37254/0 (socket says 172.21.15.100:37254) 2023-11-17T06:33:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 -- 172.21.15.100:0/767658836 learned_addr learned my addr 172.21.15.100:0/767658836 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3952d9d700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 0x7f39540b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 -- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 msgr2=0x7f39540b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3951d9b700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 0x7f3954155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 0x7f39540b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 -- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 msgr2=0x7f3954155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 0x7f3954155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 -- 172.21.15.100:0/767658836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394400b810 con 0x7f39540714b0 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3952d9d700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 0x7f39540b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3951d9b700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 0x7f3954155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395259c700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3944000c00 tx=0x7f3944004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394401f070 con 0x7f39540714b0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944010e30 con 0x7f39540714b0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39541f2820 con 0x7f39540714b0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944019810 con 0x7f39540714b0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39540af280 con 0x7f39540714b0 2023-11-17T06:33:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.823+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3954153e60 con 0x7f39540714b0 2023-11-17T06:33:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.827+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3944019970 con 0x7f39540714b0 2023-11-17T06:33:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.827+0000 7f3942ffd700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 0x7f39340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.827+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f3944087a60 con 0x7f39540714b0 2023-11-17T06:33:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.827+0000 7f3951d9b700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 0x7f39340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.827+0000 7f3951d9b700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 0x7f39340689d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39540c6be0 tx=0x7f3948009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.838 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:12.835+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3944054f40 con 0x7f39540714b0 2023-11-17T06:33:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.047+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f3954067990 con 0x7f39540714b0 2023-11-17T06:33:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.175+0000 7f3942ffd700 1 -- 172.21.15.100:0/767658836 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v26) v1 ==== 162+0+0 (secure 0 0 0) 0x7f39440290b0 con 0x7f39540714b0 2023-11-17T06:33:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 msgr2=0x7f39340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 0x7f39340689d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39540c6be0 tx=0x7f3948009040 comp rx=0 tx=0).stop 2023-11-17T06:33:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 msgr2=0x7f39540aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3944000c00 tx=0x7f3944004770 comp rx=0 tx=0).stop 2023-11-17T06:33:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 shutdown_connections 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3954159fc0 0x7f39540b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39540ce4b0 0x7f3954155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f3934066510 0x7f39340689d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 --2- 172.21.15.100:0/767658836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39540714b0 0x7f39540aff10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 >> 172.21.15.100:0/767658836 conn(0x7f39540cfed0 msgr2=0x7f395406e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 shutdown_connections 2023-11-17T06:33:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.179+0000 7f395359e700 1 -- 172.21.15.100:0/767658836 wait complete. 2023-11-17T06:33:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-17T06:33:13.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.379+0000 7fdbb240f700 1 Processor -- start 2023-11-17T06:33:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.379+0000 7fdbb240f700 1 -- start start 2023-11-17T06:33:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb240f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb240f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 0x7fdbac0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb240f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac15d8f0 con 0x7fdbac0d0260 2023-11-17T06:33:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb240f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac0d2750 con 0x7fdbac0d15f0 2023-11-17T06:33:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb240f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0d1ad0 con 0x7fdbac15d510 2023-11-17T06:33:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdba37fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 0x7fdbac0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:53886/0 (socket says 172.21.15.100:53886) 2023-11-17T06:33:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 -- 172.21.15.100:0/2671065340 learned_addr learned my addr 172.21.15.100:0/2671065340 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbb09ac700 1 --1- 172.21.15.100:0/2671065340 >> v1:172.21.15.119:6789/0 conn(0x7fdbac0d0260 0x7fdbac0b63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:39470/0 (socket says 172.21.15.100:39470) 2023-11-17T06:33:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 -- 172.21.15.100:0/2671065340 >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 msgr2=0x7fdbac0b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 --2- 172.21.15.100:0/2671065340 >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 0x7fdbac0b8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 -- 172.21.15.100:0/2671065340 >> v1:172.21.15.119:6789/0 conn(0x7fdbac0d0260 legacy=0x7fdbac0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 -- 172.21.15.100:0/2671065340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0d1db0 con 0x7fdbac15d510 2023-11-17T06:33:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdba37fe700 1 --2- 172.21.15.100:0/2671065340 >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 0x7fdbac0b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbabfff700 1 --2- 172.21.15.100:0/2671065340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009e50 tx=0x7fdb9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331f6d10dbe5f1a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.383+0000 7fdbab7fe700 1 -- 172.21.15.100:0/2671065340 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00e070 con 0x7fdbac15d510 2023-11-17T06:33:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbab7fe700 1 -- 172.21.15.100:0/2671065340 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00b910 con 0x7fdbac15d510 2023-11-17T06:33:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbab7fe700 1 -- 172.21.15.100:0/2671065340 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00bcc0 con 0x7fdbac15d510 2023-11-17T06:33:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- 172.21.15.100:0/2671065340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 msgr2=0x7fdbac0d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2671065340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009e50 tx=0x7fdb9c00b330 comp rx=0 tx=0).stop 2023-11-17T06:33:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- 172.21.15.100:0/2671065340 shutdown_connections 2023-11-17T06:33:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2671065340 >> v2:172.21.15.119:3300/0 conn(0x7fdbac0d15f0 0x7fdbac0b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2671065340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac15d510 0x7fdbac0d2b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- 172.21.15.100:0/2671065340 >> 172.21.15.100:0/2671065340 conn(0x7fdbac073680 msgr2=0x7fdbac073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- 172.21.15.100:0/2671065340 shutdown_connections 2023-11-17T06:33:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- 172.21.15.100:0/2671065340 wait complete. 2023-11-17T06:33:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 Processor -- start 2023-11-17T06:33:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.387+0000 7fdbb240f700 1 -- start start 2023-11-17T06:33:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbac0d0260 0x7fdbac0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac0d15f0 0x7fdbac15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15e560 con 0x7fdbac15d510 2023-11-17T06:33:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15f000 con 0x7fdbac0d0260 2023-11-17T06:33:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15e760 con 0x7fdbac0d15f0 2023-11-17T06:33:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37268/0 (socket says 172.21.15.100:37268) 2023-11-17T06:33:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 -- 172.21.15.100:0/2697693587 learned_addr learned my addr 172.21.15.100:0/2697693587 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbabfff700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbac0d0260 0x7fdbac0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdba37fe700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac0d15f0 0x7fdbac15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 -- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac0d15f0 msgr2=0x7fdbac15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac0d15f0 0x7fdbac15dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 -- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbac0d0260 msgr2=0x7fdbac0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbac0d0260 0x7fdbac0b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 -- 172.21.15.100:0/2697693587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940094b0 con 0x7fdbac15d510 2023-11-17T06:33:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb09ac700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c3e0 tx=0x7fdba400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4004a90 con 0x7fdbac15d510 2023-11-17T06:33:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4004bf0 con 0x7fdbac15d510 2023-11-17T06:33:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c009b30 con 0x7fdbac15d510 2023-11-17T06:33:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40070d0 con 0x7fdbac15d510 2023-11-17T06:33:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.391+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac15ed20 con 0x7fdbac15d510 2023-11-17T06:33:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.395+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac04eea0 con 0x7fdbac15d510 2023-11-17T06:33:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.395+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdba4007230 con 0x7fdbac15d510 2023-11-17T06:33:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.395+0000 7fdba97fa700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 0x7fdb8c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.395+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fdba40835c0 con 0x7fdbac15d510 2023-11-17T06:33:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.399+0000 7fdbabfff700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 0x7fdb8c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.399+0000 7fdbabfff700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 0x7fdb8c0689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00b370 tx=0x7fdb9c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.403+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdba40509a0 con 0x7fdbac15d510 2023-11-17T06:33:13.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.611+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbac0d2340 con 0x7fdbac15d510 2023-11-17T06:33:13.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.615+0000 7fdba97fa700 1 -- 172.21.15.100:0/2697693587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fdba4081e60 con 0x7fdbac15d510 2023-11-17T06:33:13.618 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:13.618 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:13.181685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.615+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 msgr2=0x7fdb8c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.615+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 0x7fdb8c0689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00b370 tx=0x7fdb9c009000 comp rx=0 tx=0).stop 2023-11-17T06:33:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.615+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 msgr2=0x7fdbac15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.615+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c3e0 tx=0x7fdba400c6f0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 shutdown_connections 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdb8c066510 0x7fdb8c0689d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbac15d510 0x7fdbac15e020 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbac0d15f0 0x7fdbac15dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 --2- 172.21.15.100:0/2697693587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbac0d0260 0x7fdbac0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 >> 172.21.15.100:0/2697693587 conn(0x7fdbac073680 msgr2=0x7fdbac0c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 shutdown_connections 2023-11-17T06:33:13.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:13.619+0000 7fdbb240f700 1 -- 172.21.15.100:0/2697693587 wait complete. 2023-11-17T06:33:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2023-11-17T06:33:14.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:33:13.181685+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 37, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.100:6837/3260089866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3260089866}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3260089866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:14.049 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5667:up:replay 2023-11-17T06:33:15.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 Processor -- start 2023-11-17T06:33:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 -- start start 2023-11-17T06:33:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c58160b60 0x7f7c580d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160f40 0x7f7c580d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580d21b0 con 0x7f7c580d10d0 2023-11-17T06:33:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580b04d0 con 0x7f7c58160b60 2023-11-17T06:33:15.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.219+0000 7f7c5f279700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580d0710 con 0x7f7c58160f40 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5ea78700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7c580d10d0 0x7f7c580cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51392/0 (socket says 172.21.15.100:51392) 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5ea78700 1 -- 172.21.15.100:0/569052890 learned_addr learned my addr 172.21.15.100:0/569052890 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 --2- 172.21.15.100:0/569052890 >> v2:172.21.15.100:3300/0 conn(0x7f7c58160b60 0x7f7c580d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5da76700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160f40 0x7f7c580d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 -- 172.21.15.100:0/569052890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160f40 msgr2=0x7f7c580d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:15.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160f40 0x7f7c580d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 -- 172.21.15.100:0/569052890 >> v1:172.21.15.100:6789/0 conn(0x7f7c580d10d0 legacy=0x7f7c580cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 -- 172.21.15.100:0/569052890 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580d09f0 con 0x7f7c58160b60 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5e277700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c58160b60 0x7f7c580d0080 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009850 tx=0x7f7c54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297e0b5efe419452 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5d275700 1 -- 172.21.15.100:0/569052890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011830 con 0x7f7c58160b60 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5d275700 1 -- 172.21.15.100:0/569052890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54011990 con 0x7f7c58160b60 2023-11-17T06:33:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5d275700 1 -- 172.21.15.100:0/569052890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011d40 con 0x7f7c58160b60 2023-11-17T06:33:15.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 -- 172.21.15.100:0/569052890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c58160b60 msgr2=0x7f7c580d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c58160b60 0x7f7c580d0080 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009850 tx=0x7f7c54009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 -- 172.21.15.100:0/569052890 shutdown_connections 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160f40 0x7f7c580d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 --2- 172.21.15.100:0/569052890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c58160b60 0x7f7c580d0080 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 -- 172.21.15.100:0/569052890 >> 172.21.15.100:0/569052890 conn(0x7f7c580d31d0 msgr2=0x7f7c580d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 -- 172.21.15.100:0/569052890 shutdown_connections 2023-11-17T06:33:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.223+0000 7f7c5f279700 1 -- 172.21.15.100:0/569052890 wait complete. 2023-11-17T06:33:15.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 Processor -- start 2023-11-17T06:33:15.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 -- start start 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 0x7f7c580c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 0x7f7c580b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c92e0 con 0x7f7c580b88c0 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580b8d60 con 0x7f7c580d10d0 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5f279700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c8940 con 0x7f7c58160b60 2023-11-17T06:33:15.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37280/0 (socket says 172.21.15.100:37280) 2023-11-17T06:33:15.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 -- 172.21.15.100:0/1537577452 learned_addr learned my addr 172.21.15.100:0/1537577452 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:15.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5da76700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 0x7f7c580b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5e277700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 0x7f7c580c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 -- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 msgr2=0x7f7c580b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 0x7f7c580b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 -- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 msgr2=0x7f7c580c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 0x7f7c580c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 -- 172.21.15.100:0/1537577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540094b0 con 0x7f7c580b88c0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5da76700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 0x7f7c580b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5e277700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 0x7f7c580c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.227+0000 7f7c5ea78700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000cbc0 tx=0x7f7c5000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000a9e0 con 0x7f7c580b88c0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580c8c20 con 0x7f7c580b88c0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000ab40 con 0x7f7c580b88c0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c580c8560 con 0x7f7c580b88c0 2023-11-17T06:33:15.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000ce80 con 0x7f7c580b88c0 2023-11-17T06:33:15.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c580c9420 con 0x7f7c580b88c0 2023-11-17T06:33:15.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.231+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c50012400 con 0x7f7c580b88c0 2023-11-17T06:33:15.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.235+0000 7f7c4effd700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 0x7f7c3c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:15.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.235+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f7c50083730 con 0x7f7c580b88c0 2023-11-17T06:33:15.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.235+0000 7f7c5e277700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 0x7f7c3c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:15.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.235+0000 7f7c5e277700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 0x7f7c3c0689d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c540090b0 tx=0x7f7c54008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:15.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.239+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c50050b20 con 0x7f7c580b88c0 2023-11-17T06:33:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.451+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c580d21b0 con 0x7f7c580b88c0 2023-11-17T06:33:15.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.451+0000 7f7c4effd700 1 -- 172.21.15.100:0/1537577452 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f7c580d21b0 con 0x7f7c580b88c0 2023-11-17T06:33:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:15.455 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:14.198405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 msgr2=0x7f7c3c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 0x7f7c3c0689d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c540090b0 tx=0x7f7c54008030 comp rx=0 tx=0).stop 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 msgr2=0x7f7c580b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000cbc0 tx=0x7f7c5000cca0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 shutdown_connections 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f7c3c066510 0x7f7c3c0689d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c580b88c0 0x7f7c580b6780 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c58160b60 0x7f7c580b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 --2- 172.21.15.100:0/1537577452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c580d10d0 0x7f7c580c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 >> 172.21.15.100:0/1537577452 conn(0x7f7c580d31d0 msgr2=0x7f7c5815d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:15.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 shutdown_connections 2023-11-17T06:33:15.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:15.455+0000 7f7c5f279700 1 -- 172.21.15.100:0/1537577452 wait complete. 2023-11-17T06:33:15.460 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 29 2023-11-17T06:33:15.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:33:14.198405+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 37, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.100:6837/3260089866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3260089866}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3260089866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:15.881 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5667:up:rejoin 2023-11-17T06:33:16.882 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:17.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.067+0000 7f333e9ce700 1 Processor -- start 2023-11-17T06:33:17.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.067+0000 7f333e9ce700 1 -- start start 2023-11-17T06:33:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333e9ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161960 0x7f33380d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333e9ce700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33380ca730 0x7f33380cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333e9ce700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333806a2a0 con 0x7f3338161d40 2023-11-17T06:33:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333e9ce700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333806a580 con 0x7f33380ca730 2023-11-17T06:33:17.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333e9ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33380cc230 con 0x7f3338161960 2023-11-17T06:33:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33380ca730 0x7f33380cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33380ca730 0x7f33380cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37288/0 (socket says 172.21.15.100:37288) 2023-11-17T06:33:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 -- 172.21.15.100:0/546189490 learned_addr learned my addr 172.21.15.100:0/546189490 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f3337fff700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161960 0x7f33380d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 -- 172.21.15.100:0/546189490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161960 msgr2=0x7f33380d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161960 0x7f33380d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 -- 172.21.15.100:0/546189490 >> v1:172.21.15.119:6789/0 conn(0x7f3338161d40 legacy=0x7f333806aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f333cf6b700 1 -- 172.21.15.100:0/546189490 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380cc510 con 0x7f33380ca730 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.071+0000 7f33377fe700 1 -- 172.21.15.100:0/546189490 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003889371 0 0) 0x7f333806a2a0 con 0x7f3338161d40 2023-11-17T06:33:17.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333cf6b700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33380ca730 0x7f33380cdfe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3330009e50 tx=0x7f333000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ff00c1cf1a37bd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f33377fe700 1 -- 172.21.15.100:0/546189490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e070 con 0x7f33380ca730 2023-11-17T06:33:17.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f33377fe700 1 -- 172.21.15.100:0/546189490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000b910 con 0x7f33380ca730 2023-11-17T06:33:17.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f33377fe700 1 -- 172.21.15.100:0/546189490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000bcc0 con 0x7f33380ca730 2023-11-17T06:33:17.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 -- 172.21.15.100:0/546189490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33380ca730 msgr2=0x7f33380cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33380ca730 0x7f33380cdfe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3330009e50 tx=0x7f333000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 -- 172.21.15.100:0/546189490 shutdown_connections 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33380ca730 0x7f33380cdfe0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 --2- 172.21.15.100:0/546189490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161960 0x7f33380d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 -- 172.21.15.100:0/546189490 >> 172.21.15.100:0/546189490 conn(0x7f33380d00e0 msgr2=0x7f33380d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 -- 172.21.15.100:0/546189490 shutdown_connections 2023-11-17T06:33:17.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.075+0000 7f333e9ce700 1 -- 172.21.15.100:0/546189490 wait complete. 2023-11-17T06:33:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 Processor -- start 2023-11-17T06:33:17.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 -- start start 2023-11-17T06:33:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33380ca730 0x7f33380c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161d40 0x7f3338163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380c77b0 con 0x7f3338161960 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380c7a90 con 0x7f33380ca730 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333e9ce700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33380c7d70 con 0x7f3338161d40 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37304/0 (socket says 172.21.15.100:37304) 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 -- 172.21.15.100:0/2131412680 learned_addr learned my addr 172.21.15.100:0/2131412680 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f3337fff700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33380ca730 0x7f33380c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f333cf6b700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161d40 0x7f3338163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 -- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161d40 msgr2=0x7f3338163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161d40 0x7f3338163330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 -- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33380ca730 msgr2=0x7f33380c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33380ca730 0x7f33380c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.079+0000 7f332f7fe700 1 -- 172.21.15.100:0/2131412680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009b30 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f332f7fe700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f33200011e0 tx=0x7f332000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200054e0 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33200036a0 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33380c8050 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320003a50 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33380b53c0 con 0x7f3338161960 2023-11-17T06:33:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3338067e40 con 0x7f3338161960 2023-11-17T06:33:17.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.083+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3320003bb0 con 0x7f3338161960 2023-11-17T06:33:17.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.087+0000 7f33357fa700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 0x7f331c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.087+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f33200833f0 con 0x7f3338161960 2023-11-17T06:33:17.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.087+0000 7f3337fff700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 0x7f331c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.087+0000 7f3337fff700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 0x7f331c0689d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3328009be0 tx=0x7f33280091c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.091+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3320050720 con 0x7f3338161960 2023-11-17T06:33:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.307+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f333804eea0 con 0x7f3338161960 2023-11-17T06:33:17.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.307+0000 7f33357fa700 1 -- 172.21.15.100:0/2131412680 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f3320003e60 con 0x7f3338161960 2023-11-17T06:33:17.314 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:17.314 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:15.209855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 msgr2=0x7f331c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 0x7f331c0689d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3328009be0 tx=0x7f33280091c0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 msgr2=0x7f3338162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f33200011e0 tx=0x7f332000ca30 comp rx=0 tx=0).stop 2023-11-17T06:33:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 shutdown_connections 2023-11-17T06:33:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3338161d40 0x7f3338163330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f331c066510 0x7f331c0689d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338161960 0x7f3338162df0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 --2- 172.21.15.100:0/2131412680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33380ca730 0x7f33380c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 >> 172.21.15.100:0/2131412680 conn(0x7f33380d00e0 msgr2=0x7f333809e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 shutdown_connections 2023-11-17T06:33:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.311+0000 7f333e9ce700 1 -- 172.21.15.100:0/2131412680 wait complete. 2023-11-17T06:33:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2023-11-17T06:33:17.739 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:01.702360+0000', 'modified': '2023-11-17T06:33:15.209855+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 37, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6837/3260089866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3260089866}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3260089866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:17.739 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:33:17.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-17T06:33:17.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 Processor -- start 2023-11-17T06:33:17.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 -- start start 2023-11-17T06:33:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f8015d510 0x7f0f800ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f800d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0f800d0720 0x7f0f800d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800d0bb0 con 0x7f0f800d0720 2023-11-17T06:33:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800d30c0 con 0x7f0f8015d510 2023-11-17T06:33:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.915+0000 7f0f852f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800d33a0 con 0x7f0f800d2940 2023-11-17T06:33:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f8015d510 0x7f0f800ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f8015d510 0x7f0f800ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34610/0 (socket says 172.21.15.100:34610) 2023-11-17T06:33:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 -- 172.21.15.100:0/4091631795 learned_addr learned my addr 172.21.15.100:0/4091631795 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/4091631795 >> v2:172.21.15.100:3300/0 conn(0x7f0f800d0720 0x7f0f800d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f77fff700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f800d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 -- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 msgr2=0x7f0f800d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f800d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 -- 172.21.15.100:0/4091631795 >> v2:172.21.15.100:3300/0 conn(0x7f0f800d0720 msgr2=0x7f0f800d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 --2- 172.21.15.100:0/4091631795 >> v2:172.21.15.100:3300/0 conn(0x7f0f800d0720 0x7f0f800d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 -- 172.21.15.100:0/4091631795 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800d3680 con 0x7f0f8015d510 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f77fff700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f800d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:17.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7effd700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f800ce600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0f800d0df0 tx=0x7f0f70009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19565b4983ad5b63 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7e7fc700 1 -- 172.21.15.100:0/4091631795 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70011830 con 0x7f0f8015d510 2023-11-17T06:33:17.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7e7fc700 1 -- 172.21.15.100:0/4091631795 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70011990 con 0x7f0f8015d510 2023-11-17T06:33:17.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f7e7fc700 1 -- 172.21.15.100:0/4091631795 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70011d20 con 0x7f0f8015d510 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 -- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 msgr2=0x7f0f800ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f800ce600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0f800d0df0 tx=0x7f0f70009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 -- 172.21.15.100:0/4091631795 shutdown_connections 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 --2- 172.21.15.100:0/4091631795 >> v2:172.21.15.100:3300/0 conn(0x7f0f800d0720 0x7f0f800d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f800d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 --2- 172.21.15.100:0/4091631795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f800ce600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 -- 172.21.15.100:0/4091631795 >> 172.21.15.100:0/4091631795 conn(0x7f0f80073440 msgr2=0x7f0f80073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 -- 172.21.15.100:0/4091631795 shutdown_connections 2023-11-17T06:33:17.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.919+0000 7f0f852f3700 1 -- 172.21.15.100:0/4091631795 wait complete. 2023-11-17T06:33:17.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 Processor -- start 2023-11-17T06:33:17.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 -- start start 2023-11-17T06:33:17.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f8015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f8015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80154490 con 0x7f0f800d0720 2023-11-17T06:33:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cc740 con 0x7f0f8015d510 2023-11-17T06:33:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f852f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cca20 con 0x7f0f800d2940 2023-11-17T06:33:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37316/0 (socket says 172.21.15.100:37316) 2023-11-17T06:33:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 -- 172.21.15.100:0/1020441046 learned_addr learned my addr 172.21.15.100:0/1020441046 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f8015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 -- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 msgr2=0x7f0f8015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f8015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 -- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 msgr2=0x7f0f8015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f8015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 -- 172.21.15.100:0/1020441046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70009570 con 0x7f0f800d0720 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.923+0000 7f0f7effd700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f70014040 tx=0x7f0f70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f777fe700 1 -- 172.21.15.100:0/1020441046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70004590 con 0x7f0f800d0720 2023-11-17T06:33:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f777fe700 1 -- 172.21.15.100:0/1020441046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7001e070 con 0x7f0f800d0720 2023-11-17T06:33:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f777fe700 1 -- 172.21.15.100:0/1020441046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70003900 con 0x7f0f800d0720 2023-11-17T06:33:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800ccd00 con 0x7f0f800d0720 2023-11-17T06:33:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f800cd2c0 con 0x7f0f800d0720 2023-11-17T06:33:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.927+0000 7f0f777fe700 1 -- 172.21.15.100:0/1020441046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f70003a60 con 0x7f0f800d0720 2023-11-17T06:33:17.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.931+0000 7f0f777fe700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 0x7f0f600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.931+0000 7f0f777fe700 1 -- 172.21.15.100:0/1020441046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0f70084bb0 con 0x7f0f800d0720 2023-11-17T06:33:17.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.931+0000 7f0f77fff700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 0x7f0f600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.931+0000 7f0f77fff700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 0x7f0f600689d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.931+0000 7f0f885bd740 1 Processor -- start 2023-11-17T06:33:17.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 -- start start 2023-11-17T06:33:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfc8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xef8620 con 0xfc6750 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xef5d10 con 0xfc9390 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xef1600 con 0xfc8530 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:34618/0 (socket says 172.21.15.100:34618) 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 -- 172.21.15.100:0/2347858602 learned_addr learned my addr 172.21.15.100:0/2347858602 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7effd700 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfc8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 -- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 msgr2=0xfc8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfc8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 -- 172.21.15.100:0/2347858602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 msgr2=0xfc8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 -- 172.21.15.100:0/2347858602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf16850 con 0xfc9390 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7effd700 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfc8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f780076b0 tx=0x7f0f78009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213d42dbf4ec4b57 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f74ff9700 1 -- 172.21.15.100:0/2347858602 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800e030 con 0xfc9390 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f74ff9700 1 -- 172.21.15.100:0/2347858602 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f780153f0 con 0xfc9390 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.935+0000 7f0f74ff9700 1 -- 172.21.15.100:0/2347858602 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78015760 con 0xfc9390 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 msgr2=0xfc9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f780076b0 tx=0x7f0f78009750 comp rx=0 tx=0).stop 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- 172.21.15.100:0/2347858602 shutdown_connections 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfc9770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2347858602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfc8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- 172.21.15.100:0/2347858602 >> 172.21.15.100:0/2347858602 conn(0xd164d0 msgr2=0xfb1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- 172.21.15.100:0/2347858602 shutdown_connections 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- 172.21.15.100:0/2347858602 wait complete. 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- start start 2023-11-17T06:33:17.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 Processor -- start 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 0xfae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0xf89250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xeaf6e0 con 0xfc6750 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xeaf380 con 0xfc8530 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xd9aaa0 con 0xfc9390 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f885bd740 10 client.0 _ll_register_callbacks cb 0xe9ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37340/0 (socket says 172.21.15.100:37340) 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 -- 172.21.15.100:0/2642326510 learned_addr learned my addr 172.21.15.100:0/2642326510 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0xf89250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f77fff700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 0xfae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 -- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 msgr2=0xf89250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0xf89250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 -- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 msgr2=0xfae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.939+0000 7f0f7effd700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 0xfae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f7effd700 1 -- 172.21.15.100:0/2642326510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78007330 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f77fff700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 0xfae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f7effd700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009f40 tx=0x7f0f70056450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d0a2ff9fb82f41 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7005dfd0 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0f700523e0 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xeea5e0 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f700525a0 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 10 client.5745 fetch_fsmap learned FSMap version 30 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0xd61960 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xeea5e0 con 0xfc6750 2023-11-17T06:33:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0f70055f30 con 0xfc6750 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 10 client.5745 fetch_fsmap finished waiting for FSMap version 30 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 10 client.5745 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 20 client.5745 populate_metadata read hostname 'smithi100' 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xf864c0 0xf868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 4 client.5745 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 --> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xeaa470 con 0xf864c0 2023-11-17T06:33:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f77fff700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xf864c0 0xf868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f5dffb700 10 client.5745 ms_handle_connect on v2:172.21.15.100:6835/3260089866 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.943+0000 7f0f77fff700 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xf864c0 0xf868a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c7d38fd906e21a server_cookie=40a7b1c18070af5a in_seq=0 out_seq=0 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f5dffb700 1 -- 172.21.15.100:0/2642326510 <== mds.0 v2:172.21.15.100:6835/3260089866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0xeaa470 con 0xf864c0 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f5dffb700 10 client.5745 handle_command_reply: tid=0 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 client.5745 shutdown 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 msgr2=0xfadd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009f40 tx=0x7f0f70056450 comp rx=0 tx=0).stop 2023-11-17T06:33:17.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 shutdown_connections 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0xf89250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xf864c0 0xf868a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc8530 0xfae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 --2- 172.21.15.100:0/2642326510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfadd80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f5dffb700 0 client.5745 ms_handle_reset on v2:172.21.15.100:6835/3260089866 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 >> 172.21.15.100:0/2642326510 conn(0xd164d0 msgr2=0xf89e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 shutdown_connections 2023-11-17T06:33:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 1 -- 172.21.15.100:0/2642326510 wait complete. 2023-11-17T06:33:17.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.947+0000 7f0f885bd740 20 client.5745 trim_cache size 0 max 16384 2023-11-17T06:33:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 Processor -- start 2023-11-17T06:33:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 -- start start 2023-11-17T06:33:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfdfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xebc8e0 con 0xfc6750 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xeaa470 con 0xfc9390 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xe9e5a0 con 0xfc8530 2023-11-17T06:33:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:53974/0 (socket says 172.21.15.100:53974) 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f7effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37354/0 (socket says 172.21.15.100:37354) 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 -- 172.21.15.100:0/1955512350 learned_addr learned my addr 172.21.15.100:0/1955512350 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfdfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 -- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 msgr2=0xfdfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfdfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 -- 172.21.15.100:0/1955512350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 msgr2=0xfc5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.967+0000 7f0f77fff700 1 -- 172.21.15.100:0/1955512350 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xeb44f0 con 0xfc8530 2023-11-17T06:33:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f77fff700 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f68008010 tx=0x7f0f68013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87882b79dbed94 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f757fa700 1 -- 172.21.15.100:0/1955512350 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801e040 con 0xfc8530 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f757fa700 1 -- 172.21.15.100:0/1955512350 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680040e0 con 0xfc8530 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f757fa700 1 -- 172.21.15.100:0/1955512350 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68024410 con 0xfc8530 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 msgr2=0xfdf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f68008010 tx=0x7f0f68013000 comp rx=0 tx=0).stop 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- 172.21.15.100:0/1955512350 shutdown_connections 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc9390 0xfdfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc8530 0xfdf9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- 172.21.15.100:0/1955512350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc6750 0xfc5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- 172.21.15.100:0/1955512350 >> 172.21.15.100:0/1955512350 conn(0xd164d0 msgr2=0xfc9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- 172.21.15.100:0/1955512350 shutdown_connections 2023-11-17T06:33:17.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- 172.21.15.100:0/1955512350 wait complete. 2023-11-17T06:33:17.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- start start 2023-11-17T06:33:17.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 Processor -- start 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc6750 0x1036dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0x1037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0xff5500 con 0xfc8530 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc5980 con 0xfc6750 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0xfe6460 con 0xfc9390 2023-11-17T06:33:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f885bd740 10 client.0 _ll_register_callbacks cb 0xeb64b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.971+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37362/0 (socket says 172.21.15.100:37362) 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 -- 172.21.15.100:0/3794401619 learned_addr learned my addr 172.21.15.100:0/3794401619 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f7effd700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc6750 0x1036dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f7f7fe700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0x1037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 -- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 msgr2=0x1037cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0x1037cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 -- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc6750 msgr2=0x1036dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc6750 0x1036dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 -- 172.21.15.100:0/3794401619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6800e040 con 0xfc8530 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f77fff700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f800b6070 tx=0x7f0f68006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379e2bed0433b5db server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801e070 con 0xfc8530 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0f68024b80 con 0xfc8530 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f780153f0 con 0xfc8530 2023-11-17T06:33:17.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f68024590 con 0xfc8530 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 10 client.5751 fetch_fsmap learned FSMap version 30 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0xe9a8d0 con 0xfc8530 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f780153f0 con 0xfc8530 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0f6800d5c0 con 0xfc8530 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 10 client.5751 fetch_fsmap finished waiting for FSMap version 30 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 10 client.5751 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 20 client.5751 populate_metadata read hostname 'smithi100' 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xfe4810 0xfe4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 4 client.5751 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 --> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] -- command(tid 0: {"prefix": "status"}) v1 -- 0xd6d460 con 0xfe4810 2023-11-17T06:33:17.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f7effd700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xfe4810 0xfe4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f5dffb700 10 client.5751 ms_handle_connect on v2:172.21.15.100:6835/3260089866 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.975+0000 7f0f7effd700 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xfe4810 0xfe4bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f3c8c93639f1a7 server_cookie=4c18b91825de1d97 in_seq=0 out_seq=0 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f5dffb700 1 -- 172.21.15.100:0/3794401619 <== mds.0 v2:172.21.15.100:6835/3260089866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xd6d460 con 0xfe4810 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f5dffb700 10 client.5751 handle_command_reply: tid=0 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 client.5751 shutdown 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 msgr2=0x1037780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f800b6070 tx=0x7f0f68006ea0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 shutdown_connections 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0xfc9390 0x1037cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0xfc8530 0x1037780 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.100:6835/3260089866,v1:172.21.15.100:6837/3260089866] conn(0xfe4810 0xfe4bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 --2- 172.21.15.100:0/3794401619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0xfc6750 0x1036dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f5dffb700 0 client.5751 ms_handle_reset on v2:172.21.15.100:6835/3260089866 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 >> 172.21.15.100:0/3794401619 conn(0xd164d0 msgr2=0xf85ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 shutdown_connections 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 1 -- 172.21.15.100:0/3794401619 wait complete. 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f885bd740 20 client.5751 trim_cache size 0 max 16384 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "85721606-40d2-46b5-8d45-5c90fa8b3283", 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5667, 2023-11-17T06:33:17.984 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 4.7966218070000002, 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 30, 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 37, 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 37, 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7.7436427859999997 2023-11-17T06:33:17.985 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 msgr2=0x7f0f600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 0x7f0f600689d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68008040 comp rx=0 tx=0).stop 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 msgr2=0x7f0f80153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f70014040 tx=0x7f0f70004770 comp rx=0 tx=0).stop 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 shutdown_connections 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f8015d510 0x7f0f8015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f800d2940 0x7f0f8015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0f60066510 0x7f0f600689d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 --2- 172.21.15.100:0/1020441046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f800d0720 0x7f0f80153f50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 >> 172.21.15.100:0/1020441046 conn(0x7f0f80073440 msgr2=0x7f0f800b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 shutdown_connections 2023-11-17T06:33:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:17.979+0000 7f0f852f3700 1 -- 172.21.15.100:0/1020441046 wait complete. 2023-11-17T06:33:18.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:33:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.167+0000 7f2cdd2ec700 1 Processor -- start 2023-11-17T06:33:18.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.167+0000 7f2cdd2ec700 1 -- start start 2023-11-17T06:33:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cd80cd870 0x7f2cd80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd8165740 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd80cdc50 con 0x7f2cd80cd870 2023-11-17T06:33:18.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8165a20 con 0x7f2cd80ce760 2023-11-17T06:33:18.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cd80cd870 0x7f2cd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd67fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2cd80ccaa0 0x7f2cd80ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51406/0 (socket says 172.21.15.100:51406) 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd67fc700 1 -- 172.21.15.100:0/751230188 learned_addr learned my addr 172.21.15.100:0/751230188 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd77fe700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/751230188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 msgr2=0x7f2cd80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd80cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/751230188 >> v1:172.21.15.100:6789/0 conn(0x7f2cd80ccaa0 legacy=0x7f2cd80ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/751230188 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8165d00 con 0x7f2cd80cd870 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd6ffd700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80cd870 0x7f2cd80cb9e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009850 tx=0x7f2cc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6d3230d8405672 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd5ffb700 1 -- 172.21.15.100:0/751230188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8011830 con 0x7f2cd80cd870 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd5ffb700 1 -- 172.21.15.100:0/751230188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8011990 con 0x7f2cd80cd870 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cd5ffb700 1 -- 172.21.15.100:0/751230188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8011d20 con 0x7f2cd80cd870 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/751230188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80cd870 msgr2=0x7f2cd80cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.171+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80cd870 0x7f2cd80cb9e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009850 tx=0x7f2cc8009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/751230188 shutdown_connections 2023-11-17T06:33:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/751230188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80cd870 0x7f2cd80cb9e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/751230188 >> 172.21.15.100:0/751230188 conn(0x7f2cd806a480 msgr2=0x7f2cd806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/751230188 shutdown_connections 2023-11-17T06:33:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/751230188 wait complete. 2023-11-17T06:33:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 Processor -- start 2023-11-17T06:33:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.175+0000 7f2cdd2ec700 1 -- start start 2023-11-17T06:33:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd80cd870 0x7f2cd815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8070010 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd806f9e0 con 0x7f2cd80cd870 2023-11-17T06:33:18.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80b22b0 con 0x7f2cd80ce760 2023-11-17T06:33:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37380/0 (socket says 172.21.15.100:37380) 2023-11-17T06:33:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/957621981 learned_addr learned my addr 172.21.15.100:0/957621981 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd67fc700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd80cd870 0x7f2cd815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd77fe700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 msgr2=0x7f2cd815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd815de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd80cd870 msgr2=0x7f2cd815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd80cd870 0x7f2cd815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 -- 172.21.15.100:0/957621981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80094b0 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cd6ffd700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2cd806dd40 tx=0x7f2cc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8004530 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc801f070 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8003900 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd80c4240 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.179+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd806fc30 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.183+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd8067990 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.183+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2cc8021030 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.183+0000 7f2cbf7fe700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 0x7f2cc40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.183+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2cc8085440 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.183+0000 7f2cd67fc700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 0x7f2cc40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.187+0000 7f2cd67fc700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 0x7f2cc40689d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ce290 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.191+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2cc8052820 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.415+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2cd806fdc0 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.415+0000 7f2cbf7fe700 1 -- 172.21.15.100:0/957621981 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2cd806fdc0 con 0x7f2cd80ccaa0 2023-11-17T06:33:18.421 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:33:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 msgr2=0x7f2cc40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 0x7f2cc40689d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ce290 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2023-11-17T06:33:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 msgr2=0x7f2cd80b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2cd806dd40 tx=0x7f2cc8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 shutdown_connections 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cd80ce760 0x7f2cd815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd80cd870 0x7f2cd815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2cc4066510 0x7f2cc40689d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 --2- 172.21.15.100:0/957621981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd80ccaa0 0x7f2cd80b1d70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 >> 172.21.15.100:0/957621981 conn(0x7f2cd806a480 msgr2=0x7f2cd806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 shutdown_connections 2023-11-17T06:33:18.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:18.423+0000 7f2cdd2ec700 1 -- 172.21.15.100:0/957621981 wait complete. 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:33:18.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:33:18.448 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:33:18.448 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.448 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-11-17T06:33:18.468 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-11-17T06:33:18.469 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 41923sec preferred_lft 41923sec 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:33:18.470 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:56:04:b0:e5 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:33:18.471 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::500a:a9ff:fe52:b4e2/64 scope link 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ca:4b:a0:54:7d:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c84b:a0ff:fe54:7d52/64 scope link 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether ce:a0:c8:bf:81:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::cca0:c8ff:febf:810f/64 scope link 2023-11-17T06:33:18.473 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.475 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:33:18.553 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-11-17T06:33:18.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.556 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-11-17T06:33:18.624 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-11-17T06:33:18.624 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:33:18.624 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:33:18.624 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:33:18.625 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:33:18.625 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:33:18.625 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:33:18.625 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:33:18.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.625 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-11-17T06:33:18.625 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-11-17T06:33:18.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:33:18.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:33:18.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:33:18.626 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-11-17T06:33:18.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.762 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:33:18.778 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:33:18.779 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:33:18.779 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-11-17T06:33:18.857 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:33:18.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:18.858 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.928 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:18.929 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:33:19.076 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:19.139 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:33:19.140 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:19.141 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:19.142 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:19.142 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:19.142 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:33:19.142 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:33:19.142 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:19.143 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.144 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.146 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:33:19.211 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:33:19.212 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:33:19.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-11-17T06:33:19.294 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:19.362 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2023-11-17T06:33:19.362 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2023-11-17T06:33:19.362 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/run/lock 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2023-11-17T06:33:19.363 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:19.364 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/run/rpc_pipefs 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/fs/nfsd 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.366 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.367 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.368 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-11-17T06:33:19.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2023-11-17T06:33:19.395+0000 7ff40c80d640 -1 init, newargv = 0x561d65fd4a00 newargc=15 2023-11-17T06:33:19.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[48323]: starting ceph client 2023-11-17T06:33:19.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[48323]: starting fuse 2023-11-17T06:33:19.418 INFO:teuthology.orchestra.run.smithi100.stdout:49 2023-11-17T06:33:19.419 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:33:19.419 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-11-17T06:33:19.420 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2023-11-17T06:33:19.421 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-11-17T06:33:19.579 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.48323.asok 2023-11-17T06:33:19.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:33:19.600 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48323.asok 2023-11-17T06:33:19.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.600 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48323.asok status 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:33:19.791 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "48323", 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5769, 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5769 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:33:19.792 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1558228336 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1558228336 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5769 192.168.0.1:0/1558228336", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/1558228336", 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-11-17T06:33:19.793 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 30, 2023-11-17T06:33:19.794 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 37, 2023-11-17T06:33:19.794 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:33:19.794 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-11-17T06:33:19.794 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-11-17T06:33:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:19.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.805 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-11-17T06:33:19.806 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.820 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-11-17T06:33:19.821 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.904 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -l subdir/) 2023-11-17T06:33:20.115 INFO:teuthology.orchestra.run.smithi100.stdout:total 50 2023-11-17T06:33:20.115 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 0 2023-11-17T06:33:20.115 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 1 2023-11-17T06:33:20.115 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 10 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 11 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 12 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 13 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 14 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 15 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 16 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 17 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 18 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 19 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 2 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 20 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 22 2023-11-17T06:33:20.116 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 23 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 24 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 25 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 26 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 27 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 28 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 29 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 3 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 30 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 31 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 32 2023-11-17T06:33:20.117 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 33 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 34 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 35 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 36 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 37 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 38 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 39 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 4 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 40 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 41 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 42 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 43 2023-11-17T06:33:20.118 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 44 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 45 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 46 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 47 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 48 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 49 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 5 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 50 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 51 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 52 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 53 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 54 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 55 2023-11-17T06:33:20.119 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 56 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 57 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 58 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 59 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 6 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 60 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 61 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 62 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 63 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 64 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 65 2023-11-17T06:33:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 66 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 67 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 68 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 69 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 7 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 70 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 71 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 72 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 73 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 74 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 75 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 76 2023-11-17T06:33:20.121 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 77 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 78 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 79 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 8 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 80 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 81 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 82 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 83 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 84 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 85 2023-11-17T06:33:20.122 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 86 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 87 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 88 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 89 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:31 9 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 90 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 91 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 92 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 93 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 94 2023-11-17T06:33:20.123 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 95 2023-11-17T06:33:20.124 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 96 2023-11-17T06:33:20.124 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 97 2023-11-17T06:33:20.124 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 98 2023-11-17T06:33:20.124 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:31 99 2023-11-17T06:33:20.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:20.125 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21') 2023-11-17T06:33:20.164 INFO:teuthology.orchestra.run.smithi100.stderr:cat: subdir/21: No such file or directory 2023-11-17T06:33:20.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:20.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-17T06:33:20.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:33:20.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:33:20.306 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-17T06:33:20.307 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:33:20.307 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:20.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 Processor -- start 2023-11-17T06:33:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 -- start start 2023-11-17T06:33:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6e815ca60 0x7ff6e815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80cb620 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e8070390 con 0x7ff6e806bc20 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.547+0000 7ff6ed091700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e8155e10 con 0x7ff6e815ca60 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e7fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff6e80cb9e0 0x7ff6e80cbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51412/0 (socket says 172.21.15.100:51412) 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e7fff700 1 -- 172.21.15.100:0/822512060 learned_addr learned my addr 172.21.15.100:0/822512060 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ec890700 1 --2- 172.21.15.100:0/822512060 >> v2:172.21.15.100:3300/0 conn(0x7ff6e815ca60 0x7ff6e815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e77fe700 1 -- 172.21.15.100:0/822512060 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877378842 0 0) 0x7ff6e80cb620 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e77fe700 1 -- 172.21.15.100:0/822512060 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d40035d0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ec890700 1 -- 172.21.15.100:0/822512060 >> v1:172.21.15.119:6789/0 conn(0x7ff6e806bc20 legacy=0x7ff6e806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ec890700 1 -- 172.21.15.100:0/822512060 >> v1:172.21.15.100:6789/0 conn(0x7ff6e80cb9e0 legacy=0x7ff6e80cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ec890700 1 -- 172.21.15.100:0/822512060 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e806c150 con 0x7ff6e815ca60 2023-11-17T06:33:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ec890700 1 --2- 172.21.15.100:0/822512060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e815ca60 0x7ff6e815bed0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009850 tx=0x7ff6e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e14f5eb6c11077 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e77fe700 1 -- 172.21.15.100:0/822512060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011830 con 0x7ff6e815ca60 2023-11-17T06:33:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e77fe700 1 -- 172.21.15.100:0/822512060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e0011990 con 0x7ff6e815ca60 2023-11-17T06:33:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6e77fe700 1 -- 172.21.15.100:0/822512060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011d40 con 0x7ff6e815ca60 2023-11-17T06:33:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 -- 172.21.15.100:0/822512060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e815ca60 msgr2=0x7ff6e815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 --2- 172.21.15.100:0/822512060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e815ca60 0x7ff6e815bed0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009850 tx=0x7ff6e0009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 -- 172.21.15.100:0/822512060 shutdown_connections 2023-11-17T06:33:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 --2- 172.21.15.100:0/822512060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e815ca60 0x7ff6e815bed0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 -- 172.21.15.100:0/822512060 >> 172.21.15.100:0/822512060 conn(0x7ff6e806a480 msgr2=0x7ff6e806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 -- 172.21.15.100:0/822512060 shutdown_connections 2023-11-17T06:33:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.551+0000 7ff6ed091700 1 -- 172.21.15.100:0/822512060 wait complete. 2023-11-17T06:33:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 Processor -- start 2023-11-17T06:33:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 -- start start 2023-11-17T06:33:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6e806bc20 0x7ff6e814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6e815ca60 0x7ff6e81592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80c3ae0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80c3dc0 con 0x7ff6e806bc20 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ed091700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80c40a0 con 0x7ff6e815ca60 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37398/0 (socket says 172.21.15.100:37398) 2023-11-17T06:33:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6df7fe700 1 -- 172.21.15.100:0/3804311674 learned_addr learned my addr 172.21.15.100:0/3804311674 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:20.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6e7fff700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6e806bc20 0x7ff6e814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6ec890700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6e815ca60 0x7ff6e81592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.555+0000 7ff6df7fe700 1 -- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6e815ca60 msgr2=0x7ff6e81592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6df7fe700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6e815ca60 0x7ff6e81592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6df7fe700 1 -- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6e806bc20 msgr2=0x7ff6e814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6df7fe700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6e806bc20 0x7ff6e814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6df7fe700 1 -- 172.21.15.100:0/3804311674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00094b0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6df7fe700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c500 tx=0x7ff6d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00052d0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0005430 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e80c4380 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00055a0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e80c4660 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8067990 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.559+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6d00038e0 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.563+0000 7ff6e57fa700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 0x7ff6c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.563+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff6d0083210 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.563+0000 7ff6e7fff700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 0x7ff6c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.563+0000 7ff6e7fff700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 0x7ff6c80689d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001560 tx=0x7ff6d8001a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.571+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6d0050670 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.751+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e80b1200 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6e57fa700 1 -- 172.21.15.100:0/3804311674 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16856 (secure 0 0 0) 0x7ff6d0053c90 con 0x7ff6e80cb9e0 2023-11-17T06:33:20.758 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:20.758 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:33:10.144106+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6835/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:20.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 msgr2=0x7ff6c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 0x7ff6c80689d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001560 tx=0x7ff6d8001a90 comp rx=0 tx=0).stop 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 msgr2=0x7ff6e80c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c500 tx=0x7ff6d000c810 comp rx=0 tx=0).stop 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 shutdown_connections 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6e815ca60 0x7ff6e81592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6c8066510 0x7ff6c80689d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e80cb9e0 0x7ff6e80c31d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 --2- 172.21.15.100:0/3804311674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6e806bc20 0x7ff6e814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 >> 172.21.15.100:0/3804311674 conn(0x7ff6e806a480 msgr2=0x7ff6e806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 shutdown_connections 2023-11-17T06:33:20.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.755+0000 7ff6ed091700 1 -- 172.21.15.100:0/3804311674 wait complete. 2023-11-17T06:33:20.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:20.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:20.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.959+0000 7f247268f700 1 Processor -- start 2023-11-17T06:33:20.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 -- start start 2023-11-17T06:33:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f246c0c96a0 0x7f246c15c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 0x7f246c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0ca460 con 0x7f246c0719f0 2023-11-17T06:33:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c06fdb0 con 0x7f246c0c96a0 2023-11-17T06:33:20.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f247268f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c9fc0 con 0x7f246c0cfc00 2023-11-17T06:33:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f2470c2c700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f246c0719f0 0x7f246c06be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51422/0 (socket says 172.21.15.100:51422) 2023-11-17T06:33:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f2470c2c700 1 -- 172.21.15.100:0/2485453928 learned_addr learned my addr 172.21.15.100:0/2485453928 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f246bfff700 1 --2- 172.21.15.100:0/2485453928 >> v2:172.21.15.119:3300/0 conn(0x7f246c0c96a0 0x7f246c15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.963+0000 7f2463fff700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 0x7f246c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246b7fe700 1 -- 172.21.15.100:0/2485453928 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789655307 0 0) 0x7f246c0ca460 con 0x7f246c0719f0 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246b7fe700 1 -- 172.21.15.100:0/2485453928 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24580035d0 con 0x7f246c0719f0 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246bfff700 1 -- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 msgr2=0x7f246c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246bfff700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 0x7f246c0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246bfff700 1 -- 172.21.15.100:0/2485453928 >> v1:172.21.15.100:6789/0 conn(0x7f246c0719f0 legacy=0x7f246c06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246bfff700 1 -- 172.21.15.100:0/2485453928 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c06ffc0 con 0x7f246c0c96a0 2023-11-17T06:33:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f2463fff700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 0x7f246c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246bfff700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c15c350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f245c009850 tx=0x7f245c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892e8ea17a743771 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246b7fe700 1 -- 172.21.15.100:0/2485453928 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011830 con 0x7f246c0c96a0 2023-11-17T06:33:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246b7fe700 1 -- 172.21.15.100:0/2485453928 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c011990 con 0x7f246c0c96a0 2023-11-17T06:33:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f246b7fe700 1 -- 172.21.15.100:0/2485453928 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011d40 con 0x7f246c0c96a0 2023-11-17T06:33:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 -- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 msgr2=0x7f246c15c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c15c350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f245c009850 tx=0x7f245c009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 -- 172.21.15.100:0/2485453928 shutdown_connections 2023-11-17T06:33:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0cfc00 0x7f246c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 --2- 172.21.15.100:0/2485453928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c15c350 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 -- 172.21.15.100:0/2485453928 >> 172.21.15.100:0/2485453928 conn(0x7f246c0cf050 msgr2=0x7f246c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 -- 172.21.15.100:0/2485453928 shutdown_connections 2023-11-17T06:33:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.967+0000 7f247268f700 1 -- 172.21.15.100:0/2485453928 wait complete. 2023-11-17T06:33:20.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 Processor -- start 2023-11-17T06:33:20.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 -- start start 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0719f0 0x7f246c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c45e0 con 0x7f246c0cfc00 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c48c0 con 0x7f246c0c96a0 2023-11-17T06:33:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c4ba0 con 0x7f246c0719f0 2023-11-17T06:33:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37404/0 (socket says 172.21.15.100:37404) 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 -- 172.21.15.100:0/4175300882 learned_addr learned my addr 172.21.15.100:0/4175300882 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f246bfff700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0719f0 0x7f246c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2463fff700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 -- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0719f0 msgr2=0x7f246c147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0719f0 0x7f246c147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 -- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 msgr2=0x7f246c0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c0c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 -- 172.21.15.100:0/4175300882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540094b0 con 0x7f246c0cfc00 2023-11-17T06:33:20.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f2470c2c700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f246400cb40 tx=0x7f246400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400a9e0 con 0x7f246c0cfc00 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400ab40 con 0x7f246c0cfc00 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0094b0 con 0x7f246c0cfc00 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.971+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400ce60 con 0x7f246c0cfc00 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.975+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c0c5160 con 0x7f246c0cfc00 2023-11-17T06:33:20.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.975+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c04eea0 con 0x7f246c0cfc00 2023-11-17T06:33:20.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.975+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f246401b3b0 con 0x7f246c0cfc00 2023-11-17T06:33:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.979+0000 7f24697fa700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 0x7f244c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.979+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2464083ac0 con 0x7f246c0cfc00 2023-11-17T06:33:20.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.979+0000 7f246bfff700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 0x7f244c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.979+0000 7f246bfff700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 0x7f244c0689d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f245c0090b0 tx=0x7f245c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:20.983+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2464050df0 con 0x7f246c0cfc00 2023-11-17T06:33:21.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.159+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f246c06db30 con 0x7f246c0cfc00 2023-11-17T06:33:21.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f24697fa700 1 -- 172.21.15.100:0/4175300882 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2464017020 con 0x7f246c0cfc00 2023-11-17T06:33:21.166 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:33:21.166 INFO:tasks.ceph.mds.a.smithi100.stderr:2023-11-17T06:33:21.163+0000 7fbeb19ad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 msgr2=0x7f244c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 0x7f244c0689d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f245c0090b0 tx=0x7f245c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 msgr2=0x7f246c0b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f246400cb40 tx=0x7f246400cc20 comp rx=0 tx=0).stop 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 shutdown_connections 2023-11-17T06:33:21.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f244c066510 0x7f244c0689d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f246c0cfc00 0x7f246c0b44d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f246c0c96a0 0x7f246c0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 --2- 172.21.15.100:0/4175300882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f246c0719f0 0x7f246c147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 >> 172.21.15.100:0/4175300882 conn(0x7f246c0cf050 msgr2=0x7f246c0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 shutdown_connections 2023-11-17T06:33:21.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.163+0000 7f247268f700 1 -- 172.21.15.100:0/4175300882 wait complete. 2023-11-17T06:33:21.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.379+0000 7f069359e700 1 Processor -- start 2023-11-17T06:33:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.379+0000 7f069359e700 1 -- start start 2023-11-17T06:33:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f069415d360 0x7f0694160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06940cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 0x7f06940b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940d0630 con 0x7f069415d360 2023-11-17T06:33:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940b6250 con 0x7f06940d01a0 2023-11-17T06:33:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940d16c0 con 0x7f06940b8c80 2023-11-17T06:33:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f069415d360 0x7f0694160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f069415d360 0x7f0694160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37418/0 (socket says 172.21.15.100:37418) 2023-11-17T06:33:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 -- 172.21.15.100:0/92507684 learned_addr learned my addr 172.21.15.100:0/92507684 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0692d9d700 1 --2- 172.21.15.100:0/92507684 >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 0x7f06940b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0689d9b700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06940cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 -- 172.21.15.100:0/92507684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 msgr2=0x7f06940cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06940cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 -- 172.21.15.100:0/92507684 >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 msgr2=0x7f06940b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 --2- 172.21.15.100:0/92507684 >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 0x7f06940b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 -- 172.21.15.100:0/92507684 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694161d90 con 0x7f069415d360 2023-11-17T06:33:21.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0692d9d700 1 --2- 172.21.15.100:0/92507684 >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 0x7f06940b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:21.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f069259c700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f069415d360 0x7f0694160ef0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f069408b330 tx=0x7f0684009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d10a8f5cd480ed server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0691d9b700 1 -- 172.21.15.100:0/92507684 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068400ba20 con 0x7f069415d360 2023-11-17T06:33:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0691d9b700 1 -- 172.21.15.100:0/92507684 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068400bb80 con 0x7f069415d360 2023-11-17T06:33:21.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.383+0000 7f0691d9b700 1 -- 172.21.15.100:0/92507684 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684009e60 con 0x7f069415d360 2023-11-17T06:33:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 -- 172.21.15.100:0/92507684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f069415d360 msgr2=0x7f0694160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f069415d360 0x7f0694160ef0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f069408b330 tx=0x7f0684009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 -- 172.21.15.100:0/92507684 shutdown_connections 2023-11-17T06:33:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 --2- 172.21.15.100:0/92507684 >> v2:172.21.15.119:3300/0 conn(0x7f06940d01a0 0x7f06940b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06940cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 --2- 172.21.15.100:0/92507684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f069415d360 0x7f0694160ef0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 -- 172.21.15.100:0/92507684 >> 172.21.15.100:0/92507684 conn(0x7f069406ade0 msgr2=0x7f069406b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 -- 172.21.15.100:0/92507684 shutdown_connections 2023-11-17T06:33:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.387+0000 7f069359e700 1 -- 172.21.15.100:0/92507684 wait complete. 2023-11-17T06:33:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 Processor -- start 2023-11-17T06:33:21.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 -- start start 2023-11-17T06:33:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06941513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 0x7f069415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c7f50 con 0x7f06940d01a0 2023-11-17T06:33:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c79b0 con 0x7f069415d360 2023-11-17T06:33:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c8160 con 0x7f06940b8c80 2023-11-17T06:33:21.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37426/0 (socket says 172.21.15.100:37426) 2023-11-17T06:33:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 -- 172.21.15.100:0/1709100223 learned_addr learned my addr 172.21.15.100:0/1709100223 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f069259c700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06941513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0692d9d700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 0x7f069415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 -- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 msgr2=0x7f06941513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06941513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 -- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 msgr2=0x7f069415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 0x7f069415fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 -- 172.21.15.100:0/1709100223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009570 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0692d9d700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 0x7f069415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.391+0000 7f0689d9b700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f067c00e810 tx=0x7f067c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c013610 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06940c8440 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c013790 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c013b40 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06940c9180 con 0x7f06940d01a0 2023-11-17T06:33:21.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0694067990 con 0x7f06940d01a0 2023-11-17T06:33:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.395+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f067c013ca0 con 0x7f06940d01a0 2023-11-17T06:33:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.399+0000 7f068b7fe700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 0x7f06740689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.399+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f067c083b80 con 0x7f06940d01a0 2023-11-17T06:33:21.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.399+0000 7f069259c700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 0x7f06740689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.399+0000 7f069259c700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 0x7f06740689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0684014040 tx=0x7f0684008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.403+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f067c050ec0 con 0x7f06940d01a0 2023-11-17T06:33:21.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.579+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0694160800 con 0x7f06940d01a0 2023-11-17T06:33:21.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.579+0000 7f068b7fe700 1 -- 172.21.15.100:0/1709100223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f067c021020 con 0x7f06940d01a0 2023-11-17T06:33:21.583 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 msgr2=0x7f06740689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 0x7f06740689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0684014040 tx=0x7f0684008030 comp rx=0 tx=0).stop 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 msgr2=0x7f06940c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f067c00e810 tx=0x7f067c00eb20 comp rx=0 tx=0).stop 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 shutdown_connections 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f069415d360 0x7f069415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0674066510 0x7f06740689d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06940d01a0 0x7f06940c8c40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 --2- 172.21.15.100:0/1709100223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06940b8c80 0x7f06941513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 >> 172.21.15.100:0/1709100223 conn(0x7f069406ade0 msgr2=0x7f06940d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 shutdown_connections 2023-11-17T06:33:21.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.583+0000 7f069359e700 1 -- 172.21.15.100:0/1709100223 wait complete. 2023-11-17T06:33:21.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.779+0000 7f6ad4b90700 1 Processor -- start 2023-11-17T06:33:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 -- start start 2023-11-17T06:33:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ad00ce1e0 0x7f6ad00c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 0x7f6ad00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad006d7b0 con 0x7f6ad00ceb20 2023-11-17T06:33:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad015de80 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ad4b90700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad00cae10 con 0x7f6ad00ca460 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ad00ce1e0 0x7f6ad00c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ad00ce1e0 0x7f6ad00c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37438/0 (socket says 172.21.15.100:37438) 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 -- 172.21.15.100:0/3402607258 learned_addr learned my addr 172.21.15.100:0/3402607258 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6aced9d700 1 --2- 172.21.15.100:0/3402607258 >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 0x7f6ad00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 -- 172.21.15.100:0/3402607258 >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 msgr2=0x7f6ad00ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:21.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 --2- 172.21.15.100:0/3402607258 >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 0x7f6ad00ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 -- 172.21.15.100:0/3402607258 >> v1:172.21.15.119:6789/0 conn(0x7f6ad00ceb20 legacy=0x7f6ad0071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6ace59c700 1 -- 172.21.15.100:0/3402607258 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad006da90 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.783+0000 7f6aced9d700 1 --2- 172.21.15.100:0/3402607258 >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 0x7f6ad00ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ace59c700 1 --2- 172.21.15.100:0/3402607258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ce1e0 0x7f6ad00c9950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6ad015f110 tx=0x7f6ac0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e402bc954f68e7e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6acd59a700 1 -- 172.21.15.100:0/3402607258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000ba20 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6acd59a700 1 -- 172.21.15.100:0/3402607258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac000bb80 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6acd59a700 1 -- 172.21.15.100:0/3402607258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0009e60 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 -- 172.21.15.100:0/3402607258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ce1e0 msgr2=0x7f6ad00c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/3402607258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ce1e0 0x7f6ad00c9950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6ad015f110 tx=0x7f6ac0009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 -- 172.21.15.100:0/3402607258 shutdown_connections 2023-11-17T06:33:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/3402607258 >> v2:172.21.15.119:3300/0 conn(0x7f6ad00ca460 0x7f6ad00ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/3402607258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ce1e0 0x7f6ad00c9950 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 -- 172.21.15.100:0/3402607258 >> 172.21.15.100:0/3402607258 conn(0x7f6ad00cf050 msgr2=0x7f6ad00cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 -- 172.21.15.100:0/3402607258 shutdown_connections 2023-11-17T06:33:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.787+0000 7f6ad4b90700 1 -- 172.21.15.100:0/3402607258 wait complete. 2023-11-17T06:33:21.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 Processor -- start 2023-11-17T06:33:21.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 -- start start 2023-11-17T06:33:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ad00ca460 0x7f6ad01581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ad00ce1e0 0x7f6ad00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00b2090 con 0x7f6ad00ceb20 2023-11-17T06:33:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00b4ae0 con 0x7f6ad00ca460 2023-11-17T06:33:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ad4b90700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01586e0 con 0x7f6ad00ce1e0 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6aced9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6aced9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37448/0 (socket says 172.21.15.100:37448) 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6aced9d700 1 -- 172.21.15.100:0/847318454 learned_addr learned my addr 172.21.15.100:0/847318454 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6ace59c700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ad00ca460 0x7f6ad01581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.791+0000 7f6acdd9b700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ad00ce1e0 0x7f6ad00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 -- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ad00ce1e0 msgr2=0x7f6ad00c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ad00ce1e0 0x7f6ad00c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 -- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ad00ca460 msgr2=0x7f6ad01581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ad00ca460 0x7f6ad01581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 -- 172.21.15.100:0/847318454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac0009570 con 0x7f6ad00ceb20 2023-11-17T06:33:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6aced9d700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800cd80 tx=0x7f6ac800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800f480 con 0x7f6ad00ceb20 2023-11-17T06:33:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800f600 con 0x7f6ad00ceb20 2023-11-17T06:33:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad00b3f60 con 0x7f6ad00ceb20 2023-11-17T06:33:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800f9b0 con 0x7f6ad00ceb20 2023-11-17T06:33:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00b4520 con 0x7f6ad00ceb20 2023-11-17T06:33:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.795+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad004eea0 con 0x7f6ad00ceb20 2023-11-17T06:33:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.799+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ac800b040 con 0x7f6ad00ceb20 2023-11-17T06:33:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.799+0000 7f6abeffd700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 0x7f6ab00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.799+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f6ac8084650 con 0x7f6ad00ceb20 2023-11-17T06:33:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.799+0000 7f6ace59c700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 0x7f6ab00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.799+0000 7f6ace59c700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 0x7f6ab00689d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000c00 tx=0x7f6ac001b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.807+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ac8051980 con 0x7f6ad00ceb20 2023-11-17T06:33:21.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.979+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ad00cdd50 con 0x7f6ad00ceb20 2023-11-17T06:33:21.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.979+0000 7f6abeffd700 1 -- 172.21.15.100:0/847318454 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ac801d020 con 0x7f6ad00ceb20 2023-11-17T06:33:21.984 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:33:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 msgr2=0x7f6ab00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 0x7f6ab00689d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000c00 tx=0x7f6ac001b040 comp rx=0 tx=0).stop 2023-11-17T06:33:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 msgr2=0x7f6ad00ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800cd80 tx=0x7f6ac800a560 comp rx=0 tx=0).stop 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 shutdown_connections 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6ab0066510 0x7f6ab00689d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad00ceb20 0x7f6ad00ccc00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ad00ce1e0 0x7f6ad00c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 --2- 172.21.15.100:0/847318454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ad00ca460 0x7f6ad01581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 >> 172.21.15.100:0/847318454 conn(0x7f6ad00cf050 msgr2=0x7f6ad015a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 shutdown_connections 2023-11-17T06:33:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:21.983+0000 7f6ad4b90700 1 -- 172.21.15.100:0/847318454 wait complete. 2023-11-17T06:33:22.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:22.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.183+0000 7fd139b7c700 1 Processor -- start 2023-11-17T06:33:22.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.183+0000 7fd139b7c700 1 -- start start 2023-11-17T06:33:22.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd139b7c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 0x7fd1340717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd139b7c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1340cb9e0 0x7fd1340cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd139b7c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd134070780 con 0x7fd1340cab60 2023-11-17T06:33:22.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd139b7c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340caff0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd139b7c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340cc3b0 con 0x7fd13415a2a0 2023-11-17T06:33:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1340cb9e0 0x7fd1340cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1340cb9e0 0x7fd1340cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43300/0 (socket says 172.21.15.100:43300) 2023-11-17T06:33:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 -- 172.21.15.100:0/533735699 learned_addr learned my addr 172.21.15.100:0/533735699 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:22.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd138b7a700 1 --2- 172.21.15.100:0/533735699 >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 0x7fd1340717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 -- 172.21.15.100:0/533735699 >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 msgr2=0x7fd1340717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 --2- 172.21.15.100:0/533735699 >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 0x7fd1340717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 -- 172.21.15.100:0/533735699 >> v1:172.21.15.119:6789/0 conn(0x7fd1340cab60 legacy=0x7fd13415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd13937b700 1 -- 172.21.15.100:0/533735699 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13415a680 con 0x7fd1340cb9e0 2023-11-17T06:33:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.187+0000 7fd138b7a700 1 --2- 172.21.15.100:0/533735699 >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 0x7fd1340717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd13937b700 1 --2- 172.21.15.100:0/533735699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1340cbe70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1340cfdc0 tx=0x7fd12c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be73efbb61330f3f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd12b7fe700 1 -- 172.21.15.100:0/533735699 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011830 con 0x7fd1340cb9e0 2023-11-17T06:33:22.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd12b7fe700 1 -- 172.21.15.100:0/533735699 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c011990 con 0x7fd1340cb9e0 2023-11-17T06:33:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd12b7fe700 1 -- 172.21.15.100:0/533735699 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011d20 con 0x7fd1340cb9e0 2023-11-17T06:33:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 -- 172.21.15.100:0/533735699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 msgr2=0x7fd1340cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 --2- 172.21.15.100:0/533735699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1340cbe70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1340cfdc0 tx=0x7fd12c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 -- 172.21.15.100:0/533735699 shutdown_connections 2023-11-17T06:33:22.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 --2- 172.21.15.100:0/533735699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1340cbe70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 --2- 172.21.15.100:0/533735699 >> v2:172.21.15.119:3300/0 conn(0x7fd13415a2a0 0x7fd1340717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 -- 172.21.15.100:0/533735699 >> 172.21.15.100:0/533735699 conn(0x7fd13406a480 msgr2=0x7fd13406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 -- 172.21.15.100:0/533735699 shutdown_connections 2023-11-17T06:33:22.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.191+0000 7fd139b7c700 1 -- 172.21.15.100:0/533735699 wait complete. 2023-11-17T06:33:22.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 Processor -- start 2023-11-17T06:33:22.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 -- start start 2023-11-17T06:33:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1340cab60 0x7fd134154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd13415a2a0 0x7fd1341509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c2ea0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341681e0 con 0x7fd13415a2a0 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd139b7c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c3bd0 con 0x7fd1340cab60 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43308/0 (socket says 172.21.15.100:43308) 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 -- 172.21.15.100:0/2215901763 learned_addr learned my addr 172.21.15.100:0/2215901763 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd138b7a700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1340cab60 0x7fd134154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd13937b700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd13415a2a0 0x7fd1341509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 -- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1340cab60 msgr2=0x7fd134154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1340cab60 0x7fd134154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 -- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd13415a2a0 msgr2=0x7fd1341509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd13415a2a0 0x7fd1341509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.195+0000 7fd12bfff700 1 -- 172.21.15.100:0/2215901763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240094b0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd12bfff700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd130001ed0 tx=0x7fd1300021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130003c20 con 0x7fd1340cb9e0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130003d80 con 0x7fd1340cb9e0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c009570 con 0x7fd1340cb9e0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000ab40 con 0x7fd1340cb9e0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340c30f0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd134067990 con 0x7fd1340cb9e0 2023-11-17T06:33:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.199+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd13000aca0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.203+0000 7fd1297fa700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 0x7fd1200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.203+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd130083f50 con 0x7fd1340cb9e0 2023-11-17T06:33:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.203+0000 7fd138b7a700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 0x7fd1200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.203+0000 7fd138b7a700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 0x7fd1200689d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ae730 tx=0x7fd124009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.207+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd130051320 con 0x7fd1340cb9e0 2023-11-17T06:33:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.391+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd1340b4cd0 con 0x7fd1340cb9e0 2023-11-17T06:33:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.395+0000 7fd1297fa700 1 -- 172.21.15.100:0/2215901763 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v37) v1 ==== 80+0+248 (secure 0 0 0) 0x7fd130054940 con 0x7fd1340cb9e0 2023-11-17T06:33:22.398 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6837/3740073099 2023-11-18T06:33:10.144059+0000 2023-11-17T06:33:22.399 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6835/3740073099 2023-11-18T06:33:10.144059+0000 2023-11-17T06:33:22.399 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6835/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:22.399 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.119:6833/1192926084 2023-11-18T06:31:29.231194+0000 2023-11-17T06:33:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 msgr2=0x7fd1200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 0x7fd1200689d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ae730 tx=0x7fd124009240 comp rx=0 tx=0).stop 2023-11-17T06:33:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 msgr2=0x7fd1341536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd130001ed0 tx=0x7fd1300021e0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 shutdown_connections 2023-11-17T06:33:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd13415a2a0 0x7fd1341509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd120066510 0x7fd1200689d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1340cb9e0 0x7fd1341536c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 --2- 172.21.15.100:0/2215901763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1340cab60 0x7fd134154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 >> 172.21.15.100:0/2215901763 conn(0x7fd13406a480 msgr2=0x7fd1340af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 shutdown_connections 2023-11-17T06:33:22.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:22.399+0000 7fd139b7c700 1 -- 172.21.15.100:0/2215901763 wait complete. 2023-11-17T06:33:22.405 INFO:teuthology.orchestra.run.smithi100.stderr:listed 4 entries 2023-11-17T06:33:22.424 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-11-17T06:33:22.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:22.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:22.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[48323]: fuse finished with error 0 and tester_r 0 2023-11-17T06:33:22.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:22.465 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:33:22.594 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:33:22.594 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:22.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352272k,nr_inodes=4088068,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:22.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:33:22.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:22.619 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-17T06:33:22.642 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-17T06:33:22.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:22.643 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:33:22.644 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:22.669 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352152k,nr_inodes=4088038,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9234 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:22.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:33:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:22.670 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-17T06:33:22.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:22.745 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-17T06:33:22.745 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:33:22.746 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:22.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352272k,nr_inodes=4088068,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:22.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:33:22.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:22.769 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-17T06:33:22.833 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-17T06:33:22.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:22.835 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.007+0000 7fd0e27a5700 1 Processor -- start 2023-11-17T06:33:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.007+0000 7fd0e27a5700 1 -- start start 2023-11-17T06:33:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0e27a5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc1545e0 0x7fd0dc0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0e27a5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0dc071210 0x7fd0dc06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0e27a5700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc15dca0 con 0x7fd0dc06a7e0 2023-11-17T06:33:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0e27a5700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc06ac70 con 0x7fd0dc071210 2023-11-17T06:33:23.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0e27a5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15df80 con 0x7fd0dc1545e0 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0dc071210 0x7fd0dc06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0d37fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0dc071210 0x7fd0dc06a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43312/0 (socket says 172.21.15.100:43312) 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0d37fe700 1 -- 172.21.15.100:0/2643074324 learned_addr learned my addr 172.21.15.100:0/2643074324 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.011+0000 7fd0dbfff700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc1545e0 0x7fd0dc0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0d37fe700 1 -- 172.21.15.100:0/2643074324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc1545e0 msgr2=0x7fd0dc0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0d37fe700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc1545e0 0x7fd0dc0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0d37fe700 1 -- 172.21.15.100:0/2643074324 >> v1:172.21.15.100:6789/0 conn(0x7fd0dc06a7e0 legacy=0x7fd0dc06fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0d37fe700 1 -- 172.21.15.100:0/2643074324 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc15e260 con 0x7fd0dc071210 2023-11-17T06:33:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0d37fe700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc071210 0x7fd0dc06a2a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009910 tx=0x7fd0c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f730238f1623163 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0db7fe700 1 -- 172.21.15.100:0/2643074324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011830 con 0x7fd0dc071210 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0db7fe700 1 -- 172.21.15.100:0/2643074324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4011990 con 0x7fd0dc071210 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0db7fe700 1 -- 172.21.15.100:0/2643074324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011d40 con 0x7fd0dc071210 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 -- 172.21.15.100:0/2643074324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc071210 msgr2=0x7fd0dc06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc071210 0x7fd0dc06a2a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009910 tx=0x7fd0c4009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 -- 172.21.15.100:0/2643074324 shutdown_connections 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc071210 0x7fd0dc06a2a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/2643074324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc1545e0 0x7fd0dc0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 -- 172.21.15.100:0/2643074324 >> 172.21.15.100:0/2643074324 conn(0x7fd0dc06d3e0 msgr2=0x7fd0dc06bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 -- 172.21.15.100:0/2643074324 shutdown_connections 2023-11-17T06:33:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.015+0000 7fd0e27a5700 1 -- 172.21.15.100:0/2643074324 wait complete. 2023-11-17T06:33:23.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 Processor -- start 2023-11-17T06:33:23.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 -- start start 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc06a7e0 0x7fd0dc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0dc1545e0 0x7fd0dc14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc151270 con 0x7fd0dc14abe0 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc153a80 con 0x7fd0dc1545e0 2023-11-17T06:33:23.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.019+0000 7fd0e27a5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc150100 con 0x7fd0dc06a7e0 2023-11-17T06:33:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43316/0 (socket says 172.21.15.100:43316) 2023-11-17T06:33:23.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 -- 172.21.15.100:0/1846365856 learned_addr learned my addr 172.21.15.100:0/1846365856 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0dbfff700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc06a7e0 0x7fd0dc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0d37fe700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0dc1545e0 0x7fd0dc14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 -- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc06a7e0 msgr2=0x7fd0dc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc06a7e0 0x7fd0dc0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 -- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0dc1545e0 msgr2=0x7fd0dc14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0dc1545e0 0x7fd0dc14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 -- 172.21.15.100:0/1846365856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009570 con 0x7fd0dc14abe0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e0d42700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400cc50 tx=0x7fd0d400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003c20 con 0x7fd0dc14abe0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4003d80 con 0x7fd0dc14abe0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400aab0 con 0x7fd0dc14abe0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc1506c0 con 0x7fd0dc14abe0 2023-11-17T06:33:23.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.023+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc150f90 con 0x7fd0dc14abe0 2023-11-17T06:33:23.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.027+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc15daa0 con 0x7fd0dc14abe0 2023-11-17T06:33:23.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.027+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0d400ac10 con 0x7fd0dc14abe0 2023-11-17T06:33:23.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.027+0000 7fd0d97fa700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 0x7fd0bc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.027+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd0d4083e70 con 0x7fd0dc14abe0 2023-11-17T06:33:23.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.031+0000 7fd0dbfff700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 0x7fd0bc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.031+0000 7fd0dbfff700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 0x7fd0bc0689d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009b50 tx=0x7fd0cc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.035+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0d4051230 con 0x7fd0dc14abe0 2023-11-17T06:33:23.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.239+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0dc04eea0 con 0x7fd0dc14abe0 2023-11-17T06:33:23.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.239+0000 7fd0d97fa700 1 -- 172.21.15.100:0/1846365856 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fd0d4054850 con 0x7fd0dc14abe0 2023-11-17T06:33:23.245 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:23.245 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:15.209855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:23.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 msgr2=0x7fd0bc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 0x7fd0bc0689d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009b50 tx=0x7fd0cc009240 comp rx=0 tx=0).stop 2023-11-17T06:33:23.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 msgr2=0x7fd0dc15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400cc50 tx=0x7fd0d400cf60 comp rx=0 tx=0).stop 2023-11-17T06:33:23.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 shutdown_connections 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd0bc066510 0x7fd0bc0689d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0dc14abe0 0x7fd0dc15c410 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0dc1545e0 0x7fd0dc14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 --2- 172.21.15.100:0/1846365856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0dc06a7e0 0x7fd0dc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 >> 172.21.15.100:0/1846365856 conn(0x7fd0dc06d3e0 msgr2=0x7fd0dc0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 shutdown_connections 2023-11-17T06:33:23.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.243+0000 7fd0e27a5700 1 -- 172.21.15.100:0/1846365856 wait complete. 2023-11-17T06:33:23.250 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2023-11-17T06:33:23.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.443+0000 7fb4b5382700 1 Processor -- start 2023-11-17T06:33:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.443+0000 7fb4b5382700 1 -- start start 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b5382700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 0x7fb4b015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b5382700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b00cb620 con 0x7fb4b006bc20 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b5382700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b0070390 con 0x7fb4b00cb9e0 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b5382700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0155e10 con 0x7fb4b015ca60 2023-11-17T06:33:23.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4a77fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb4b006bc20 0x7fb4b006fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33940/0 (socket says 172.21.15.100:33940) 2023-11-17T06:33:23.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4a77fe700 1 -- 172.21.15.100:0/93284760 learned_addr learned my addr 172.21.15.100:0/93284760 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:23.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b4b81700 1 --2- 172.21.15.100:0/93284760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 0x7fb4b015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4af7fe700 1 -- 172.21.15.100:0/93284760 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952481850 0 0) 0x7fb4b00cb620 con 0x7fb4b006bc20 2023-11-17T06:33:23.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4af7fe700 1 -- 172.21.15.100:0/93284760 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb49c0035d0 con 0x7fb4b006bc20 2023-11-17T06:33:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b4b81700 1 -- 172.21.15.100:0/93284760 >> v1:172.21.15.119:6789/0 conn(0x7fb4b00cb9e0 legacy=0x7fb4b00cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b4b81700 1 -- 172.21.15.100:0/93284760 >> v1:172.21.15.100:6789/0 conn(0x7fb4b006bc20 legacy=0x7fb4b006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b4b81700 1 -- 172.21.15.100:0/93284760 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b006c150 con 0x7fb4b015ca60 2023-11-17T06:33:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.447+0000 7fb4b4b81700 1 --2- 172.21.15.100:0/93284760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 0x7fb4b015bed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009dc0 tx=0x7fb4a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27d032d50c69c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4af7fe700 1 -- 172.21.15.100:0/93284760 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800e070 con 0x7fb4b015ca60 2023-11-17T06:33:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4af7fe700 1 -- 172.21.15.100:0/93284760 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a800bb20 con 0x7fb4b015ca60 2023-11-17T06:33:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4af7fe700 1 -- 172.21.15.100:0/93284760 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800be90 con 0x7fb4b015ca60 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 -- 172.21.15.100:0/93284760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 msgr2=0x7fb4b015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 --2- 172.21.15.100:0/93284760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 0x7fb4b015bed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009dc0 tx=0x7fb4a800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 -- 172.21.15.100:0/93284760 shutdown_connections 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 --2- 172.21.15.100:0/93284760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b015ca60 0x7fb4b015bed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 -- 172.21.15.100:0/93284760 >> 172.21.15.100:0/93284760 conn(0x7fb4b006a480 msgr2=0x7fb4b006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 -- 172.21.15.100:0/93284760 shutdown_connections 2023-11-17T06:33:23.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.451+0000 7fb4b5382700 1 -- 172.21.15.100:0/93284760 wait complete. 2023-11-17T06:33:23.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 Processor -- start 2023-11-17T06:33:23.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 -- start start 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b006bc20 0x7fb4b00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 0x7fb4b0150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c7240 con 0x7fb4b015ca60 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c32a0 con 0x7fb4b00cb9e0 2023-11-17T06:33:23.461 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b5382700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c3580 con 0x7fb4b006bc20 2023-11-17T06:33:23.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.455+0000 7fb4b4b81700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43324/0 (socket says 172.21.15.100:43324) 2023-11-17T06:33:23.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 -- 172.21.15.100:0/741075123 learned_addr learned my addr 172.21.15.100:0/741075123 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:23.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4affff700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b006bc20 0x7fb4b00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4a77fe700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 0x7fb4b0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 -- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b006bc20 msgr2=0x7fb4b00c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b006bc20 0x7fb4b00c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 -- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 msgr2=0x7fb4b0150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 0x7fb4b0150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 -- 172.21.15.100:0/741075123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009a70 con 0x7fb4b015ca60 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4a77fe700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 0x7fb4b0150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:23.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b4b81700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009f30 tx=0x7fb4a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8012630 con 0x7fb4b015ca60 2023-11-17T06:33:23.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8012790 con 0x7fb4b015ca60 2023-11-17T06:33:23.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8012b00 con 0x7fb4b015ca60 2023-11-17T06:33:23.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b00c3860 con 0x7fb4b015ca60 2023-11-17T06:33:23.464 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b015e310 con 0x7fb4b015ca60 2023-11-17T06:33:23.465 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.459+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b0067990 con 0x7fb4b015ca60 2023-11-17T06:33:23.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.463+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb4a8012c60 con 0x7fb4b015ca60 2023-11-17T06:33:23.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.463+0000 7fb4ad7fa700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 0x7fb4900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.463+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fb4a8086360 con 0x7fb4b015ca60 2023-11-17T06:33:23.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.463+0000 7fb4affff700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 0x7fb4900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.463+0000 7fb4affff700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 0x7fb4900689d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb4b006fea0 tx=0x7fb4a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.474 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.471+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4a80538f0 con 0x7fb4b015ca60 2023-11-17T06:33:23.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.651+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4b006c6e0 con 0x7fb4b015ca60 2023-11-17T06:33:23.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.655+0000 7fb4ad7fa700 1 -- 172.21.15.100:0/741075123 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16856 (secure 0 0 0) 0x7fb4a8056f10 con 0x7fb4b015ca60 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:33:10.144106+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6835/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 msgr2=0x7fb4900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 0x7fb4900689d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb4b006fea0 tx=0x7fb4a0009040 comp rx=0 tx=0).stop 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 msgr2=0x7fb4b00c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009f30 tx=0x7fb4a8004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 shutdown_connections 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb490066510 0x7fb4900689d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4b015ca60 0x7fb4b00c4ad0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b00cb9e0 0x7fb4b0150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 --2- 172.21.15.100:0/741075123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b006bc20 0x7fb4b00c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 >> 172.21.15.100:0/741075123 conn(0x7fb4b006a480 msgr2=0x7fb4b0157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 shutdown_connections 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.659+0000 7fb4b5382700 1 -- 172.21.15.100:0/741075123 wait complete. 2023-11-17T06:33:23.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:28:43.341030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:00.183428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:00.711479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:23.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:23.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.855+0000 7ff4f17de700 1 Processor -- start 2023-11-17T06:33:23.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.855+0000 7ff4f17de700 1 -- start start 2023-11-17T06:33:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4f17de700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff4ec0d33a0 0x7ff4ec0d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4f17de700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 0x7ff4ec0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4f17de700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec0d3d40 con 0x7ff4ec15d500 2023-11-17T06:33:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4f17de700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec0cf540 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4f17de700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0d20d0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4eaffd700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff4ec15d500 0x7ff4ec0d19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33948/0 (socket says 172.21.15.100:33948) 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1673135239 learned_addr learned my addr 172.21.15.100:0/1673135239 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/1673135239 >> v2:172.21.15.119:3300/0 conn(0x7ff4ec0d33a0 0x7ff4ec0d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4eb7fe700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 0x7ff4ec0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691156677 0 0) 0x7ff4ec0d3d40 con 0x7ff4ec15d500 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d40035d0 con 0x7ff4ec15d500 2023-11-17T06:33:23.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042960839 0 0) 0x7ff4d40035d0 con 0x7ff4ec15d500 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 -- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 msgr2=0x7ff4ec0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 0x7ff4ec0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 -- 172.21.15.100:0/1673135239 >> v1:172.21.15.100:6789/0 conn(0x7ff4ec15d500 legacy=0x7ff4ec0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 -- 172.21.15.100:0/1673135239 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0ce930 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4eb7fe700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 0x7ff4ec0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.859+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec0d33a0 0x7ff4ec0d3800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009850 tx=0x7ff4e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc9a81c85516903b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0017f0 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0004030 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4e9ffb700 1 -- 172.21.15.100:0/1673135239 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00043e0 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 -- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec0d33a0 msgr2=0x7ff4ec0d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec0d33a0 0x7ff4ec0d3800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009850 tx=0x7ff4e0009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 -- 172.21.15.100:0/1673135239 shutdown_connections 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0cf9d0 0x7ff4ec0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 --2- 172.21.15.100:0/1673135239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec0d33a0 0x7ff4ec0d3800 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 -- 172.21.15.100:0/1673135239 >> 172.21.15.100:0/1673135239 conn(0x7ff4ec08ce30 msgr2=0x7ff4ec09c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 -- 172.21.15.100:0/1673135239 shutdown_connections 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.863+0000 7ff4f17de700 1 -- 172.21.15.100:0/1673135239 wait complete. 2023-11-17T06:33:23.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 Processor -- start 2023-11-17T06:33:23.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 -- start start 2023-11-17T06:33:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0d33a0 0x7ff4ec15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec15d500 0x7ff4ec0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0c98d0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec15f310 con 0x7ff4ec15d500 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4f17de700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec15f5f0 con 0x7ff4ec0d33a0 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43334/0 (socket says 172.21.15.100:43334) 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 -- 172.21.15.100:0/3783832724 learned_addr learned my addr 172.21.15.100:0/3783832724 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0d33a0 0x7ff4ec15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eb7fe700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec15d500 0x7ff4ec0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 -- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0d33a0 msgr2=0x7ff4ec15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0d33a0 0x7ff4ec15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 -- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec15d500 msgr2=0x7ff4ec0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec15d500 0x7ff4ec0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.867+0000 7ff4eaffd700 1 -- 172.21.15.100:0/3783832724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009a70 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4eaffd700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c540 tx=0x7ff4dc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0074e0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc007640 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc005a90 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e00094b0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec15fbb0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.871+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec04eea0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.875+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4dc005bf0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.875+0000 7ff4d37fe700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 0x7ff4d80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.875+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff4dc083430 con 0x7ff4ec0cf9d0 2023-11-17T06:33:23.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.875+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 0x7ff4d80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.875+0000 7ff4ea7fc700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 0x7ff4d80689d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00090b0 tx=0x7ff4e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:23.883+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4dc050770 con 0x7ff4ec0cf9d0 2023-11-17T06:33:24.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.055+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4ec08cbd0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:24.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.055+0000 7ff4d37fe700 1 -- 172.21.15.100:0/3783832724 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4dc0170a0 con 0x7ff4ec0cf9d0 2023-11-17T06:33:24.061 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 msgr2=0x7ff4d80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 0x7ff4d80689d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00090b0 tx=0x7ff4e0008030 comp rx=0 tx=0).stop 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 msgr2=0x7ff4ec1f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c540 tx=0x7ff4dc00c850 comp rx=0 tx=0).stop 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 shutdown_connections 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4ec15d500 0x7ff4ec0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4ec0d33a0 0x7ff4ec15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff4d8066510 0x7ff4d80689d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 --2- 172.21.15.100:0/3783832724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4ec0cf9d0 0x7ff4ec1f24d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 >> 172.21.15.100:0/3783832724 conn(0x7ff4ec08ce30 msgr2=0x7ff4ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:24.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 shutdown_connections 2023-11-17T06:33:24.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.059+0000 7ff4f17de700 1 -- 172.21.15.100:0/3783832724 wait complete. 2023-11-17T06:33:24.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 Processor -- start 2023-11-17T06:33:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 -- start start 2023-11-17T06:33:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c15d610 0x7f9f7c0d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0d3c90 con 0x7f9f7c0ce1c0 2023-11-17T06:33:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0ce630 con 0x7f9f7c15d610 2023-11-17T06:33:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f819de700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0d33f0 con 0x7f9f7c0b8af0 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f7affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c15d610 0x7f9f7c0d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f7affd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9f7c15d610 0x7f9f7c0d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43350/0 (socket says 172.21.15.100:43350) 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.267+0000 7f9f7affd700 1 -- 172.21.15.100:0/556288953 learned_addr learned my addr 172.21.15.100:0/556288953 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7a7fc700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7affd700 1 -- 172.21.15.100:0/556288953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0b8af0 msgr2=0x7f9f7c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7affd700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7affd700 1 -- 172.21.15.100:0/556288953 >> v1:172.21.15.119:6789/0 conn(0x7f9f7c0ce1c0 legacy=0x7f9f7c0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7affd700 1 -- 172.21.15.100:0/556288953 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0d36d0 con 0x7f9f7c15d610 2023-11-17T06:33:24.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f7affd700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0d2a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0aa8762d4b2050 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:24.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f79ffb700 1 -- 172.21.15.100:0/556288953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00ba60 con 0x7f9f7c15d610 2023-11-17T06:33:24.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f79ffb700 1 -- 172.21.15.100:0/556288953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c00bbc0 con 0x7f9f7c15d610 2023-11-17T06:33:24.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f79ffb700 1 -- 172.21.15.100:0/556288953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c009e60 con 0x7f9f7c15d610 2023-11-17T06:33:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 -- 172.21.15.100:0/556288953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 msgr2=0x7f9f7c0d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0d2a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 -- 172.21.15.100:0/556288953 shutdown_connections 2023-11-17T06:33:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 --2- 172.21.15.100:0/556288953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0d2a80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 -- 172.21.15.100:0/556288953 >> 172.21.15.100:0/556288953 conn(0x7f9f7c073620 msgr2=0x7f9f7c073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:24.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 -- 172.21.15.100:0/556288953 shutdown_connections 2023-11-17T06:33:24.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.271+0000 7f9f819de700 1 -- 172.21.15.100:0/556288953 wait complete. 2023-11-17T06:33:24.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 Processor -- start 2023-11-17T06:33:24.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 -- start start 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 0x7f9f7c1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cbb70 con 0x7f9f7c15d610 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cbe50 con 0x7f9f7c0b8af0 2023-11-17T06:33:24.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.275+0000 7f9f819de700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cc130 con 0x7f9f7c0ce1c0 2023-11-17T06:33:24.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43354/0 (socket says 172.21.15.100:43354) 2023-11-17T06:33:24.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 -- 172.21.15.100:0/3885866027 learned_addr learned my addr 172.21.15.100:0/3885866027 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:24.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7a7fc700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 0x7f9f7c1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 -- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 msgr2=0x7f9f7c1f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 0x7f9f7c1f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 -- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 msgr2=0x7f9f7c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 -- 172.21.15.100:0/3885866027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009570 con 0x7f9f7c15d610 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7affd700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7a7fc700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 0x7f9f7c1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f7b7fe700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400cb50 tx=0x7f9f7400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74003c20 con 0x7f9f7c15d610 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74003d80 con 0x7f9f7c15d610 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400aa20 con 0x7f9f7c15d610 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c0cc410 con 0x7f9f7c15d610 2023-11-17T06:33:24.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.279+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c0ccc10 con 0x7f9f7c15d610 2023-11-17T06:33:24.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.283+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c0cc930 con 0x7f9f7c15d610 2023-11-17T06:33:24.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.283+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f7400ab80 con 0x7f9f7c15d610 2023-11-17T06:33:24.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.283+0000 7f9f63fff700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 0x7f9f680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:24.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.283+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9f74083ee0 con 0x7f9f7c15d610 2023-11-17T06:33:24.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.283+0000 7f9f7affd700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 0x7f9f680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:24.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.287+0000 7f9f7affd700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 0x7f9f680689d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c000c00 tx=0x7f9f6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:24.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.291+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f7c0cc930 con 0x7f9f7c15d610 2023-11-17T06:33:24.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.463+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f7c0cc930 con 0x7f9f7c15d610 2023-11-17T06:33:24.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f63fff700 1 -- 172.21.15.100:0/3885866027 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f7c0cc930 con 0x7f9f7c15d610 2023-11-17T06:33:24.470 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-11-17T06:33:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 msgr2=0x7f9f680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 0x7f9f680689d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c000c00 tx=0x7f9f6c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:24.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 msgr2=0x7f9f7c0c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:24.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400cb50 tx=0x7f9f7400ce60 comp rx=0 tx=0).stop 2023-11-17T06:33:24.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 shutdown_connections 2023-11-17T06:33:24.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9f68066510 0x7f9f680689d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f7c15d610 0x7f9f7c0c8c50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0ce1c0 0x7f9f7c1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 --2- 172.21.15.100:0/3885866027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c0b8af0 0x7f9f7c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 >> 172.21.15.100:0/3885866027 conn(0x7f9f7c073620 msgr2=0x7f9f7c15e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 shutdown_connections 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:24.467+0000 7f9f819de700 1 -- 172.21.15.100:0/3885866027 wait complete. 2023-11-17T06:33:30.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:30.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:31.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:31.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.203+0000 7f53213ed700 1 Processor -- start 2023-11-17T06:33:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.203+0000 7f53213ed700 1 -- start start 2023-11-17T06:33:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f53213ed700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f531c15b300 0x7f531c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f53213ed700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c0b33e0 con 0x7f531c06bac0 2023-11-17T06:33:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f53213ed700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c0ce2f0 con 0x7f531c0b2f80 2023-11-17T06:33:31.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f53213ed700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c06c0e0 con 0x7f531c15b300 2023-11-17T06:33:31.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f531c15b300 0x7f531c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f531c15b300 0x7f531c0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43370/0 (socket says 172.21.15.100:43370) 2023-11-17T06:33:31.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f5320bec700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f531c06bac0 0x7f531c0cb5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33958/0 (socket says 172.21.15.100:33958) 2023-11-17T06:33:31.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 -- 172.21.15.100:0/1968304865 learned_addr learned my addr 172.21.15.100:0/1968304865 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:31.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 -- 172.21.15.100:0/1968304865 >> v1:172.21.15.119:6789/0 conn(0x7f531c0b2f80 legacy=0x7f531c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 -- 172.21.15.100:0/1968304865 >> v1:172.21.15.100:6789/0 conn(0x7f531c06bac0 legacy=0x7f531c0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 -- 172.21.15.100:0/1968304865 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0cd9c0 con 0x7f531c15b300 2023-11-17T06:33:31.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531bfff700 1 --2- 172.21.15.100:0/1968304865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c15b300 0x7f531c0b2a40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f530c009910 tx=0x7f530c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2a920e990fb815 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531affd700 1 -- 172.21.15.100:0/1968304865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00ba60 con 0x7f531c15b300 2023-11-17T06:33:31.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531affd700 1 -- 172.21.15.100:0/1968304865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c00bbc0 con 0x7f531c15b300 2023-11-17T06:33:31.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.207+0000 7f531affd700 1 -- 172.21.15.100:0/1968304865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c009e60 con 0x7f531c15b300 2023-11-17T06:33:31.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 -- 172.21.15.100:0/1968304865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c15b300 msgr2=0x7f531c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 --2- 172.21.15.100:0/1968304865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c15b300 0x7f531c0b2a40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f530c009910 tx=0x7f530c009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 -- 172.21.15.100:0/1968304865 shutdown_connections 2023-11-17T06:33:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 --2- 172.21.15.100:0/1968304865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c15b300 0x7f531c0b2a40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 -- 172.21.15.100:0/1968304865 >> 172.21.15.100:0/1968304865 conn(0x7f531c06deb0 msgr2=0x7f531c06e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 -- 172.21.15.100:0/1968304865 shutdown_connections 2023-11-17T06:33:31.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.211+0000 7f53213ed700 1 -- 172.21.15.100:0/1968304865 wait complete. 2023-11-17T06:33:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 Processor -- start 2023-11-17T06:33:31.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 -- start start 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f531c06bac0 0x7f531c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f531c15b300 0x7f531c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c155e80 con 0x7f531c0b2f80 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c157740 con 0x7f531c06bac0 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f53213ed700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c157a20 con 0x7f531c15b300 2023-11-17T06:33:31.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43384/0 (socket says 172.21.15.100:43384) 2023-11-17T06:33:31.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 -- 172.21.15.100:0/2973658922 learned_addr learned my addr 172.21.15.100:0/2973658922 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531bfff700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f531c06bac0 0x7f531c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f5320bec700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f531c15b300 0x7f531c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 -- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f531c15b300 msgr2=0x7f531c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f531c15b300 0x7f531c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 -- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f531c06bac0 msgr2=0x7f531c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f531c06bac0 0x7f531c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.215+0000 7f531b7fe700 1 -- 172.21.15.100:0/2973658922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c009570 con 0x7f531c0b2f80 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f531b7fe700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f531000c500 tx=0x7f531000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100052d0 con 0x7f531c0b2f80 2023-11-17T06:33:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310005430 con 0x7f531c0b2f80 2023-11-17T06:33:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c157d00 con 0x7f531c0b2f80 2023-11-17T06:33:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100055a0 con 0x7f531c0b2f80 2023-11-17T06:33:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c1582c0 con 0x7f531c0b2f80 2023-11-17T06:33:31.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c067990 con 0x7f531c0b2f80 2023-11-17T06:33:31.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.219+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f53100038e0 con 0x7f531c0b2f80 2023-11-17T06:33:31.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.223+0000 7f5318ff9700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 0x7f53080689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.223+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5310083440 con 0x7f531c0b2f80 2023-11-17T06:33:31.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.223+0000 7f531bfff700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 0x7f53080689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.223+0000 7f531bfff700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 0x7f53080689d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f530c009860 tx=0x7f530c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.227+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5310050800 con 0x7f531c0b2f80 2023-11-17T06:33:31.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.403+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f531c06d170 con 0x7f531c0b2f80 2023-11-17T06:33:31.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f5318ff9700 1 -- 172.21.15.100:0/2973658922 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5310053e20 con 0x7f531c0b2f80 2023-11-17T06:33:31.409 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 msgr2=0x7f53080689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 0x7f53080689d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f530c009860 tx=0x7f530c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 msgr2=0x7f531c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f531000c500 tx=0x7f531000c8c0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 shutdown_connections 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f531c15b300 0x7f531c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f5308066510 0x7f53080689d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c0b2f80 0x7f531c159ea0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 --2- 172.21.15.100:0/2973658922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f531c06bac0 0x7f531c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 >> 172.21.15.100:0/2973658922 conn(0x7f531c06deb0 msgr2=0x7f531c15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 shutdown_connections 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.407+0000 7f53213ed700 1 -- 172.21.15.100:0/2973658922 wait complete. 2023-11-17T06:33:31.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.599+0000 7ff232f95700 1 Processor -- start 2023-11-17T06:33:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff232f95700 1 -- start start 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff232f95700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff22c06bc20 0x7ff22c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff232f95700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0cb620 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff232f95700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c06c150 con 0x7ff22c15ca60 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff232f95700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c155e10 con 0x7ff22c06bc20 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff231f93700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff22c0cb9e0 0x7ff22c0cbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33968/0 (socket says 172.21.15.100:33968) 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff231f93700 1 -- 172.21.15.100:0/4045304851 learned_addr learned my addr 172.21.15.100:0/4045304851 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff231792700 1 --2- 172.21.15.100:0/4045304851 >> v2:172.21.15.119:3300/0 conn(0x7ff22c06bc20 0x7ff22c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779992709 0 0) 0x7ff22c0cb620 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2180035d0 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892963537 0 0) 0x7ff22c06c150 con 0x7ff22c15ca60 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22c0cb620 con 0x7ff22c15ca60 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427458575 0 0) 0x7ff2180035d0 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 >> v2:172.21.15.119:3300/0 conn(0x7ff22c06bc20 msgr2=0x7ff22c06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 --2- 172.21.15.100:0/4045304851 >> v2:172.21.15.119:3300/0 conn(0x7ff22c06bc20 0x7ff22c06fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 >> v1:172.21.15.119:6789/0 conn(0x7ff22c15ca60 legacy=0x7ff22c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c06c430 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7ff228001670 con 0x7ff22c0cb9e0 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.603+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 >> v1:172.21.15.100:6789/0 conn(0x7ff22c0cb9e0 legacy=0x7ff22c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218003c70 0x7ff218004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 0x7ff218004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218005230 0x7ff21800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800c1a0 con 0x7ff218004870 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800c310 con 0x7ff218003c70 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800c4d0 con 0x7ff218005230 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 0x7ff218004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231f93700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218003c70 0x7ff218004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232794700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218005230 0x7ff21800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 -- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218005230 msgr2=0x7ff21800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218005230 0x7ff21800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 -- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218003c70 msgr2=0x7ff218004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218003c70 0x7ff218004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232794700 1 -- 172.21.15.100:0/4045304851 reap_dead start 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 -- 172.21.15.100:0/4045304851 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180035d0 con 0x7ff218004870 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231f93700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff218003c70 0x7ff218004070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff231792700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 0x7ff218004cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009b70 tx=0x7ff2180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354e8269956e68f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00e6c0 con 0x7ff218004870 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00e820 con 0x7ff218004870 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff230f91700 1 -- 172.21.15.100:0/4045304851 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00eb90 con 0x7ff218004870 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 -- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 msgr2=0x7ff218004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 0x7ff218004cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009b70 tx=0x7ff2180058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 -- 172.21.15.100:0/4045304851 shutdown_connections 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 --2- 172.21.15.100:0/4045304851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff218004870 0x7ff218004cf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 -- 172.21.15.100:0/4045304851 >> 172.21.15.100:0/4045304851 conn(0x7ff22c06a480 msgr2=0x7ff22c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.607+0000 7ff232f95700 1 -- 172.21.15.100:0/4045304851 shutdown_connections 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 -- 172.21.15.100:0/4045304851 wait complete. 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 Processor -- start 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 -- start start 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218004870 0x7ff22c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff22c1f03b0 0x7ff22c1f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c15a5b0 con 0x7ff22c1f0830 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0c54e0 con 0x7ff22c1f03b0 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232f95700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c1f4cb0 con 0x7ff218004870 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.611+0000 7ff232794700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43392/0 (socket says 172.21.15.100:43392) 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 -- 172.21.15.100:0/2110774682 learned_addr learned my addr 172.21.15.100:0/2110774682 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff231792700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff22c1f03b0 0x7ff22c1f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff231f93700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218004870 0x7ff22c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 -- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218004870 msgr2=0x7ff22c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218004870 0x7ff22c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 -- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff22c1f03b0 msgr2=0x7ff22c1f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff22c1f03b0 0x7ff22c1f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 -- 172.21.15.100:0/2110774682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c159ef0 con 0x7ff22c1f0830 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232794700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0cec90 tx=0x7ff22400d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400fed0 con 0x7ff22c1f0830 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400dd70 con 0x7ff22c1f0830 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c15a1d0 con 0x7ff22c1f0830 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224003c40 con 0x7ff22c1f0830 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c0c9ac0 con 0x7ff22c1f0830 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.615+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c15a6f0 con 0x7ff22c1f0830 2023-11-17T06:33:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.619+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff2240050d0 con 0x7ff22c1f0830 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.619+0000 7ff2227fc700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 0x7ff2100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.619+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff224084220 con 0x7ff22c1f0830 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.619+0000 7ff231f93700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 0x7ff2100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.619+0000 7ff231f93700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 0x7ff2100689d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff228001050 tx=0x7ff228009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.623+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff22c15a6f0 con 0x7ff22c1f0830 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.835+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff22c15a6f0 con 0x7ff22c1f0830 2023-11-17T06:33:31.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff2227fc700 1 -- 172.21.15.100:0/2110774682 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4926 (secure 0 0 0) 0x7ff22c15a6f0 con 0x7ff22c1f0830 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:15.209855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 msgr2=0x7ff2100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 0x7ff2100689d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff228001050 tx=0x7ff228009040 comp rx=0 tx=0).stop 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 msgr2=0x7ff22c1f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0cec90 tx=0x7ff22400d660 comp rx=0 tx=0).stop 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 shutdown_connections 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff210066510 0x7ff2100689d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff22c1f0830 0x7ff22c1f4680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff22c1f03b0 0x7ff22c1f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 --2- 172.21.15.100:0/2110774682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff218004870 0x7ff22c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.839+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 >> 172.21.15.100:0/2110774682 conn(0x7ff22c06a480 msgr2=0x7ff22c15ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.843+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 shutdown_connections 2023-11-17T06:33:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:31.843+0000 7ff232f95700 1 -- 172.21.15.100:0/2110774682 wait complete. 2023-11-17T06:33:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2023-11-17T06:33:31.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:32.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 Processor -- start 2023-11-17T06:33:32.036 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 -- start start 2023-11-17T06:33:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 0x7fbd980cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd9806bc20 0x7fbd9806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9815ca60 0x7fbd9815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd98155e10 con 0x7fbd9806bc20 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd980cb620 con 0x7fbd980cb9e0 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.031+0000 7fbd9efa6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980cc300 con 0x7fbd9815ca60 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd9806bc20 0x7fbd9806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd9806bc20 0x7fbd9806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59234/0 (socket says 172.21.15.100:59234) 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 -- 172.21.15.100:0/719714422 learned_addr learned my addr 172.21.15.100:0/719714422 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/719714422 >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 0x7fbd980cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9e7a5700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9815ca60 0x7fbd9815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 -- 172.21.15.100:0/719714422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9815ca60 msgr2=0x7fbd9815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9815ca60 0x7fbd9815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 -- 172.21.15.100:0/719714422 >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 msgr2=0x7fbd980cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 --2- 172.21.15.100:0/719714422 >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 0x7fbd980cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 -- 172.21.15.100:0/719714422 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9806c150 con 0x7fbd9806bc20 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/719714422 >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 0x7fbd980cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9d7a3700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9806bc20 0x7fbd9806fc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbd9806dff0 tx=0x7fbd88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c280d7bc2a3d09 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9cfa2700 1 -- 172.21.15.100:0/719714422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88011830 con 0x7fbd9806bc20 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9cfa2700 1 -- 172.21.15.100:0/719714422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd88011990 con 0x7fbd9806bc20 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9cfa2700 1 -- 172.21.15.100:0/719714422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88011d20 con 0x7fbd9806bc20 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 -- 172.21.15.100:0/719714422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9806bc20 msgr2=0x7fbd9806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9806bc20 0x7fbd9806fc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbd9806dff0 tx=0x7fbd88009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 -- 172.21.15.100:0/719714422 shutdown_connections 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9815ca60 0x7fbd9815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/719714422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9806bc20 0x7fbd9806fc80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/719714422 >> v2:172.21.15.119:3300/0 conn(0x7fbd980cb9e0 0x7fbd980cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 -- 172.21.15.100:0/719714422 >> 172.21.15.100:0/719714422 conn(0x7fbd9806a480 msgr2=0x7fbd9806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 -- 172.21.15.100:0/719714422 shutdown_connections 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.035+0000 7fbd9efa6700 1 -- 172.21.15.100:0/719714422 wait complete. 2023-11-17T06:33:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.039+0000 7fbd9efa6700 1 Processor -- start 2023-11-17T06:33:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.039+0000 7fbd9efa6700 1 -- start start 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 0x7fbd981f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd980cb9e0 0x7fbd980c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9814da80 con 0x7fbd9815ca60 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980c57b0 con 0x7fbd980cb9e0 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980c5550 con 0x7fbd9806bc20 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59242/0 (socket says 172.21.15.100:59242) 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 -- 172.21.15.100:0/3032383428 learned_addr learned my addr 172.21.15.100:0/3032383428 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9d7a3700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd980cb9e0 0x7fbd980c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 0x7fbd981f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 -- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 msgr2=0x7fbd981f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 0x7fbd981f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 -- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd980cb9e0 msgr2=0x7fbd980c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd980cb9e0 0x7fbd980c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 -- 172.21.15.100:0/3032383428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88009570 con 0x7fbd9815ca60 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 0x7fbd981f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9e7a5700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000efc0 tx=0x7fbd9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90009ea0 con 0x7fbd9815ca60 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000f040 con 0x7fbd9815ca60 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd980c7780 con 0x7fbd9815ca60 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90014480 con 0x7fbd9815ca60 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.043+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd980c2c70 con 0x7fbd9815ca60 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.047+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9806c6f0 con 0x7fbd9815ca60 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.047+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd900145e0 con 0x7fbd9815ca60 2023-11-17T06:33:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.047+0000 7fbd8e7fc700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 0x7fbd7c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.047+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbd900847b0 con 0x7fbd9815ca60 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.047+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 0x7fbd7c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.051+0000 7fbd9dfa4700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 0x7fbd7c0689d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbd94003950 tx=0x7fbd94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.055+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd9806c6f0 con 0x7fbd9815ca60 2023-11-17T06:33:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.227+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd9806c6f0 con 0x7fbd9815ca60 2023-11-17T06:33:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd8e7fc700 1 -- 172.21.15.100:0/3032383428 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16856 (secure 0 0 0) 0x7fbd9806c6f0 con 0x7fbd9815ca60 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:33:10.144106+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6835/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 msgr2=0x7fbd7c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 0x7fbd7c0689d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbd94003950 tx=0x7fbd94008040 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 msgr2=0x7fbd980c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000efc0 tx=0x7fbd9000c3a0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 shutdown_connections 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fbd7c066510 0x7fbd7c0689d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd9815ca60 0x7fbd980c7240 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd980cb9e0 0x7fbd980c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 --2- 172.21.15.100:0/3032383428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd9806bc20 0x7fbd981f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 >> 172.21.15.100:0/3032383428 conn(0x7fbd9806a480 msgr2=0x7fbd980c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 shutdown_connections 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.231+0000 7fbd9efa6700 1 -- 172.21.15.100:0/3032383428 wait complete. 2023-11-17T06:33:32.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:33:32.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.423+0000 7f0d25a56700 1 Processor -- start 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.423+0000 7f0d25a56700 1 -- start start 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d25a56700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d20071210 0x7f0d2006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d25a56700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200b3e00 con 0x7f0d2006a7e0 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d25a56700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2015dca0 con 0x7f0d201545e0 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d25a56700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2006ac70 con 0x7f0d20071210 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1f7fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0d2006a7e0 0x7f0d200b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48202/0 (socket says 172.21.15.100:48202) 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/71459286 learned_addr learned my addr 172.21.15.100:0/71459286 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d167fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d20071210 0x7f0d2006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111325207 0 0) 0x7f0d200b3e00 con 0x7f0d2006a7e0 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c0035d0 con 0x7f0d2006a7e0 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886351717 0 0) 0x7f0d2015dca0 con 0x7f0d201545e0 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d200b3e00 con 0x7f0d201545e0 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043862133 0 0) 0x7f0d0c0035d0 con 0x7f0d2006a7e0 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d20071210 msgr2=0x7f0d2006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d20071210 0x7f0d2006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 >> v1:172.21.15.119:6789/0 conn(0x7f0d201545e0 legacy=0x7f0d200b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2015df80 con 0x7f0d2006a7e0 2023-11-17T06:33:32.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f0d18001a10 con 0x7f0d2006a7e0 2023-11-17T06:33:32.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 >> v1:172.21.15.100:6789/0 conn(0x7f0d2006a7e0 legacy=0x7f0d200b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c003c50 0x7f0d0c004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c004870 0x7f0d0c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d0c0052a0 0x7f0d0c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2006ac70 con 0x7f0d0c003c50 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00e230 con 0x7f0d0c004870 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00e3f0 con 0x7f0d0c0052a0 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1effd700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c003c50 0x7f0d0c004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d167fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c004870 0x7f0d0c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.427+0000 7f0d1f7fe700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d0c0052a0 0x7f0d0c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 -- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d0c0052a0 msgr2=0x7f0d0c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d0c0052a0 0x7f0d0c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 -- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c004870 msgr2=0x7f0d0c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c004870 0x7f0d0c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 -- 172.21.15.100:0/71459286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0035d0 con 0x7f0d0c003c50 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d167fc700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c004870 0x7f0d0c004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1effd700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c003c50 0x7f0d0c004050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001960 tx=0x7f0d0c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feb7277b5a2e115 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10001450 con 0x7f0d0c003c50 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d100052f0 con 0x7f0d0c003c50 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1e7fc700 1 -- 172.21.15.100:0/71459286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100036a0 con 0x7f0d0c003c50 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 -- 172.21.15.100:0/71459286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c003c50 msgr2=0x7f0d0c004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 --2- 172.21.15.100:0/71459286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c003c50 0x7f0d0c004050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d10001960 tx=0x7f0d0c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/71459286 reap_dead start 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 -- 172.21.15.100:0/71459286 shutdown_connections 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 -- 172.21.15.100:0/71459286 >> 172.21.15.100:0/71459286 conn(0x7f0d2006d3e0 msgr2=0x7f0d2006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 -- 172.21.15.100:0/71459286 shutdown_connections 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.431+0000 7f0d25a56700 1 -- 172.21.15.100:0/71459286 wait complete. 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.435+0000 7f0d25a56700 1 Processor -- start 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.435+0000 7f0d25a56700 1 -- start start 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c003c50 0x7f0d2014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 0x7f0d2014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201504b0 con 0x7f0d2014c6d0 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20151f60 con 0x7f0d0c003c50 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201f6990 con 0x7f0d2014faf0 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59254/0 (socket says 172.21.15.100:59254) 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/522659979 learned_addr learned my addr 172.21.15.100:0/522659979 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d167fc700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 0x7f0d2014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1effd700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c003c50 0x7f0d2014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 msgr2=0x7f0d2014ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 0x7f0d2014ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c003c50 msgr2=0x7f0d2014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c003c50 0x7f0d2014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 -- 172.21.15.100:0/522659979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d201f6e20 con 0x7f0d2014c6d0 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d167fc700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 0x7f0d2014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1f7fe700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0d200b3f90 tx=0x7f0d18001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800a910 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800aa90 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800ae40 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2014d320 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201f60a0 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.439+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2004eea0 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.443+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d1801d460 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.443+0000 7f0d1cff9700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 0x7f0d000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.443+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0d18084180 con 0x7f0d2014c6d0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.443+0000 7f0d1effd700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 0x7f0d000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.447+0000 7f0d1effd700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 0x7f0d000689d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d201f5ed0 tx=0x7f0d1000a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.451+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d180515e0 con 0x7f0d2014c6d0 2023-11-17T06:33:32.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.663+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d20070ca0 con 0x7f0d2014c6d0 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d1cff9700 1 -- 172.21.15.100:0/522659979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f0d18054c00 con 0x7f0d2014c6d0 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:15.209855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:32.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 msgr2=0x7f0d000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 0x7f0d000689d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d201f5ed0 tx=0x7f0d1000a000 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 msgr2=0x7f0d2014cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0d200b3f90 tx=0x7f0d18001a40 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 shutdown_connections 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0d00066510 0x7f0d000689d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d2014c6d0 0x7f0d2014cb50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d2014faf0 0x7f0d2014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 --2- 172.21.15.100:0/522659979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d0c003c50 0x7f0d2014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 >> 172.21.15.100:0/522659979 conn(0x7f0d2006d3e0 msgr2=0x7f0d2014ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 shutdown_connections 2023-11-17T06:33:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.667+0000 7f0d25a56700 1 -- 172.21.15.100:0/522659979 wait complete. 2023-11-17T06:33:32.675 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2023-11-17T06:33:32.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.859+0000 7f0bf6663700 1 Processor -- start 2023-11-17T06:33:32.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.859+0000 7f0bf6663700 1 -- start start 2023-11-17T06:33:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf6663700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf6663700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0bf0160f40 0x7f0bf00d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf6663700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf00d21b0 con 0x7f0bf00d10d0 2023-11-17T06:33:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf6663700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf00b04d0 con 0x7f0bf0160f40 2023-11-17T06:33:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf6663700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00d0710 con 0x7f0bf0160b60 2023-11-17T06:33:32.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0beffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bef7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0bf0160f40 0x7f0bf00d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf4c00700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0bf00d10d0 0x7f0bf00cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:53930/0 (socket says 172.21.15.100:53930) 2023-11-17T06:33:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bf4c00700 1 -- 172.21.15.100:0/2903080056 learned_addr learned my addr 172.21.15.100:0/2903080056 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bef7fe700 1 -- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 msgr2=0x7f0bf00d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bef7fe700 1 --2- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bef7fe700 1 -- 172.21.15.100:0/2903080056 >> v1:172.21.15.119:6789/0 conn(0x7f0bf00d10d0 legacy=0x7f0bf00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.863+0000 7f0bef7fe700 1 -- 172.21.15.100:0/2903080056 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00d09f0 con 0x7f0bf0160f40 2023-11-17T06:33:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bef7fe700 1 --2- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf0160f40 0x7f0bf00d1c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009850 tx=0x7f0be4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10bd05a310865cf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0beeffd700 1 -- 172.21.15.100:0/2903080056 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0bf0160f40 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0beeffd700 1 -- 172.21.15.100:0/2903080056 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0bf0160f40 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0beeffd700 1 -- 172.21.15.100:0/2903080056 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011d40 con 0x7f0bf0160f40 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 -- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf0160f40 msgr2=0x7f0bf00d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 --2- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf0160f40 0x7f0bf00d1c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009850 tx=0x7f0be4009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 -- 172.21.15.100:0/2903080056 shutdown_connections 2023-11-17T06:33:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 --2- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf0160f40 0x7f0bf00d1c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 --2- 172.21.15.100:0/2903080056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 -- 172.21.15.100:0/2903080056 >> 172.21.15.100:0/2903080056 conn(0x7f0bf00d31d0 msgr2=0x7f0bf00d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 -- 172.21.15.100:0/2903080056 shutdown_connections 2023-11-17T06:33:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 -- 172.21.15.100:0/2903080056 wait complete. 2023-11-17T06:33:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.867+0000 7f0bf6663700 1 Processor -- start 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 -- start start 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf00d10d0 0x7f0bf015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00ccf90 con 0x7f0bf00ccae0 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00b8170 con 0x7f0bf00d10d0 2023-11-17T06:33:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf6663700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00c6490 con 0x7f0bf0160b60 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59258/0 (socket says 172.21.15.100:59258) 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 -- 172.21.15.100:0/1767773764 learned_addr learned my addr 172.21.15.100:0/1767773764 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bef7fe700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0beffff700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf00d10d0 0x7f0bf015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 -- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 msgr2=0x7f0bf00cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 -- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf00d10d0 msgr2=0x7f0bf015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf00d10d0 0x7f0bf015c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 -- 172.21.15.100:0/1767773764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40094b0 con 0x7f0bf00ccae0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0bf4c00700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0be800cbc0 tx=0x7f0be800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8007480 con 0x7f0bf00ccae0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.871+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80075e0 con 0x7f0bf00ccae0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.875+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf00b7560 con 0x7f0bf00ccae0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.875+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8007950 con 0x7f0bf00ccae0 2023-11-17T06:33:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.875+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf00b7b20 con 0x7f0bf00ccae0 2023-11-17T06:33:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.875+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf00b8320 con 0x7f0bf00ccae0 2023-11-17T06:33:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.875+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0be8012400 con 0x7f0bf00ccae0 2023-11-17T06:33:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.879+0000 7f0becff9700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 0x7f0bdc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.879+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0be8083550 con 0x7f0bf00ccae0 2023-11-17T06:33:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.879+0000 7f0beffff700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 0x7f0bdc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.879+0000 7f0beffff700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 0x7f0bdc068a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009bf0 tx=0x7f0be0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:32.883+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bf00b8320 con 0x7f0bf00ccae0 2023-11-17T06:33:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.091+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bf00d21b0 con 0x7f0bf00ccae0 2023-11-17T06:33:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.091+0000 7f0becff9700 1 -- 172.21.15.100:0/1767773764 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f0bf00d21b0 con 0x7f0bf00ccae0 2023-11-17T06:33:33.097 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:33.097 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:01.702360+0000","modified":"2023-11-17T06:33:15.209855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/3260089866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3260089866},{"type":"v1","addr":"172.21.15.100:6837","nonce":3260089866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 msgr2=0x7f0bdc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 0x7f0bdc068a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009bf0 tx=0x7f0be0009240 comp rx=0 tx=0).stop 2023-11-17T06:33:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 msgr2=0x7f0bf0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0be800cbc0 tx=0x7f0be800cbf0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 shutdown_connections 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0bdc066540 0x7f0bdc068a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf00ccae0 0x7f0bf0159aa0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bf0160b60 0x7f0bf00cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 --2- 172.21.15.100:0/1767773764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bf00d10d0 0x7f0bf015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 >> 172.21.15.100:0/1767773764 conn(0x7f0bf00d31d0 msgr2=0x7f0bf006c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 shutdown_connections 2023-11-17T06:33:33.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.095+0000 7f0bf6663700 1 -- 172.21.15.100:0/1767773764 wait complete. 2023-11-17T06:33:33.102 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2023-11-17T06:33:33.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.283+0000 7f44234ec700 1 Processor -- start 2023-11-17T06:33:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.283+0000 7f44234ec700 1 -- start start 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44234ec700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f441c071810 0x7f441c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44234ec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44234ec700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c06e970 con 0x7f441c15e600 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44234ec700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c06ac30 con 0x7f441c071810 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44234ec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0ce0e0 con 0x7f441c06a2a0 2023-11-17T06:33:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f441c071810 0x7f441c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f441c071810 0x7f441c15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59266/0 (socket says 172.21.15.100:59266) 2023-11-17T06:33:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4422ceb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44224ea700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f441c15e600 0x7f441c15c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:53944/0 (socket says 172.21.15.100:53944) 2023-11-17T06:33:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 -- 172.21.15.100:0/3681143720 learned_addr learned my addr 172.21.15.100:0/3681143720 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 -- 172.21.15.100:0/3681143720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 msgr2=0x7f441c06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 --2- 172.21.15.100:0/3681143720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c06a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 -- 172.21.15.100:0/3681143720 >> v1:172.21.15.119:6789/0 conn(0x7f441c15e600 legacy=0x7f441c15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 -- 172.21.15.100:0/3681143720 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c071cd0 con 0x7f441c071810 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f4421ce9700 1 --2- 172.21.15.100:0/3681143720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c15c8d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f440c009910 tx=0x7f440c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40650e2ed3792d97 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44214e8700 1 -- 172.21.15.100:0/3681143720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c011830 con 0x7f441c071810 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44214e8700 1 -- 172.21.15.100:0/3681143720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c011990 con 0x7f441c071810 2023-11-17T06:33:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.287+0000 7f44214e8700 1 -- 172.21.15.100:0/3681143720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c011d40 con 0x7f441c071810 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- 172.21.15.100:0/3681143720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 msgr2=0x7f441c15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 --2- 172.21.15.100:0/3681143720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c15c8d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f440c009910 tx=0x7f440c009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- 172.21.15.100:0/3681143720 shutdown_connections 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 --2- 172.21.15.100:0/3681143720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 --2- 172.21.15.100:0/3681143720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c15c8d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- 172.21.15.100:0/3681143720 >> 172.21.15.100:0/3681143720 conn(0x7f441c0b1a00 msgr2=0x7f441c0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- 172.21.15.100:0/3681143720 shutdown_connections 2023-11-17T06:33:33.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- 172.21.15.100:0/3681143720 wait complete. 2023-11-17T06:33:33.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 Processor -- start 2023-11-17T06:33:33.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.291+0000 7f44234ec700 1 -- start start 2023-11-17T06:33:33.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c15e600 0x7f441c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c157200 con 0x7f441c071810 2023-11-17T06:33:33.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c153fe0 con 0x7f441c15e600 2023-11-17T06:33:33.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c7cb0 con 0x7f441c06a2a0 2023-11-17T06:33:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59272/0 (socket says 172.21.15.100:59272) 2023-11-17T06:33:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 -- 172.21.15.100:0/612386393 learned_addr learned my addr 172.21.15.100:0/612386393 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:33.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44224ea700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4422ceb700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c15e600 0x7f441c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 -- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 msgr2=0x7f441c153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 -- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c15e600 msgr2=0x7f441c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c15e600 0x7f441c0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 -- 172.21.15.100:0/612386393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c009570 con 0x7f441c071810 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4421ce9700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f440c000c00 tx=0x7f440c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c004610 con 0x7f441c071810 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c0036c0 con 0x7f441c071810 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c003a50 con 0x7f441c071810 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0c7f90 con 0x7f441c071810 2023-11-17T06:33:33.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c156e20 con 0x7f441c071810 2023-11-17T06:33:33.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.295+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c157340 con 0x7f441c071810 2023-11-17T06:33:33.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.299+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f440c003bb0 con 0x7f441c071810 2023-11-17T06:33:33.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.299+0000 7f4412ffd700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 0x7f44000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.299+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f440c021030 con 0x7f441c071810 2023-11-17T06:33:33.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.299+0000 7f44224ea700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 0x7f44000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.299+0000 7f44224ea700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 0x7f44000689d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4418000fb0 tx=0x7f4418007d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.307+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f441c157340 con 0x7f441c071810 2023-11-17T06:33:33.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.479+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f441c157340 con 0x7f441c071810 2023-11-17T06:33:33.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.479+0000 7f4412ffd700 1 -- 172.21.15.100:0/612386393 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16856 (secure 0 0 0) 0x7f441c157340 con 0x7f441c071810 2023-11-17T06:33:33.486 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:33.486 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:33:10.144106+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:00.183428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:00.711479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6835/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 msgr2=0x7f44000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 0x7f44000689d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4418000fb0 tx=0x7f4418007d00 comp rx=0 tx=0).stop 2023-11-17T06:33:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 msgr2=0x7f441c0c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f440c000c00 tx=0x7f440c004770 comp rx=0 tx=0).stop 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 shutdown_connections 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c15e600 0x7f441c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f4400066510 0x7f44000689d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441c071810 0x7f441c0c86c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 --2- 172.21.15.100:0/612386393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f441c06a2a0 0x7f441c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 >> 172.21.15.100:0/612386393 conn(0x7f441c0b1a00 msgr2=0x7f441c0b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 shutdown_connections 2023-11-17T06:33:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.483+0000 7f44234ec700 1 -- 172.21.15.100:0/612386393 wait complete. 2023-11-17T06:33:33.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:33:33.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.691+0000 7fba758ba700 1 Processor -- start 2023-11-17T06:33:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.691+0000 7fba758ba700 1 -- start start 2023-11-17T06:33:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba758ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 0x7fba700cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba758ba700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700cb620 con 0x7fba7015ca60 2023-11-17T06:33:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba758ba700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba70070390 con 0x7fba7006bc20 2023-11-17T06:33:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba758ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70155e10 con 0x7fba700cb9e0 2023-11-17T06:33:33.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6f7fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fba7015ca60 0x7fba7015bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48208/0 (socket says 172.21.15.100:48208) 2023-11-17T06:33:33.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6f7fe700 1 -- 172.21.15.100:0/1555410340 learned_addr learned my addr 172.21.15.100:0/1555410340 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:33.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6effd700 1 --2- 172.21.15.100:0/1555410340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 0x7fba700cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055191506 0 0) 0x7fba700cb620 con 0x7fba7015ca60 2023-11-17T06:33:33.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0035d0 con 0x7fba7015ca60 2023-11-17T06:33:33.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944660208 0 0) 0x7fba70070390 con 0x7fba7006bc20 2023-11-17T06:33:33.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba700cb620 con 0x7fba7006bc20 2023-11-17T06:33:33.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6effd700 1 -- 172.21.15.100:0/1555410340 >> v1:172.21.15.119:6789/0 conn(0x7fba7006bc20 legacy=0x7fba7006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6effd700 1 -- 172.21.15.100:0/1555410340 >> v1:172.21.15.100:6789/0 conn(0x7fba7015ca60 legacy=0x7fba7015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6effd700 1 -- 172.21.15.100:0/1555410340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700cc300 con 0x7fba700cb9e0 2023-11-17T06:33:33.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.695+0000 7fba6effd700 1 --2- 172.21.15.100:0/1555410340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 0x7fba700cbdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba60009880 tx=0x7fba60009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2633b19a7ed410a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60011830 con 0x7fba700cb9e0 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60011990 con 0x7fba700cb9e0 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba6e7fc700 1 -- 172.21.15.100:0/1555410340 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60011d00 con 0x7fba700cb9e0 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- 172.21.15.100:0/1555410340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 msgr2=0x7fba700cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 --2- 172.21.15.100:0/1555410340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 0x7fba700cbdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba60009880 tx=0x7fba60009b90 comp rx=0 tx=0).stop 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- 172.21.15.100:0/1555410340 shutdown_connections 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 --2- 172.21.15.100:0/1555410340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba700cb9e0 0x7fba700cbdc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- 172.21.15.100:0/1555410340 >> 172.21.15.100:0/1555410340 conn(0x7fba7006a480 msgr2=0x7fba7006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- 172.21.15.100:0/1555410340 shutdown_connections 2023-11-17T06:33:33.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- 172.21.15.100:0/1555410340 wait complete. 2023-11-17T06:33:33.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 Processor -- start 2023-11-17T06:33:33.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.699+0000 7fba758ba700 1 -- start start 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba7006bc20 0x7fba700b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba700cb9e0 0x7fba70150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700b3e00 con 0x7fba7015ca60 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c39a0 con 0x7fba700cb9e0 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7015ae30 con 0x7fba7006bc20 2023-11-17T06:33:33.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59274/0 (socket says 172.21.15.100:59274) 2023-11-17T06:33:33.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 -- 172.21.15.100:0/1647348343 learned_addr learned my addr 172.21.15.100:0/1647348343 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:33.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6effd700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba7006bc20 0x7fba700b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba67fff700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba700cb9e0 0x7fba70150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 -- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba7006bc20 msgr2=0x7fba700b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba7006bc20 0x7fba700b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 -- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba700cb9e0 msgr2=0x7fba70150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba700cb9e0 0x7fba70150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 -- 172.21.15.100:0/1647348343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600094b0 con 0x7fba7015ca60 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6f7fe700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba6800caf0 tx=0x7fba6800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68007480 con 0x7fba7015ca60 2023-11-17T06:33:33.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba680075e0 con 0x7fba7015ca60 2023-11-17T06:33:33.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68007970 con 0x7fba7015ca60 2023-11-17T06:33:33.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba701508d0 con 0x7fba7015ca60 2023-11-17T06:33:33.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.703+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba700c3070 con 0x7fba7015ca60 2023-11-17T06:33:33.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.707+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba70067990 con 0x7fba7015ca60 2023-11-17T06:33:33.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.707+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fba6801b3b0 con 0x7fba7015ca60 2023-11-17T06:33:33.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.707+0000 7fba6cff9700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 0x7fba500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.707+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fba680837f0 con 0x7fba7015ca60 2023-11-17T06:33:33.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.707+0000 7fba6effd700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 0x7fba500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.711+0000 7fba6effd700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 0x7fba500689d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba600090b0 tx=0x7fba60010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.715+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba68054640 con 0x7fba7015ca60 2023-11-17T06:33:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.923+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba700c3ae0 con 0x7fba7015ca60 2023-11-17T06:33:33.927 INFO:tasks.ceph.mon.a.smithi100.stderr:2023-11-17T06:33:33.923+0000 7f0e7e1f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:33:33.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.927+0000 7fba6cff9700 1 -- 172.21.15.100:0/1647348343 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba68017090 con 0x7fba7015ca60 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 msgr2=0x7fba500689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 0x7fba500689d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba600090b0 tx=0x7fba60010000 comp rx=0 tx=0).stop 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 msgr2=0x7fba700c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba6800caf0 tx=0x7fba6800cb20 comp rx=0 tx=0).stop 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 shutdown_connections 2023-11-17T06:33:33.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fba50066510 0x7fba500689d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba7015ca60 0x7fba700c3e30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba700cb9e0 0x7fba70150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 --2- 172.21.15.100:0/1647348343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba7006bc20 0x7fba700b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 >> 172.21.15.100:0/1647348343 conn(0x7fba7006a480 msgr2=0x7fba7006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 shutdown_connections 2023-11-17T06:33:33.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:33.931+0000 7fba758ba700 1 -- 172.21.15.100:0/1647348343 wait complete. 2023-11-17T06:33:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:33:33.952 INFO:tasks.ceph.mds.a.smithi100.stderr: -571> 2023-11-17T06:33:21.163+0000 7fbeb19ad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:33.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-17T06:33:34.004 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2023-11-17T06:33:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.135+0000 7fd040cb3700 1 Processor -- start 2023-11-17T06:33:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.135+0000 7fd040cb3700 1 -- start start 2023-11-17T06:33:34.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd040cb3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 0x7fd03c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd040cb3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd03c0cb740 0x7fd03c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd040cb3700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03c0cc100 con 0x7fd03c15a400 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd040cb3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0ce340 con 0x7fd03c0cb740 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd040cb3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0ce620 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd03a59c700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd03c15a400 0x7fd03c0b1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48234/0 (socket says 172.21.15.100:48234) 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd03a59c700 1 -- 172.21.15.100:0/3901772085 learned_addr learned my addr 172.21.15.100:0/3901772085 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd03ad9d700 1 --2- 172.21.15.100:0/3901772085 >> v2:172.21.15.119:3300/0 conn(0x7fd03c0cb740 0x7fd03c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 --2- 172.21.15.100:0/3901772085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 0x7fd03c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd03959a700 1 -- 172.21.15.100:0/3901772085 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376727992 0 0) 0x7fd03c0cc100 con 0x7fd03c15a400 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd03959a700 1 -- 172.21.15.100:0/3901772085 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0240035d0 con 0x7fd03c15a400 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 -- 172.21.15.100:0/3901772085 >> v2:172.21.15.119:3300/0 conn(0x7fd03c0cb740 msgr2=0x7fd03c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 --2- 172.21.15.100:0/3901772085 >> v2:172.21.15.119:3300/0 conn(0x7fd03c0cb740 0x7fd03c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 -- 172.21.15.100:0/3901772085 >> v1:172.21.15.100:6789/0 conn(0x7fd03c15a400 legacy=0x7fd03c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 -- 172.21.15.100:0/3901772085 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c070c80 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.139+0000 7fd039d9b700 1 --2- 172.21.15.100:0/3901772085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 0x7fd03c0cac20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd030009850 tx=0x7fd030009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21ececac0bd722c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd03959a700 1 -- 172.21.15.100:0/3901772085 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011830 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd03959a700 1 -- 172.21.15.100:0/3901772085 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030011990 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd03959a700 1 -- 172.21.15.100:0/3901772085 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011d40 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 -- 172.21.15.100:0/3901772085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 msgr2=0x7fd03c0cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 --2- 172.21.15.100:0/3901772085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 0x7fd03c0cac20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd030009850 tx=0x7fd030009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:34.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 -- 172.21.15.100:0/3901772085 shutdown_connections 2023-11-17T06:33:34.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 --2- 172.21.15.100:0/3901772085 >> v2:172.21.15.119:3300/0 conn(0x7fd03c0cb740 0x7fd03c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 --2- 172.21.15.100:0/3901772085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c0c9bd0 0x7fd03c0cac20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 -- 172.21.15.100:0/3901772085 >> 172.21.15.100:0/3901772085 conn(0x7fd03c06a2a0 msgr2=0x7fd03c06a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 -- 172.21.15.100:0/3901772085 shutdown_connections 2023-11-17T06:33:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.143+0000 7fd040cb3700 1 -- 172.21.15.100:0/3901772085 wait complete. 2023-11-17T06:33:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 Processor -- start 2023-11-17T06:33:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 -- start start 2023-11-17T06:33:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd03c0c9bd0 0x7fd03c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 0x7fd03c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b0390 con 0x7fd03c0cb740 2023-11-17T06:33:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b44e0 con 0x7fd03c0c9bd0 2023-11-17T06:33:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0b3f20 con 0x7fd03c15a400 2023-11-17T06:33:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59310/0 (socket says 172.21.15.100:59310) 2023-11-17T06:33:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 -- 172.21.15.100:0/2424024399 learned_addr learned my addr 172.21.15.100:0/2424024399 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd03a59c700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd03c0c9bd0 0x7fd03c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd03ad9d700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 0x7fd03c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 -- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 msgr2=0x7fd03c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 0x7fd03c153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 -- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd03c0c9bd0 msgr2=0x7fd03c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd03c0c9bd0 0x7fd03c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 -- 172.21.15.100:0/2424024399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300094b0 con 0x7fd03c0cb740 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd03ad9d700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 0x7fd03c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd039d9b700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd0300097a0 tx=0x7fd030004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030004610 con 0x7fd03c0cb740 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300036c0 con 0x7fd03c0cb740 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c0b4200 con 0x7fd03c0cb740 2023-11-17T06:33:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.147+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030003a50 con 0x7fd03c0cb740 2023-11-17T06:33:34.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.151+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c1f5f20 con 0x7fd03c0cb740 2023-11-17T06:33:34.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.151+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c04eea0 con 0x7fd03c0cb740 2023-11-17T06:33:34.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.151+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd030003bb0 con 0x7fd03c0cb740 2023-11-17T06:33:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.155+0000 7fd02affd700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 0x7fd01c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.155+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fd030021030 con 0x7fd03c0cb740 2023-11-17T06:33:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.155+0000 7fd03a59c700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 0x7fd01c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.155+0000 7fd03a59c700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 0x7fd01c0689d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0011e0 tx=0x7fd02c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.159+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd030052930 con 0x7fd03c0cb740 2023-11-17T06:33:34.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.379+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd03c0cab50 con 0x7fd03c0cb740 2023-11-17T06:33:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.931+0000 7fd02affd700 1 -- 172.21.15.100:0/2424024399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd030003e60 con 0x7fd03c0cb740 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 msgr2=0x7fd01c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 0x7fd01c0689d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0011e0 tx=0x7fd02c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 msgr2=0x7fd03c0afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd0300097a0 tx=0x7fd030004770 comp rx=0 tx=0).stop 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 shutdown_connections 2023-11-17T06:33:34.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd03c15a400 0x7fd03c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd01c066510 0x7fd01c0689d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c0cb740 0x7fd03c0afe50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 --2- 172.21.15.100:0/2424024399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd03c0c9bd0 0x7fd03c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 >> 172.21.15.100:0/2424024399 conn(0x7fd03c06a2a0 msgr2=0x7fd03c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 shutdown_connections 2023-11-17T06:33:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:34.935+0000 7fd040cb3700 1 -- 172.21.15.100:0/2424024399 wait complete. 2023-11-17T06:33:34.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-17T06:33:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.187+0000 7fb3ecb1d700 1 Processor -- start 2023-11-17T06:33:35.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.187+0000 7fb3ecb1d700 1 -- start start 2023-11-17T06:33:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3ecb1d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 0x7fb3e806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3ecb1d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 0x7fb3e80c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3ecb1d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e806d810 con 0x7fb3e80c5aa0 2023-11-17T06:33:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3ecb1d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e806de90 con 0x7fb3e806e7f0 2023-11-17T06:33:35.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3ecb1d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815dec0 con 0x7fb3e8143930 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 0x7fb3e806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e7fff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb3e80c5aa0 0x7fb3e80cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:53958/0 (socket says 172.21.15.100:53958) 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e7fff700 1 -- 172.21.15.100:0/4283496190 learned_addr learned my addr 172.21.15.100:0/4283496190 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3dffff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 0x7fb3e80c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e6ffd700 1 -- 172.21.15.100:0/4283496190 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229345186 0 0) 0x7fb3e806d810 con 0x7fb3e80c5aa0 2023-11-17T06:33:35.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e6ffd700 1 -- 172.21.15.100:0/4283496190 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d40035d0 con 0x7fb3e80c5aa0 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 -- 172.21.15.100:0/4283496190 >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 msgr2=0x7fb3e80c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 --2- 172.21.15.100:0/4283496190 >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 0x7fb3e80c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 -- 172.21.15.100:0/4283496190 >> v1:172.21.15.119:6789/0 conn(0x7fb3e80c5aa0 legacy=0x7fb3e80cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 -- 172.21.15.100:0/4283496190 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80c60b0 con 0x7fb3e8143930 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3dffff700 1 --2- 172.21.15.100:0/4283496190 >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 0x7fb3e80c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:35.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.191+0000 7fb3e77fe700 1 --2- 172.21.15.100:0/4283496190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 0x7fb3e806e2b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009850 tx=0x7fb3d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cf4c0529d2c7d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:35.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3e6ffd700 1 -- 172.21.15.100:0/4283496190 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8011830 con 0x7fb3e8143930 2023-11-17T06:33:35.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3e6ffd700 1 -- 172.21.15.100:0/4283496190 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8011990 con 0x7fb3e8143930 2023-11-17T06:33:35.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3e6ffd700 1 -- 172.21.15.100:0/4283496190 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8011d40 con 0x7fb3e8143930 2023-11-17T06:33:35.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/4283496190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 msgr2=0x7fb3e806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/4283496190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 0x7fb3e806e2b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009850 tx=0x7fb3d8009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/4283496190 shutdown_connections 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/4283496190 >> v2:172.21.15.119:3300/0 conn(0x7fb3e806e7f0 0x7fb3e80c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/4283496190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e8143930 0x7fb3e806e2b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/4283496190 >> 172.21.15.100:0/4283496190 conn(0x7fb3e80b1b00 msgr2=0x7fb3e80b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/4283496190 shutdown_connections 2023-11-17T06:33:35.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.195+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/4283496190 wait complete. 2023-11-17T06:33:35.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 Processor -- start 2023-11-17T06:33:35.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 -- start start 2023-11-17T06:33:35.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e80c5aa0 0x7fb3e80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3e8143930 0x7fb3e815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80b5f30 con 0x7fb3e8143930 2023-11-17T06:33:35.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80cb270 con 0x7fb3e806e7f0 2023-11-17T06:33:35.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3ecb1d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e81f66d0 con 0x7fb3e80c5aa0 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3e8143930 0x7fb3e815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:46020/0 (socket says 172.21.15.100:46020) 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3e77fe700 1 -- 172.21.15.100:0/976007100 learned_addr learned my addr 172.21.15.100:0/976007100 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.199+0000 7fb3dffff700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e80c5aa0 0x7fb3e80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 -- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e80c5aa0 msgr2=0x7fb3e80b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e80c5aa0 0x7fb3e80b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 -- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3e8143930 msgr2=0x7fb3e815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3e8143930 0x7fb3e815c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 -- 172.21.15.100:0/976007100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00094b0 con 0x7fb3e806e7f0 2023-11-17T06:33:35.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e77fe700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80090b0 tx=0x7fb3d8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8004450 con 0x7fb3e806e7f0 2023-11-17T06:33:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d801f070 con 0x7fb3e806e7f0 2023-11-17T06:33:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d80094b0 con 0x7fb3e806e7f0 2023-11-17T06:33:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8003900 con 0x7fb3e806e7f0 2023-11-17T06:33:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e81f7210 con 0x7fb3e806e7f0 2023-11-17T06:33:35.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.203+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e8067990 con 0x7fb3e806e7f0 2023-11-17T06:33:35.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.207+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb3d8003a60 con 0x7fb3e806e7f0 2023-11-17T06:33:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.207+0000 7fb3e4ff9700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:35.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.207+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb3d8021070 con 0x7fb3e806e7f0 2023-11-17T06:33:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.207+0000 7fb3dffff700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.207+0000 7fb3dffff700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 0x7fb3c80689d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cd230 tx=0x7fb3d0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.215+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3d80528b0 con 0x7fb3e806e7f0 2023-11-17T06:33:35.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.391+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3e80cd260 con 0x7fb3e806e7f0 2023-11-17T06:33:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.947+0000 7fb3e4ff9700 1 -- 172.21.15.100:0/976007100 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb3d8055ed0 con 0x7fb3e806e7f0 2023-11-17T06:33:35.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 msgr2=0x7fb3c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 0x7fb3c80689d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cd230 tx=0x7fb3d0009240 comp rx=0 tx=0).stop 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 msgr2=0x7fb3e80cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80090b0 tx=0x7fb3d8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 shutdown_connections 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3e8143930 0x7fb3e815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3e80c5aa0 0x7fb3e80b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 --2- 172.21.15.100:0/976007100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3e806e7f0 0x7fb3e80cccf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:35.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 >> 172.21.15.100:0/976007100 conn(0x7fb3e80b1b00 msgr2=0x7fb3e80c5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:35.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 shutdown_connections 2023-11-17T06:33:35.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:35.951+0000 7fb3ecb1d700 1 -- 172.21.15.100:0/976007100 wait complete. 2023-11-17T06:33:35.959 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2023-11-17T06:33:35.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-17T06:33:36.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.159+0000 7fd4556a8700 1 Processor -- start 2023-11-17T06:33:36.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.159+0000 7fd4556a8700 1 -- start start 2023-11-17T06:33:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd4556a8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd450160950 0x7fd4500b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd4556a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 0x7fd4500b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd4556a8700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd450160d30 con 0x7fd4500b6790 2023-11-17T06:33:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd4556a8700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500ce8f0 con 0x7fd450160950 2023-11-17T06:33:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd4556a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500d2110 con 0x7fd4500b8f80 2023-11-17T06:33:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 0x7fd4500b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 0x7fd4500b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:60700/0 (socket says 172.21.15.100:60700) 2023-11-17T06:33:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.163+0000 7fd44e7fc700 1 -- 172.21.15.100:0/4069934063 learned_addr learned my addr 172.21.15.100:0/4069934063 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 --2- 172.21.15.100:0/4069934063 >> v2:172.21.15.100:3300/0 conn(0x7fd450160950 0x7fd4500b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 -- 172.21.15.100:0/4069934063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 msgr2=0x7fd4500b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 --2- 172.21.15.100:0/4069934063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 0x7fd4500b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 -- 172.21.15.100:0/4069934063 >> v1:172.21.15.100:6789/0 conn(0x7fd4500b6790 legacy=0x7fd4500cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 -- 172.21.15.100:0/4069934063 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500b2790 con 0x7fd450160950 2023-11-17T06:33:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44effd700 1 --2- 172.21.15.100:0/4069934063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450160950 0x7fd4500b8a40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd440009850 tx=0x7fd440009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13190fa858421573 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44dffb700 1 -- 172.21.15.100:0/4069934063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440004230 con 0x7fd450160950 2023-11-17T06:33:36.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44dffb700 1 -- 172.21.15.100:0/4069934063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440004390 con 0x7fd450160950 2023-11-17T06:33:36.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd44dffb700 1 -- 172.21.15.100:0/4069934063 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400036c0 con 0x7fd450160950 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 -- 172.21.15.100:0/4069934063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450160950 msgr2=0x7fd4500b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 --2- 172.21.15.100:0/4069934063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450160950 0x7fd4500b8a40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd440009850 tx=0x7fd440009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 -- 172.21.15.100:0/4069934063 shutdown_connections 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 --2- 172.21.15.100:0/4069934063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b8f80 0x7fd4500b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 --2- 172.21.15.100:0/4069934063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450160950 0x7fd4500b8a40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.167+0000 7fd4556a8700 1 -- 172.21.15.100:0/4069934063 >> 172.21.15.100:0/4069934063 conn(0x7fd45006acf0 msgr2=0x7fd45006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:36.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.171+0000 7fd4556a8700 1 -- 172.21.15.100:0/4069934063 shutdown_connections 2023-11-17T06:33:36.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.171+0000 7fd4556a8700 1 -- 172.21.15.100:0/4069934063 wait complete. 2023-11-17T06:33:36.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.171+0000 7fd4556a8700 1 Processor -- start 2023-11-17T06:33:36.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 -- start start 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 0x7fd4501f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 0x7fd4500c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd450160950 0x7fd4501efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501ff710 con 0x7fd4500b8f80 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f1220 con 0x7fd450160950 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f0610 con 0x7fd4500b6790 2023-11-17T06:33:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 0x7fd4500c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 0x7fd4500c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59338/0 (socket says 172.21.15.100:59338) 2023-11-17T06:33:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44e7fc700 1 -- 172.21.15.100:0/3691180143 learned_addr learned my addr 172.21.15.100:0/3691180143 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 0x7fd4501f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44f7fe700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd450160950 0x7fd4501efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 -- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd450160950 msgr2=0x7fd4501efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd450160950 0x7fd4501efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 -- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 msgr2=0x7fd4500c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 0x7fd4500c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 -- 172.21.15.100:0/3691180143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400094b0 con 0x7fd4500b6790 2023-11-17T06:33:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd44effd700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 0x7fd4501f32d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd440015000 tx=0x7fd440004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440006ea0 con 0x7fd4500b6790 2023-11-17T06:33:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440011630 con 0x7fd4500b6790 2023-11-17T06:33:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4501f08f0 con 0x7fd4500b6790 2023-11-17T06:33:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.175+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400119e0 con 0x7fd4500b6790 2023-11-17T06:33:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501f0eb0 con 0x7fd4500b6790 2023-11-17T06:33:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd450067990 con 0x7fd4500b6790 2023-11-17T06:33:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd440011b40 con 0x7fd4500b6790 2023-11-17T06:33:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd4377fe700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 0x7fd43c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5529+0+0 (secure 0 0 0) 0x7fd440085180 con 0x7fd4500b6790 2023-11-17T06:33:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.179+0000 7fd44e7fc700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 0x7fd43c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.183+0000 7fd44e7fc700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 0x7fd43c0689d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd4500c9da0 tx=0x7fd4440092e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.187+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4400526a0 con 0x7fd4500b6790 2023-11-17T06:33:36.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.359+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4500b4830 con 0x7fd4500b6790 2023-11-17T06:33:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.963+0000 7fd4377fe700 1 -- 172.21.15.100:0/3691180143 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd440055cc0 con 0x7fd4500b6790 2023-11-17T06:33:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 msgr2=0x7fd43c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 0x7fd43c0689d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd4500c9da0 tx=0x7fd4440092e0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 msgr2=0x7fd4501f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 0x7fd4501f32d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd440015000 tx=0x7fd440004770 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 shutdown_connections 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd450160950 0x7fd4501efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd43c066510 0x7fd43c0689d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4500b8f80 0x7fd4500c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 --2- 172.21.15.100:0/3691180143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4500b6790 0x7fd4501f32d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 >> 172.21.15.100:0/3691180143 conn(0x7fd45006acf0 msgr2=0x7fd4500d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 shutdown_connections 2023-11-17T06:33:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:36.971+0000 7fd4556a8700 1 -- 172.21.15.100:0/3691180143 wait complete. 2023-11-17T06:33:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2023-11-17T06:33:36.998 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-17T06:33:37.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 Processor -- start 2023-11-17T06:33:37.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 -- start start 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6cf80d0290 0x7f6cf80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 0x7f6cf80d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf80d2840 con 0x7f6cf815d510 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80d3150 con 0x7f6cf80d1520 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cfe6b3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80d0c60 con 0x7f6cf80d0290 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cf7fff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6cf815d510 0x7f6cf80b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48246/0 (socket says 172.21.15.100:48246) 2023-11-17T06:33:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.187+0000 7f6cf7fff700 1 -- 172.21.15.100:0/2618477480 learned_addr learned my addr 172.21.15.100:0/2618477480 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfcc50700 1 --2- 172.21.15.100:0/2618477480 >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 0x7f6cf80d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2618477480 >> v2:172.21.15.119:3300/0 conn(0x7f6cf80d0290 0x7f6cf80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cf77fe700 1 -- 172.21.15.100:0/2618477480 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605797846 0 0) 0x7f6cf80d2840 con 0x7f6cf815d510 2023-11-17T06:33:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cf77fe700 1 -- 172.21.15.100:0/2618477480 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce40035d0 con 0x7f6cf815d510 2023-11-17T06:33:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2618477480 >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 msgr2=0x7f6cf80d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2618477480 >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 0x7f6cf80d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2618477480 >> v1:172.21.15.100:6789/0 conn(0x7f6cf815d510 legacy=0x7f6cf80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2618477480 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80d22c0 con 0x7f6cf80d0290 2023-11-17T06:33:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfcc50700 1 --2- 172.21.15.100:0/2618477480 >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 0x7f6cf80d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2618477480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80d0720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80b6200 tx=0x7f6ce0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24763d490b8abacd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cf77fe700 1 -- 172.21.15.100:0/2618477480 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0011830 con 0x7f6cf80d0290 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cf77fe700 1 -- 172.21.15.100:0/2618477480 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0011990 con 0x7f6cf80d0290 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cf77fe700 1 -- 172.21.15.100:0/2618477480 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0011d20 con 0x7f6cf80d0290 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2618477480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 msgr2=0x7f6cf80d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2618477480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80d0720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80b6200 tx=0x7f6ce0009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:37.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2618477480 shutdown_connections 2023-11-17T06:33:37.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2618477480 >> v2:172.21.15.100:3300/0 conn(0x7f6cf80d1520 0x7f6cf80d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2618477480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80d0720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2618477480 >> 172.21.15.100:0/2618477480 conn(0x7f6cf8073620 msgr2=0x7f6cf8073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:37.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.191+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2618477480 shutdown_connections 2023-11-17T06:33:37.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.195+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2618477480 wait complete. 2023-11-17T06:33:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.195+0000 7f6cfe6b3700 1 Processor -- start 2023-11-17T06:33:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.195+0000 7f6cfe6b3700 1 -- start start 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cf815d510 0x7f6cf80b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81f69e0 con 0x7f6cf80d1520 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81f5dd0 con 0x7f6cf80d0290 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81f60b0 con 0x7f6cf815d510 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59350/0 (socket says 172.21.15.100:59350) 2023-11-17T06:33:37.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2693094866 learned_addr learned my addr 172.21.15.100:0/2693094866 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:37.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfcc50700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cf815d510 0x7f6cf80b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cf7fff700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cf815d510 msgr2=0x7f6cf80b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cf815d510 0x7f6cf80b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 msgr2=0x7f6cf80b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 -- 172.21.15.100:0/2693094866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00094b0 con 0x7f6cf80d1520 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cef7fe700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0014040 tx=0x7f6ce0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0004510 con 0x7f6cf80d1520 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce001e070 con 0x7f6cf80d1520 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce00094b0 con 0x7f6cf80d1520 2023-11-17T06:33:37.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00038e0 con 0x7f6cf80d1520 2023-11-17T06:33:37.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.199+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf81f6670 con 0x7f6cf80d1520 2023-11-17T06:33:37.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.203+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf81f6b50 con 0x7f6cf80d1520 2023-11-17T06:33:37.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.203+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ce0003a40 con 0x7f6cf80d1520 2023-11-17T06:33:37.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.203+0000 7f6cf57fa700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 0x7f6cd8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.203+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6ce0020070 con 0x7f6cf80d1520 2023-11-17T06:33:37.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.203+0000 7f6cf7fff700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 0x7f6cd8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.207+0000 7f6cf7fff700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 0x7f6cd8068a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8001560 tx=0x7f6ce8001a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.211+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ce0052330 con 0x7f6cf80d1520 2023-11-17T06:33:37.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.387+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6cf80d2d70 con 0x7f6cf80d1520 2023-11-17T06:33:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.395+0000 7f6cf57fa700 1 -- 172.21.15.100:0/2693094866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ce0055950 con 0x7f6cf80d1520 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.395+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 msgr2=0x7f6cd8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.395+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 0x7f6cd8068a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8001560 tx=0x7f6ce8001a90 comp rx=0 tx=0).stop 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.395+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 msgr2=0x7f6cf80b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.395+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0014040 tx=0x7f6ce0004770 comp rx=0 tx=0).stop 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 shutdown_connections 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cf815d510 0x7f6cf80b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6cd8066540 0x7f6cd8068a00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80d1520 0x7f6cf80b7fc0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 --2- 172.21.15.100:0/2693094866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cf80d0290 0x7f6cf80b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 >> 172.21.15.100:0/2693094866 conn(0x7f6cf8073620 msgr2=0x7f6cf80b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 shutdown_connections 2023-11-17T06:33:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.399+0000 7f6cfe6b3700 1 -- 172.21.15.100:0/2693094866 wait complete. 2023-11-17T06:33:37.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-17T06:33:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.595+0000 7fdc01754700 1 Processor -- start 2023-11-17T06:33:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.595+0000 7fdc01754700 1 -- start start 2023-11-17T06:33:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdc01754700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdbfc161610 0x7fdbfc165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdc01754700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdbfc1619f0 0x7fdbfc0cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdc01754700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc165450 con 0x7fdbfc0c3570 2023-11-17T06:33:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdc01754700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0d0480 con 0x7fdbfc161610 2023-11-17T06:33:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdc01754700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0cd870 con 0x7fdbfc1619f0 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdbfc161610 0x7fdbfc165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbf27fc700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdbfc0c3570 0x7fdbfc0cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48256/0 (socket says 172.21.15.100:48256) 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbf27fc700 1 -- 172.21.15.100:0/2656838462 learned_addr learned my addr 172.21.15.100:0/2656838462 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfbfff700 1 --2- 172.21.15.100:0/2656838462 >> v2:172.21.15.119:3300/0 conn(0x7fdbfc1619f0 0x7fdbfc0cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfa7fc700 1 -- 172.21.15.100:0/2656838462 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239775589 0 0) 0x7fdbfc165450 con 0x7fdbfc0c3570 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfa7fc700 1 -- 172.21.15.100:0/2656838462 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbdc0035d0 con 0x7fdbfc0c3570 2023-11-17T06:33:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 -- 172.21.15.100:0/2656838462 >> v2:172.21.15.119:3300/0 conn(0x7fdbfc1619f0 msgr2=0x7fdbfc0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 --2- 172.21.15.100:0/2656838462 >> v2:172.21.15.119:3300/0 conn(0x7fdbfc1619f0 0x7fdbfc0cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 -- 172.21.15.100:0/2656838462 >> v1:172.21.15.100:6789/0 conn(0x7fdbfc0c3570 legacy=0x7fdbfc0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 -- 172.21.15.100:0/2656838462 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc1656f0 con 0x7fdbfc161610 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfaffd700 1 --2- 172.21.15.100:0/2656838462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc161610 0x7fdbfc165ed0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc3b0 tx=0x7fdbec009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8929bd54021c4ac server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfa7fc700 1 -- 172.21.15.100:0/2656838462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec011830 con 0x7fdbfc161610 2023-11-17T06:33:37.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfa7fc700 1 -- 172.21.15.100:0/2656838462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec011990 con 0x7fdbfc161610 2023-11-17T06:33:37.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.599+0000 7fdbfa7fc700 1 -- 172.21.15.100:0/2656838462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec011d20 con 0x7fdbfc161610 2023-11-17T06:33:37.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 -- 172.21.15.100:0/2656838462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc161610 msgr2=0x7fdbfc165ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 --2- 172.21.15.100:0/2656838462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc161610 0x7fdbfc165ed0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc3b0 tx=0x7fdbec009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:37.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 -- 172.21.15.100:0/2656838462 shutdown_connections 2023-11-17T06:33:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 --2- 172.21.15.100:0/2656838462 >> v2:172.21.15.119:3300/0 conn(0x7fdbfc1619f0 0x7fdbfc0cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 --2- 172.21.15.100:0/2656838462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc161610 0x7fdbfc165ed0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 -- 172.21.15.100:0/2656838462 >> 172.21.15.100:0/2656838462 conn(0x7fdbfc0b2270 msgr2=0x7fdbfc0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 -- 172.21.15.100:0/2656838462 shutdown_connections 2023-11-17T06:33:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.603+0000 7fdc01754700 1 -- 172.21.15.100:0/2656838462 wait complete. 2023-11-17T06:33:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 Processor -- start 2023-11-17T06:33:37.610 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 -- start start 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0c3570 0x7fdbfc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbfc161610 0x7fdbfc0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc1fb740 con 0x7fdbfc1619f0 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc1530e0 con 0x7fdbfc0c3570 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdc01754700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc1fb180 con 0x7fdbfc161610 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdbfbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdbfbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59372/0 (socket says 172.21.15.100:59372) 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdbfbfff700 1 -- 172.21.15.100:0/3791568600 learned_addr learned my addr 172.21.15.100:0/3791568600 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdbf27fc700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbfc161610 0x7fdbfc0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.607+0000 7fdbfaffd700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0c3570 0x7fdbfc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 -- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbfc161610 msgr2=0x7fdbfc0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbfc161610 0x7fdbfc0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 -- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0c3570 msgr2=0x7fdbfc152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0c3570 0x7fdbfc152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 -- 172.21.15.100:0/3791568600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0094b0 con 0x7fdbfc1619f0 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbfbfff700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7b0 tx=0x7fdbf400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4009560 con 0x7fdbfc1619f0 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4013680 con 0x7fdbfc1619f0 2023-11-17T06:33:37.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc1fb460 con 0x7fdbfc1619f0 2023-11-17T06:33:37.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4013a10 con 0x7fdbfc1619f0 2023-11-17T06:33:37.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0b4830 con 0x7fdbfc1619f0 2023-11-17T06:33:37.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.611+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc0b4a50 con 0x7fdbfc1619f0 2023-11-17T06:33:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.615+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbf4013b70 con 0x7fdbfc1619f0 2023-11-17T06:33:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.615+0000 7fdbf3fff700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 0x7fdbe00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.619+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fdbf4083ae0 con 0x7fdbfc1619f0 2023-11-17T06:33:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.619+0000 7fdbfaffd700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 0x7fdbe00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.619+0000 7fdbfaffd700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 0x7fdbe00689d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:37.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.623+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbf4051110 con 0x7fdbfc1619f0 2023-11-17T06:33:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.863+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7fdbfc04eea0 con 0x7fdbfc1619f0 2023-11-17T06:33:37.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.971+0000 7fdbf3fff700 1 -- 172.21.15.100:0/3791568600 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v229) v1 ==== 145+0+0 (secure 0 0 0) 0x7fdbf40170d0 con 0x7fdbfc1619f0 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 msgr2=0x7fdbe00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 0x7fdbe00689d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec008030 comp rx=0 tx=0).stop 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 msgr2=0x7fdbfc1fa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e7b0 tx=0x7fdbf400eac0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 shutdown_connections 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fdbe0066510 0x7fdbe00689d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbfc1619f0 0x7fdbfc1fa810 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbfc161610 0x7fdbfc0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 --2- 172.21.15.100:0/3791568600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbfc0c3570 0x7fdbfc152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 >> 172.21.15.100:0/3791568600 conn(0x7fdbfc0b2270 msgr2=0x7fdbfc066270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 shutdown_connections 2023-11-17T06:33:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:37.975+0000 7fdc01754700 1 -- 172.21.15.100:0/3791568600 wait complete. 2023-11-17T06:33:38.001 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. ... ERROR 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/test_data_scan.py", line 594, in test_fragmented_injection 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-11-17T06:33:38.002 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 793, in run_shell_payload 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-17T06:33:38.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:Ran 1 test in 201.051s 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:38.007 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/test_data_scan.py", line 594, in test_fragmented_injection 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 793, in run_shell_payload 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-17T06:33:38.008 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-17T06:33:38.009 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-17T06:33:38.009 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-17T06:33:38.009 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-11-17T06:33:38.009 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:38.009 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:38.123 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=05735319635d42a1a96199ec8b28a9fa Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:38.124 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-17T06:33:38.134 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-17T06:33:38.155 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-17T06:33:38.156 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:33:38.156 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:38.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352152k,nr_inodes=4088038,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9234 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:38.225 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-11-17T06:33:38.226 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:38.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352152k,nr_inodes=4088038,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9234 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:38.289 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:33:38.289 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:38.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352272k,nr_inodes=4088068,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:38.307 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-11-17T06:33:38.307 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:38.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352272k,nr_inodes=4088068,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:38.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.368 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-11-17T06:33:38.389 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:33:38.389 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:33:38.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:38.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:38.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-11-17T06:33:38.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.741 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-11-17T06:33:38.760 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-17T06:33:38.761 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-17T06:33:38.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:33:38.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:33:38.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:38.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-11-17T06:33:39.147 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-17T06:33:39.156 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-17T06:33:39.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:39.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 Processor -- start 2023-11-17T06:33:39.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 -- start start 2023-11-17T06:33:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d380cbb60 0x7f2d380cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d380cd9a0 0x7f2d380cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b2800 con 0x7f2d3815e790 2023-11-17T06:33:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380b03d0 con 0x7f2d380cbb60 2023-11-17T06:33:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.335+0000 7f2d3d99f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380b1830 con 0x7f2d380cd9a0 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d380cbb60 0x7f2d380cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3c99d700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2d3815e790 0x7f2d380b20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:53964/0 (socket says 172.21.15.100:53964) 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3c99d700 1 -- 172.21.15.100:0/1584528073 learned_addr learned my addr 172.21.15.100:0/1584528073 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d380cbb60 0x7f2d380cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.100:46062/0 (socket says 172.21.15.100:46062) 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d19e700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d380cd9a0 0x7f2d380cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 -- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d380cd9a0 msgr2=0x7f2d380cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d380cd9a0 0x7f2d380cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 -- 172.21.15.100:0/1584528073 >> v1:172.21.15.119:6789/0 conn(0x7f2d3815e790 legacy=0x7f2d380b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 -- 172.21.15.100:0/1584528073 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380b2a60 con 0x7f2d380cbb60 2023-11-17T06:33:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d377fe700 1 -- 172.21.15.100:0/1584528073 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520219773 0 0) 0x7f2d380b2800 con 0x7f2d3815e790 2023-11-17T06:33:39.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d37fff700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cbb60 0x7f2d380cf480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009850 tx=0x7f2d24009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d6f0e9016ce00 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d377fe700 1 -- 172.21.15.100:0/1584528073 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011830 con 0x7f2d380cbb60 2023-11-17T06:33:39.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d377fe700 1 -- 172.21.15.100:0/1584528073 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24011990 con 0x7f2d380cbb60 2023-11-17T06:33:39.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d377fe700 1 -- 172.21.15.100:0/1584528073 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011d40 con 0x7f2d380cbb60 2023-11-17T06:33:39.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cbb60 msgr2=0x7f2d380cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cbb60 0x7f2d380cf480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009850 tx=0x7f2d24009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1584528073 shutdown_connections 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d380cd9a0 0x7f2d380cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1584528073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cbb60 0x7f2d380cf480 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1584528073 >> 172.21.15.100:0/1584528073 conn(0x7f2d3809a300 msgr2=0x7f2d3808afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.339+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1584528073 shutdown_connections 2023-11-17T06:33:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.343+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1584528073 wait complete. 2023-11-17T06:33:39.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.343+0000 7f2d3d99f700 1 Processor -- start 2023-11-17T06:33:39.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.343+0000 7f2d3d99f700 1 -- start start 2023-11-17T06:33:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cd9a0 0x7f2d380af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d3815da40 0x7f2d380ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380b6160 con 0x7f2d3815e790 2023-11-17T06:33:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38150d60 con 0x7f2d380cd9a0 2023-11-17T06:33:39.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c8db0 con 0x7f2d3815da40 2023-11-17T06:33:39.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59376/0 (socket says 172.21.15.100:59376) 2023-11-17T06:33:39.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 -- 172.21.15.100:0/1701151285 learned_addr learned my addr 172.21.15.100:0/1701151285 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:39.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3c99d700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cd9a0 0x7f2d380af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d19e700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d3815da40 0x7f2d380ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 -- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d3815da40 msgr2=0x7f2d380ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d3815da40 0x7f2d380ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 -- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cd9a0 msgr2=0x7f2d380af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cd9a0 0x7f2d380af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 -- 172.21.15.100:0/1701151285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240094b0 con 0x7f2d3815e790 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d37fff700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2d24000c00 tx=0x7f2d24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24019a00 con 0x7f2d3815e790 2023-11-17T06:33:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2401e070 con 0x7f2d3815e790 2023-11-17T06:33:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24019da0 con 0x7f2d3815e790 2023-11-17T06:33:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d380b6930 con 0x7f2d3815e790 2023-11-17T06:33:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.347+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380b6650 con 0x7f2d3815e790 2023-11-17T06:33:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.351+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d38067990 con 0x7f2d3815e790 2023-11-17T06:33:39.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.351+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d2401a420 con 0x7f2d3815e790 2023-11-17T06:33:39.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.351+0000 7f2d357fa700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 0x7f2d1c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.351+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f2d24084c30 con 0x7f2d3815e790 2023-11-17T06:33:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.351+0000 7f2d3c99d700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 0x7f2d1c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.355+0000 7f2d3c99d700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 0x7f2d1c068a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000f60 tx=0x7f2d2c007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.359+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d2408b080 con 0x7f2d3815e790 2023-11-17T06:33:39.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.530+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d380b3020 con 0x7f2d1c066540 2023-11-17T06:33:39.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d357fa700 1 -- 172.21.15.100:0/1701151285 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48478 (secure 0 0 0) 0x7f2d2c001370 con 0x7f2d1c066540 2023-11-17T06:33:39.539 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:39.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 msgr2=0x7f2d1c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 0x7f2d1c068a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000f60 tx=0x7f2d2c007e00 comp rx=0 tx=0).stop 2023-11-17T06:33:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 msgr2=0x7f2d380ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2d24000c00 tx=0x7f2d24004770 comp rx=0 tx=0).stop 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 shutdown_connections 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d3815da40 0x7f2d380ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f2d1c066540 0x7f2d1c068a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d3815e790 0x7f2d380ae110 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 --2- 172.21.15.100:0/1701151285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d380cd9a0 0x7f2d380af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.534+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 >> 172.21.15.100:0/1701151285 conn(0x7f2d3809a300 msgr2=0x7f2d3806e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.538+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 shutdown_connections 2023-11-17T06:33:39.543 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.538+0000 7f2d3d99f700 1 -- 172.21.15.100:0/1701151285 wait complete. 2023-11-17T06:33:39.544 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:33:39.562 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-11-17T06:33:39.347774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233776,"kb_used_data":5104,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740944,"statfs":{"total":773094113280,"available":772854726656,"internally_reserved":0,"allocated":5226496,"data_stored":2665907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-406517,"num_objects":-125,"num_object_clones":0,"num_object_copies":-250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-125,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1514,"num_write":-911,"num_write_kb":-892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001896"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-17T06:33:36.167301+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:33:36.167301+0000","last_peered":"2023-11-17T06:33:36.167301+0000","last_clean":"2023-11-17T06:33:36.167301+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:33:36.167301+0000","last_undegraded":"2023-11-17T06:33:36.167301+0000","last_fullsized":"2023-11-17T06:33:36.167301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":771750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.218,"15min":1.3440000000000001},"min":{"1min":0.75,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.532,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.069},{"interface":"front","average":{"1min":1.107,"5min":1.2270000000000001,"15min":1.3740000000000001},"min":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7130000000000001,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3009999999999999,"15min":1.4370000000000001},"min":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.349},{"interface":"front","average":{"1min":1.141,"5min":1.3460000000000001,"15min":1.5549999999999999},"min":{"1min":0.79600000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.675,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.28,"15min":1.379},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6140000000000001,"5min":1.919,"15min":1.919},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1799999999999999,"15min":1.2250000000000001},"min":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.409,"5min":1.835,"15min":1.835},"last":1.165}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3899999999999999,"15min":1.5409999999999999},"min":{"1min":1.0489999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.639,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4690000000000001,"15min":1.6220000000000001},"min":{"1min":1.075,"5min":0.496,"15min":0.496},"max":{"1min":1.7250000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.167,"15min":1.256},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.385,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.296,"15min":1.4119999999999999},"min":{"1min":0.77200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.548,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.698}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3680000000000001,"15min":1.4910000000000001},"min":{"1min":0.65200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.7210000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.341,"15min":1.415},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5529999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4179999999999999,"15min":1.5309999999999999},"min":{"1min":0.66400000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5089999999999999,"5min":2.375,"15min":2.375},"last":1.494},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.411,"15min":1.4970000000000001},"min":{"1min":0.93600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7050000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":181362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.119,"15min":1.1160000000000001},"min":{"1min":0.65600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.554,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1719999999999999},"min":{"1min":0.77200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.492,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.571,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.256,"15min":1.292},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7050000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.95099999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2729999999999999,"15min":1.321},"min":{"1min":1.127,"5min":0.87,"15min":0.87},"max":{"1min":1.6120000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.294,"15min":1.3560000000000001},"min":{"1min":0.97999999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.546,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.248,"15min":1.3200000000000001},"min":{"1min":0.98799999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4239999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.252,"15min":1.3320000000000001},"min":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4570000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3360000000000001,"15min":1.4219999999999999},"min":{"1min":0.77200000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6459999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.331}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.274},"min":{"1min":0.88200000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.609,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":0.97599999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6459999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.472,"15min":1.532},"min":{"1min":1.085,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9430000000000001,"5min":2.548,"15min":2.548},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.444,"5min":1.4339999999999999,"15min":1.494},"min":{"1min":1.0880000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.849,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0980000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.667},{"interface":"front","average":{"1min":1.125,"5min":1.228,"15min":1.327},"min":{"1min":0.78800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.5309999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.232},"min":{"1min":0.73999999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4279999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.302},{"interface":"front","average":{"1min":1.234,"5min":1.2709999999999999,"15min":1.329},"min":{"1min":0.99199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2250000000000001,"15min":1.28},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6279999999999999,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.712},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.292,"15min":1.3839999999999999},"min":{"1min":0.86899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4650000000000001,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.026}]},{"osd":3,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.351,"15min":1.4390000000000001},"min":{"1min":0.94999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.538,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.141},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.405,"15min":1.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8480000000000001,"5min":3.48,"15min":3.48},"last":1.6080000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.3160000000000001,"15min":1.3620000000000001},"min":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.6599999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3999999999999999,"15min":1.5169999999999999},"min":{"1min":0.79800000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.752,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.76700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.776,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.869},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4630000000000001,"15min":1.5529999999999999},"min":{"1min":0.97799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8009999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.456}]},{"osd":7,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.514,"15min":1.6120000000000001},"min":{"1min":1.1499999999999999,"5min":0.748,"15min":0.748},"max":{"1min":1.8879999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5669999999999999,"15min":1.649},"min":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9139999999999999,"5min":3.355,"15min":3.355},"last":1.7909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.165,"15min":1.161},"min":{"1min":0.79600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6890000000000001,"5min":2.286,"15min":2.286},"last":1.427},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.21},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.498,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.194,"15min":1.1619999999999999},"min":{"1min":0.92700000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6160000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.393,"15min":1.619},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.45,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3799999999999999,"15min":1.5409999999999999},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.554,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.004}]},{"osd":3,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.22,"15min":1.2170000000000001},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5429999999999999,"5min":2.399,"15min":2.399},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5189999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.22,"15min":1.1779999999999999},"min":{"1min":0.85399999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.2450000000000001,"15min":1.27},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5820000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.605}]},{"osd":6,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.294,"15min":1.3660000000000001},"min":{"1min":0.745,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5449999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.76},{"interface":"front","average":{"1min":1.345,"5min":1.4079999999999999,"15min":1.468},"min":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.915,"5min":2.681,"15min":2.681},"last":1.5720000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3,"15min":1.3440000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.484,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6240000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.917}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":187122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.0049999999999999,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.4570000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.069,"5min":1.125,"15min":1.163},"min":{"1min":0.69599999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3129999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.68300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4059999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.1339999999999999,"15min":1.218},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6240000000000001,"5min":1.907,"15min":1.907},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.329,"15min":1.427},"min":{"1min":0.97999999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.4850000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.343,"15min":1.425},"min":{"1min":0.89400000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6910000000000001,"5min":2.359,"15min":2.359},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":1.014,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.587,"5min":2.375,"15min":2.375},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.373,"15min":1.4850000000000001},"min":{"1min":0.91200000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6279999999999999,"5min":2.202,"15min":2.202},"last":1.018}]},{"osd":6,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.413,"15min":1.492},"min":{"1min":1.0609999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.6060000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4219999999999999,"15min":1.5349999999999999},"min":{"1min":1.0149999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.667,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.5820000000000001},"min":{"1min":1.032,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.7070000000000001,"5min":2.431,"15min":2.431},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.4850000000000001,"15min":1.591},"min":{"1min":1.1379999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.7689999999999999,"5min":2.427,"15min":2.427},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.073,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90700000000000003,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.86299999999999999,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1910000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0389999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.133,"15min":1.1930000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4610000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.319}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":1.0189999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.637,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.389},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.22,"15min":1.282},"min":{"1min":0.94099999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3859999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.1930000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.306,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.4119999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.998},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.399,"15min":1.4530000000000001},"min":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.577,"5min":1.948,"15min":1.948},"last":1.133}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.361,"15min":1.4299999999999999},"min":{"1min":1.008,"5min":0.874,"15min":0.874},"max":{"1min":1.5209999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.506},"min":{"1min":1.0660000000000001,"5min":1.028,"15min":1.028},"max":{"1min":1.6479999999999999,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.413,"15min":1.4750000000000001},"min":{"1min":0.98299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5649999999999999,"5min":2.194,"15min":2.194},"last":1.504},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5049999999999999,"15min":1.575},"min":{"1min":1.2490000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.702,"5min":2.464,"15min":2.464},"last":1.2809999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0149999999999999,"15min":1.0109999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5389999999999999,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.64100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.466,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.0509999999999999},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5329999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.089,"15min":1.111},"min":{"1min":0.78200000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6140000000000001,"5min":2.262,"15min":2.262},"last":1.2050000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.244,"15min":1.3049999999999999},"min":{"1min":0.85399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1950000000000001,"15min":1.3149999999999999},"min":{"1min":0.82699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.343,"15min":1.3999999999999999},"min":{"1min":1.101,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.621,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.337},{"interface":"front","average":{"1min":1.208,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.679,"5min":3.891,"15min":3.891},"last":1.399}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3759999999999999,"15min":1.4259999999999999},"min":{"1min":1.0509999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4470000000000001,"15min":1.5549999999999999},"min":{"1min":1.097,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8440000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.538}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.536},"min":{"1min":1.153,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.835,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.5209999999999999,"15min":1.593},"min":{"1min":1.018,"5min":0.88,"15min":0.88},"max":{"1min":1.8759999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.163}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.546,"15min":1.6699999999999999},"min":{"1min":0.98599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.9159999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.5349999999999999,"15min":1.615},"min":{"1min":1.2210000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.056,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.49}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.92300000000000004},"min":{"1min":0.68300000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1579999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.141,"15min":1.109},"min":{"1min":0.80900000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.417,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.95699999999999996},"min":{"1min":0.73699999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3049999999999999,"5min":1.905,"15min":1.905},"last":0.995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.5669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0820000000000001,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6299999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.302,"5min":1.286,"15min":1.3360000000000001},"min":{"1min":1.0069999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7250000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.292,"15min":1.254},"min":{"1min":1.054,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.494,"5min":2.504,"15min":2.504},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":1.089,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5900000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.224}]},{"osd":5,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3859999999999999,"15min":1.425},"min":{"1min":1.0189999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5449999999999999,"5min":3.121,"15min":3.121},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":1.129,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6479999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.329}]},{"osd":6,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.427,"15min":1.4870000000000001},"min":{"1min":1.1399999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.7070000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.6839999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.482,"15min":1.528},"min":{"1min":1.1140000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.784,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.45},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4710000000000001,"15min":1.5049999999999999},"min":{"1min":1.2130000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.6799999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.121}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:39.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.734+0000 7f9c31995700 1 Processor -- start 2023-11-17T06:33:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.734+0000 7f9c31995700 1 -- start start 2023-11-17T06:33:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31995700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 0x7f9c2c0d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31995700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 0x7f9c2c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31995700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c0ce950 con 0x7f9c2c0b4230 2023-11-17T06:33:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31995700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c0cf1f0 con 0x7f9c2c0d1ef0 2023-11-17T06:33:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31995700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0cec30 con 0x7f9c2c160b90 2023-11-17T06:33:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c2bfff700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9c2c0b4230 0x7f9c2c0d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48268/0 (socket says 172.21.15.100:48268) 2023-11-17T06:33:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c2bfff700 1 -- 172.21.15.100:0/4210497697 learned_addr learned my addr 172.21.15.100:0/4210497697 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31194700 1 --2- 172.21.15.100:0/4210497697 >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 0x7f9c2c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c30993700 1 --2- 172.21.15.100:0/4210497697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 0x7f9c2c0d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c2b7fe700 1 -- 172.21.15.100:0/4210497697 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976787272 0 0) 0x7f9c2c0ce950 con 0x7f9c2c0b4230 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c2b7fe700 1 -- 172.21.15.100:0/4210497697 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c0035d0 con 0x7f9c2c0b4230 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c30993700 1 -- 172.21.15.100:0/4210497697 >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 msgr2=0x7f9c2c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c30993700 1 --2- 172.21.15.100:0/4210497697 >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 0x7f9c2c0c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c30993700 1 -- 172.21.15.100:0/4210497697 >> v1:172.21.15.100:6789/0 conn(0x7f9c2c0b4230 legacy=0x7f9c2c0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.746 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c30993700 1 -- 172.21.15.100:0/4210497697 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c0cef10 con 0x7f9c2c160b90 2023-11-17T06:33:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.738+0000 7f9c31194700 1 --2- 172.21.15.100:0/4210497697 >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 0x7f9c2c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c30993700 1 --2- 172.21.15.100:0/4210497697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 0x7f9c2c0d0fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009840 tx=0x7f9c20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd22f2bece8385 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c2b7fe700 1 -- 172.21.15.100:0/4210497697 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20005e50 con 0x7f9c2c160b90 2023-11-17T06:33:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c2b7fe700 1 -- 172.21.15.100:0/4210497697 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c20006030 con 0x7f9c2c160b90 2023-11-17T06:33:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c2b7fe700 1 -- 172.21.15.100:0/4210497697 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200063c0 con 0x7f9c2c160b90 2023-11-17T06:33:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 -- 172.21.15.100:0/4210497697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 msgr2=0x7f9c2c0d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 --2- 172.21.15.100:0/4210497697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 0x7f9c2c0d0fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009840 tx=0x7f9c20009b50 comp rx=0 tx=0).stop 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 -- 172.21.15.100:0/4210497697 shutdown_connections 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 --2- 172.21.15.100:0/4210497697 >> v2:172.21.15.100:3300/0 conn(0x7f9c2c0d1ef0 0x7f9c2c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 --2- 172.21.15.100:0/4210497697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c160b90 0x7f9c2c0d0fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 -- 172.21.15.100:0/4210497697 >> 172.21.15.100:0/4210497697 conn(0x7f9c2c0d3200 msgr2=0x7f9c2c0d3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 -- 172.21.15.100:0/4210497697 shutdown_connections 2023-11-17T06:33:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.742+0000 7f9c31995700 1 -- 172.21.15.100:0/4210497697 wait complete. 2023-11-17T06:33:39.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 Processor -- start 2023-11-17T06:33:39.750 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- start start 2023-11-17T06:33:39.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c0b4230 0x7f9c2c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c0d1ef0 0x7f9c2c0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0c6a30 con 0x7f9c2c160b90 2023-11-17T06:33:39.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c153820 con 0x7f9c2c0b4230 2023-11-17T06:33:39.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0caee0 con 0x7f9c2c0d1ef0 2023-11-17T06:33:39.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59404/0 (socket says 172.21.15.100:59404) 2023-11-17T06:33:39.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 -- 172.21.15.100:0/1452374170 learned_addr learned my addr 172.21.15.100:0/1452374170 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c2bfff700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c0d1ef0 0x7f9c2c0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c30993700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c0b4230 0x7f9c2c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 -- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c0d1ef0 msgr2=0x7f9c2c0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c0d1ef0 0x7f9c2c0cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 -- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c0b4230 msgr2=0x7f9c2c1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c0b4230 0x7f9c2c1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 -- 172.21.15.100:0/1452374170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24009a70 con 0x7f9c2c160b90 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31194700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009f00 tx=0x7f9c2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24009d70 con 0x7f9c2c160b90 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2400f040 con 0x7f9c2c160b90 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24014480 con 0x7f9c2c160b90 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c20009450 con 0x7f9c2c160b90 2023-11-17T06:33:39.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.746+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c0cb4a0 con 0x7f9c2c160b90 2023-11-17T06:33:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.750+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c072540 con 0x7f9c2c160b90 2023-11-17T06:33:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.750+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c240145e0 con 0x7f9c2c160b90 2023-11-17T06:33:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.750+0000 7f9c297fa700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 0x7f9c10068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.754+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9c24084a60 con 0x7f9c2c160b90 2023-11-17T06:33:39.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.754+0000 7f9c30993700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 0x7f9c10068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.754+0000 7f9c30993700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 0x7f9c10068a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009b90 tx=0x7f9c20008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.758+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c24052000 con 0x7f9c2c160b90 2023-11-17T06:33:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.926+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c2c0d4090 con 0x7f9c10066540 2023-11-17T06:33:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.930+0000 7f9c297fa700 1 -- 172.21.15.100:0/1452374170 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48478 (secure 0 0 0) 0x7f9c200040c0 con 0x7f9c10066540 2023-11-17T06:33:39.938 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 msgr2=0x7f9c10068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 0x7f9c10068a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009b90 tx=0x7f9c20008070 comp rx=0 tx=0).stop 2023-11-17T06:33:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 msgr2=0x7f9c2c15f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009f00 tx=0x7f9c2400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 shutdown_connections 2023-11-17T06:33:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9c10066540 0x7f9c10068a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c2c160b90 0x7f9c2c15f8d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c2c0d1ef0 0x7f9c2c0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 --2- 172.21.15.100:0/1452374170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c2c0b4230 0x7f9c2c1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 >> 172.21.15.100:0/1452374170 conn(0x7f9c2c0d3200 msgr2=0x7f9c2c06ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 shutdown_connections 2023-11-17T06:33:39.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:39.934+0000 7f9c31995700 1 -- 172.21.15.100:0/1452374170 wait complete. 2023-11-17T06:33:39.943 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:33:39.963 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-11-17T06:33:39.347774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233776,"kb_used_data":5104,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740944,"statfs":{"total":773094113280,"available":772854726656,"internally_reserved":0,"allocated":5226496,"data_stored":2665907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-406517,"num_objects":-125,"num_object_clones":0,"num_object_copies":-250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-125,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1514,"num_write":-911,"num_write_kb":-892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001896"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-17T06:33:36.167301+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:33:36.167301+0000","last_peered":"2023-11-17T06:33:36.167301+0000","last_clean":"2023-11-17T06:33:36.167301+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:33:36.167301+0000","last_undegraded":"2023-11-17T06:33:36.167301+0000","last_fullsized":"2023-11-17T06:33:36.167301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":771750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.218,"15min":1.3440000000000001},"min":{"1min":0.75,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.532,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.069},{"interface":"front","average":{"1min":1.107,"5min":1.2270000000000001,"15min":1.3740000000000001},"min":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7130000000000001,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3009999999999999,"15min":1.4370000000000001},"min":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.349},{"interface":"front","average":{"1min":1.141,"5min":1.3460000000000001,"15min":1.5549999999999999},"min":{"1min":0.79600000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.675,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.28,"15min":1.379},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6140000000000001,"5min":1.919,"15min":1.919},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1799999999999999,"15min":1.2250000000000001},"min":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.409,"5min":1.835,"15min":1.835},"last":1.165}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3899999999999999,"15min":1.5409999999999999},"min":{"1min":1.0489999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.639,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4690000000000001,"15min":1.6220000000000001},"min":{"1min":1.075,"5min":0.496,"15min":0.496},"max":{"1min":1.7250000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.167,"15min":1.256},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.385,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.296,"15min":1.4119999999999999},"min":{"1min":0.77200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.548,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.698}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3680000000000001,"15min":1.4910000000000001},"min":{"1min":0.65200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.7210000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.341,"15min":1.415},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5529999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4179999999999999,"15min":1.5309999999999999},"min":{"1min":0.66400000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5089999999999999,"5min":2.375,"15min":2.375},"last":1.494},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.411,"15min":1.4970000000000001},"min":{"1min":0.93600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7050000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":181362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.119,"15min":1.1160000000000001},"min":{"1min":0.65600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.554,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1719999999999999},"min":{"1min":0.77200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.492,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.571,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.256,"15min":1.292},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7050000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.95099999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2729999999999999,"15min":1.321},"min":{"1min":1.127,"5min":0.87,"15min":0.87},"max":{"1min":1.6120000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.294,"15min":1.3560000000000001},"min":{"1min":0.97999999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.546,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.248,"15min":1.3200000000000001},"min":{"1min":0.98799999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4239999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.252,"15min":1.3320000000000001},"min":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4570000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3360000000000001,"15min":1.4219999999999999},"min":{"1min":0.77200000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6459999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.331}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.274},"min":{"1min":0.88200000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.609,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":0.97599999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6459999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.472,"15min":1.532},"min":{"1min":1.085,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9430000000000001,"5min":2.548,"15min":2.548},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.444,"5min":1.4339999999999999,"15min":1.494},"min":{"1min":1.0880000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.849,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0980000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.667},{"interface":"front","average":{"1min":1.125,"5min":1.228,"15min":1.327},"min":{"1min":0.78800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.5309999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.232},"min":{"1min":0.73999999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4279999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.302},{"interface":"front","average":{"1min":1.234,"5min":1.2709999999999999,"15min":1.329},"min":{"1min":0.99199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2250000000000001,"15min":1.28},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6279999999999999,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.712},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.292,"15min":1.3839999999999999},"min":{"1min":0.86899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4650000000000001,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.026}]},{"osd":3,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.351,"15min":1.4390000000000001},"min":{"1min":0.94999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.538,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.141},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.405,"15min":1.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8480000000000001,"5min":3.48,"15min":3.48},"last":1.6080000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.3160000000000001,"15min":1.3620000000000001},"min":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.6599999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3999999999999999,"15min":1.5169999999999999},"min":{"1min":0.79800000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.752,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.76700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.776,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.869},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4630000000000001,"15min":1.5529999999999999},"min":{"1min":0.97799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8009999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.456}]},{"osd":7,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.514,"15min":1.6120000000000001},"min":{"1min":1.1499999999999999,"5min":0.748,"15min":0.748},"max":{"1min":1.8879999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5669999999999999,"15min":1.649},"min":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9139999999999999,"5min":3.355,"15min":3.355},"last":1.7909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.165,"15min":1.161},"min":{"1min":0.79600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6890000000000001,"5min":2.286,"15min":2.286},"last":1.427},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.21},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.498,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.194,"15min":1.1619999999999999},"min":{"1min":0.92700000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6160000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.393,"15min":1.619},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.45,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3799999999999999,"15min":1.5409999999999999},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.554,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.004}]},{"osd":3,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.22,"15min":1.2170000000000001},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5429999999999999,"5min":2.399,"15min":2.399},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5189999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.22,"15min":1.1779999999999999},"min":{"1min":0.85399999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.2450000000000001,"15min":1.27},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5820000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.605}]},{"osd":6,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.294,"15min":1.3660000000000001},"min":{"1min":0.745,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5449999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.76},{"interface":"front","average":{"1min":1.345,"5min":1.4079999999999999,"15min":1.468},"min":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.915,"5min":2.681,"15min":2.681},"last":1.5720000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3,"15min":1.3440000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.484,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6240000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.917}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":187122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.0049999999999999,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.4570000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.069,"5min":1.125,"15min":1.163},"min":{"1min":0.69599999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3129999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.68300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4059999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.1339999999999999,"15min":1.218},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6240000000000001,"5min":1.907,"15min":1.907},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.329,"15min":1.427},"min":{"1min":0.97999999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.4850000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.343,"15min":1.425},"min":{"1min":0.89400000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6910000000000001,"5min":2.359,"15min":2.359},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":1.014,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.587,"5min":2.375,"15min":2.375},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.373,"15min":1.4850000000000001},"min":{"1min":0.91200000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6279999999999999,"5min":2.202,"15min":2.202},"last":1.018}]},{"osd":6,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.413,"15min":1.492},"min":{"1min":1.0609999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.6060000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4219999999999999,"15min":1.5349999999999999},"min":{"1min":1.0149999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.667,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.5820000000000001},"min":{"1min":1.032,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.7070000000000001,"5min":2.431,"15min":2.431},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.4850000000000001,"15min":1.591},"min":{"1min":1.1379999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.7689999999999999,"5min":2.427,"15min":2.427},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.073,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90700000000000003,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.86299999999999999,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1910000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0389999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.133,"15min":1.1930000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4610000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.319}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":1.0189999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.637,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.389},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.22,"15min":1.282},"min":{"1min":0.94099999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3859999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.1930000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.306,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.4119999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.998},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.399,"15min":1.4530000000000001},"min":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.577,"5min":1.948,"15min":1.948},"last":1.133}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.361,"15min":1.4299999999999999},"min":{"1min":1.008,"5min":0.874,"15min":0.874},"max":{"1min":1.5209999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.506},"min":{"1min":1.0660000000000001,"5min":1.028,"15min":1.028},"max":{"1min":1.6479999999999999,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.413,"15min":1.4750000000000001},"min":{"1min":0.98299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5649999999999999,"5min":2.194,"15min":2.194},"last":1.504},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5049999999999999,"15min":1.575},"min":{"1min":1.2490000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.702,"5min":2.464,"15min":2.464},"last":1.2809999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0149999999999999,"15min":1.0109999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5389999999999999,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.64100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.466,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.0509999999999999},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5329999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.089,"15min":1.111},"min":{"1min":0.78200000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6140000000000001,"5min":2.262,"15min":2.262},"last":1.2050000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.244,"15min":1.3049999999999999},"min":{"1min":0.85399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1950000000000001,"15min":1.3149999999999999},"min":{"1min":0.82699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.343,"15min":1.3999999999999999},"min":{"1min":1.101,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.621,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.337},{"interface":"front","average":{"1min":1.208,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.679,"5min":3.891,"15min":3.891},"last":1.399}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3759999999999999,"15min":1.4259999999999999},"min":{"1min":1.0509999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4470000000000001,"15min":1.5549999999999999},"min":{"1min":1.097,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8440000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.538}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.536},"min":{"1min":1.153,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.835,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.5209999999999999,"15min":1.593},"min":{"1min":1.018,"5min":0.88,"15min":0.88},"max":{"1min":1.8759999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.163}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.546,"15min":1.6699999999999999},"min":{"1min":0.98599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.9159999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.5349999999999999,"15min":1.615},"min":{"1min":1.2210000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.056,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.49}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.92300000000000004},"min":{"1min":0.68300000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1579999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.141,"15min":1.109},"min":{"1min":0.80900000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.417,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.95699999999999996},"min":{"1min":0.73699999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3049999999999999,"5min":1.905,"15min":1.905},"last":0.995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.5669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0820000000000001,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6299999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.302,"5min":1.286,"15min":1.3360000000000001},"min":{"1min":1.0069999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7250000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.292,"15min":1.254},"min":{"1min":1.054,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.494,"5min":2.504,"15min":2.504},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":1.089,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5900000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.224}]},{"osd":5,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3859999999999999,"15min":1.425},"min":{"1min":1.0189999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5449999999999999,"5min":3.121,"15min":3.121},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":1.129,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6479999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.329}]},{"osd":6,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.427,"15min":1.4870000000000001},"min":{"1min":1.1399999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.7070000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.6839999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.482,"15min":1.528},"min":{"1min":1.1140000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.784,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.45},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4710000000000001,"15min":1.5049999999999999},"min":{"1min":1.2130000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.6799999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.121}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:39.965 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-17T06:33:39.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:40.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.146+0000 7fce7c84e700 1 Processor -- start 2023-11-17T06:33:40.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.146+0000 7fce7c84e700 1 -- start start 2023-11-17T06:33:40.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7c84e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce780cc0f0 0x7fce780ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7c84e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780ccaa0 0x7fce780ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7c84e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce78165740 con 0x7fce780cd870 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7c84e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce780cdc50 con 0x7fce780cc0f0 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7c84e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce780cead0 con 0x7fce780ccaa0 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce780cc0f0 0x7fce780ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce780cc0f0 0x7fce780ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59416/0 (socket says 172.21.15.100:59416) 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 -- 172.21.15.100:0/762282319 learned_addr learned my addr 172.21.15.100:0/762282319 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 -- 172.21.15.100:0/762282319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780ccaa0 msgr2=0x7fce780ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 --2- 172.21.15.100:0/762282319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780ccaa0 0x7fce780ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 -- 172.21.15.100:0/762282319 >> v1:172.21.15.119:6789/0 conn(0x7fce780cd870 legacy=0x7fce780cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 -- 172.21.15.100:0/762282319 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78165a20 con 0x7fce780cc0f0 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce7659c700 1 --2- 172.21.15.100:0/762282319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780cc0f0 0x7fce780ce050 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fce7815fba0 tx=0x7fce6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a853bb5881152aef server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce75d9b700 1 -- 172.21.15.100:0/762282319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00b860 con 0x7fce780cc0f0 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce75d9b700 1 -- 172.21.15.100:0/762282319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00b9c0 con 0x7fce780cc0f0 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.150+0000 7fce75d9b700 1 -- 172.21.15.100:0/762282319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00bd50 con 0x7fce780cc0f0 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 -- 172.21.15.100:0/762282319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780cc0f0 msgr2=0x7fce780ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 --2- 172.21.15.100:0/762282319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780cc0f0 0x7fce780ce050 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fce7815fba0 tx=0x7fce6c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 -- 172.21.15.100:0/762282319 shutdown_connections 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 --2- 172.21.15.100:0/762282319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780ccaa0 0x7fce780ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 --2- 172.21.15.100:0/762282319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780cc0f0 0x7fce780ce050 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 -- 172.21.15.100:0/762282319 >> 172.21.15.100:0/762282319 conn(0x7fce7806a480 msgr2=0x7fce7806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 -- 172.21.15.100:0/762282319 shutdown_connections 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.154+0000 7fce7c84e700 1 -- 172.21.15.100:0/762282319 wait complete. 2023-11-17T06:33:40.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 Processor -- start 2023-11-17T06:33:40.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 -- start start 2023-11-17T06:33:40.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780cc0f0 0x7fce780b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce780cd870 0x7fce780c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780b27d0 con 0x7fce780ccaa0 2023-11-17T06:33:40.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780b2ab0 con 0x7fce780cd870 2023-11-17T06:33:40.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7c84e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce780b2d90 con 0x7fce780cc0f0 2023-11-17T06:33:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59418/0 (socket says 172.21.15.100:59418) 2023-11-17T06:33:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce780cd870 0x7fce780c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce7659c700 1 -- 172.21.15.100:0/1589914130 learned_addr learned my addr 172.21.15.100:0/1589914130 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.158+0000 7fce76d9d700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780cc0f0 0x7fce780b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 -- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780cc0f0 msgr2=0x7fce780b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780cc0f0 0x7fce780b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 -- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce780cd870 msgr2=0x7fce780c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce780cd870 0x7fce780c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 -- 172.21.15.100:0/1589914130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009570 con 0x7fce780ccaa0 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7659c700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000c00 tx=0x7fce6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0038c0 con 0x7fce780ccaa0 2023-11-17T06:33:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c01e070 con 0x7fce780ccaa0 2023-11-17T06:33:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce780b3070 con 0x7fce780ccaa0 2023-11-17T06:33:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c003c80 con 0x7fce780ccaa0 2023-11-17T06:33:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7815d6f0 con 0x7fce780ccaa0 2023-11-17T06:33:40.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.162+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce780b3590 con 0x7fce780ccaa0 2023-11-17T06:33:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.166+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce6c011420 con 0x7fce780ccaa0 2023-11-17T06:33:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.166+0000 7fce5f7fe700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 0x7fce640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.166+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fce6c020070 con 0x7fce780ccaa0 2023-11-17T06:33:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.166+0000 7fce76d9d700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 0x7fce640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.170+0000 7fce76d9d700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 0x7fce640689d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce780b1b10 tx=0x7fce68007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.170+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce6c052a10 con 0x7fce780ccaa0 2023-11-17T06:33:40.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.346+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce78165fe0 con 0x7fce64066510 2023-11-17T06:33:40.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.350+0000 7fce5f7fe700 1 -- 172.21.15.100:0/1589914130 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48478 (secure 0 0 0) 0x7fce68003d90 con 0x7fce64066510 2023-11-17T06:33:40.357 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:40.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 msgr2=0x7fce640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 0x7fce640689d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce780b1b10 tx=0x7fce68007ee0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 msgr2=0x7fce780b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000c00 tx=0x7fce6c004770 comp rx=0 tx=0).stop 2023-11-17T06:33:40.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 shutdown_connections 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce780cd870 0x7fce780c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fce64066510 0x7fce640689d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce780ccaa0 0x7fce780b20c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 --2- 172.21.15.100:0/1589914130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce780cc0f0 0x7fce780b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 >> 172.21.15.100:0/1589914130 conn(0x7fce7806a480 msgr2=0x7fce7806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 shutdown_connections 2023-11-17T06:33:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.354+0000 7fce7c84e700 1 -- 172.21.15.100:0/1589914130 wait complete. 2023-11-17T06:33:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:33:40.382 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-11-17T06:33:39.347774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233776,"kb_used_data":5104,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740944,"statfs":{"total":773094113280,"available":772854726656,"internally_reserved":0,"allocated":5226496,"data_stored":2665907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-406517,"num_objects":-125,"num_object_clones":0,"num_object_copies":-250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-125,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1514,"num_write":-911,"num_write_kb":-892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001896"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-17T06:33:36.167301+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:33:36.167301+0000","last_peered":"2023-11-17T06:33:36.167301+0000","last_clean":"2023-11-17T06:33:36.167301+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:33:36.167301+0000","last_undegraded":"2023-11-17T06:33:36.167301+0000","last_fullsized":"2023-11-17T06:33:36.167301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":771750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.218,"15min":1.3440000000000001},"min":{"1min":0.75,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.532,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.069},{"interface":"front","average":{"1min":1.107,"5min":1.2270000000000001,"15min":1.3740000000000001},"min":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7130000000000001,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3009999999999999,"15min":1.4370000000000001},"min":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.349},{"interface":"front","average":{"1min":1.141,"5min":1.3460000000000001,"15min":1.5549999999999999},"min":{"1min":0.79600000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.675,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.28,"15min":1.379},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6140000000000001,"5min":1.919,"15min":1.919},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1799999999999999,"15min":1.2250000000000001},"min":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.409,"5min":1.835,"15min":1.835},"last":1.165}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3899999999999999,"15min":1.5409999999999999},"min":{"1min":1.0489999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.639,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4690000000000001,"15min":1.6220000000000001},"min":{"1min":1.075,"5min":0.496,"15min":0.496},"max":{"1min":1.7250000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.167,"15min":1.256},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.385,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.296,"15min":1.4119999999999999},"min":{"1min":0.77200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.548,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.698}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3680000000000001,"15min":1.4910000000000001},"min":{"1min":0.65200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.7210000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.341,"15min":1.415},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5529999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4179999999999999,"15min":1.5309999999999999},"min":{"1min":0.66400000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5089999999999999,"5min":2.375,"15min":2.375},"last":1.494},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.411,"15min":1.4970000000000001},"min":{"1min":0.93600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7050000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":181362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.119,"15min":1.1160000000000001},"min":{"1min":0.65600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.554,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1719999999999999},"min":{"1min":0.77200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.492,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.571,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.256,"15min":1.292},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7050000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.95099999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2729999999999999,"15min":1.321},"min":{"1min":1.127,"5min":0.87,"15min":0.87},"max":{"1min":1.6120000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.294,"15min":1.3560000000000001},"min":{"1min":0.97999999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.546,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.248,"15min":1.3200000000000001},"min":{"1min":0.98799999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4239999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.252,"15min":1.3320000000000001},"min":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4570000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3360000000000001,"15min":1.4219999999999999},"min":{"1min":0.77200000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6459999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.331}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.274},"min":{"1min":0.88200000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.609,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":0.97599999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6459999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.472,"15min":1.532},"min":{"1min":1.085,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9430000000000001,"5min":2.548,"15min":2.548},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.444,"5min":1.4339999999999999,"15min":1.494},"min":{"1min":1.0880000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.849,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0980000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.667},{"interface":"front","average":{"1min":1.125,"5min":1.228,"15min":1.327},"min":{"1min":0.78800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.5309999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.232},"min":{"1min":0.73999999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4279999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.302},{"interface":"front","average":{"1min":1.234,"5min":1.2709999999999999,"15min":1.329},"min":{"1min":0.99199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2250000000000001,"15min":1.28},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6279999999999999,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.712},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.292,"15min":1.3839999999999999},"min":{"1min":0.86899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4650000000000001,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.026}]},{"osd":3,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.351,"15min":1.4390000000000001},"min":{"1min":0.94999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.538,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.141},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.405,"15min":1.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8480000000000001,"5min":3.48,"15min":3.48},"last":1.6080000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.3160000000000001,"15min":1.3620000000000001},"min":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.6599999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3999999999999999,"15min":1.5169999999999999},"min":{"1min":0.79800000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.752,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.76700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.776,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.869},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4630000000000001,"15min":1.5529999999999999},"min":{"1min":0.97799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8009999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.456}]},{"osd":7,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.514,"15min":1.6120000000000001},"min":{"1min":1.1499999999999999,"5min":0.748,"15min":0.748},"max":{"1min":1.8879999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5669999999999999,"15min":1.649},"min":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9139999999999999,"5min":3.355,"15min":3.355},"last":1.7909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.165,"15min":1.161},"min":{"1min":0.79600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6890000000000001,"5min":2.286,"15min":2.286},"last":1.427},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.21},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.498,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.194,"15min":1.1619999999999999},"min":{"1min":0.92700000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6160000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.393,"15min":1.619},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.45,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3799999999999999,"15min":1.5409999999999999},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.554,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.004}]},{"osd":3,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.22,"15min":1.2170000000000001},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5429999999999999,"5min":2.399,"15min":2.399},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5189999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.22,"15min":1.1779999999999999},"min":{"1min":0.85399999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.137},{"interface":"front","average":{"1min":1.163,"5min":1.2450000000000001,"15min":1.27},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5820000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.605}]},{"osd":6,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.294,"15min":1.3660000000000001},"min":{"1min":0.745,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5449999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.76},{"interface":"front","average":{"1min":1.345,"5min":1.4079999999999999,"15min":1.468},"min":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.915,"5min":2.681,"15min":2.681},"last":1.5720000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3,"15min":1.3440000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.484,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6240000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.917}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":187122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.0049999999999999,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.4570000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.069,"5min":1.125,"15min":1.163},"min":{"1min":0.69599999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3129999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.68300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4059999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.1339999999999999,"15min":1.218},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6240000000000001,"5min":1.907,"15min":1.907},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.329,"15min":1.427},"min":{"1min":0.97999999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.4850000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.343,"15min":1.425},"min":{"1min":0.89400000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6910000000000001,"5min":2.359,"15min":2.359},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":1.014,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.587,"5min":2.375,"15min":2.375},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.373,"15min":1.4850000000000001},"min":{"1min":0.91200000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6279999999999999,"5min":2.202,"15min":2.202},"last":1.018}]},{"osd":6,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.413,"15min":1.492},"min":{"1min":1.0609999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.6060000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4219999999999999,"15min":1.5349999999999999},"min":{"1min":1.0149999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.667,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.5820000000000001},"min":{"1min":1.032,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.7070000000000001,"5min":2.431,"15min":2.431},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.4850000000000001,"15min":1.591},"min":{"1min":1.1379999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.7689999999999999,"5min":2.427,"15min":2.427},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.073,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90700000000000003,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.86299999999999999,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1910000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0389999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.133,"15min":1.1930000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4610000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.319}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":1.0189999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.637,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.389},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.22,"15min":1.282},"min":{"1min":0.94099999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3859999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.1930000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.306,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.4119999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.998},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.399,"15min":1.4530000000000001},"min":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.577,"5min":1.948,"15min":1.948},"last":1.133}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.361,"15min":1.4299999999999999},"min":{"1min":1.008,"5min":0.874,"15min":0.874},"max":{"1min":1.5209999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.506},"min":{"1min":1.0660000000000001,"5min":1.028,"15min":1.028},"max":{"1min":1.6479999999999999,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.413,"15min":1.4750000000000001},"min":{"1min":0.98299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5649999999999999,"5min":2.194,"15min":2.194},"last":1.504},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5049999999999999,"15min":1.575},"min":{"1min":1.2490000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.702,"5min":2.464,"15min":2.464},"last":1.2809999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0149999999999999,"15min":1.0109999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5389999999999999,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.64100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.466,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.0509999999999999},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5329999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.089,"15min":1.111},"min":{"1min":0.78200000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6140000000000001,"5min":2.262,"15min":2.262},"last":1.2050000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.244,"15min":1.3049999999999999},"min":{"1min":0.85399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1950000000000001,"15min":1.3149999999999999},"min":{"1min":0.82699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.343,"15min":1.3999999999999999},"min":{"1min":1.101,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.621,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.337},{"interface":"front","average":{"1min":1.208,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.679,"5min":3.891,"15min":3.891},"last":1.399}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3759999999999999,"15min":1.4259999999999999},"min":{"1min":1.0509999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4470000000000001,"15min":1.5549999999999999},"min":{"1min":1.097,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8440000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.538}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.536},"min":{"1min":1.153,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.835,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.5209999999999999,"15min":1.593},"min":{"1min":1.018,"5min":0.88,"15min":0.88},"max":{"1min":1.8759999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.163}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.546,"15min":1.6699999999999999},"min":{"1min":0.98599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.9159999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.5349999999999999,"15min":1.615},"min":{"1min":1.2210000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.056,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.49}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.92300000000000004},"min":{"1min":0.68300000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1579999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.141,"15min":1.109},"min":{"1min":0.80900000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.417,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.95699999999999996},"min":{"1min":0.73699999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3049999999999999,"5min":1.905,"15min":1.905},"last":0.995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.5669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0820000000000001,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6299999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.302,"5min":1.286,"15min":1.3360000000000001},"min":{"1min":1.0069999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7250000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.2569999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.292,"15min":1.254},"min":{"1min":1.054,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.494,"5min":2.504,"15min":2.504},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":1.089,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5900000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.224}]},{"osd":5,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3859999999999999,"15min":1.425},"min":{"1min":1.0189999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5449999999999999,"5min":3.121,"15min":3.121},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":1.129,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6479999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.329}]},{"osd":6,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.427,"15min":1.4870000000000001},"min":{"1min":1.1399999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.7070000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.6839999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.482,"15min":1.528},"min":{"1min":1.1140000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.784,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.45},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4710000000000001,"15min":1.5049999999999999},"min":{"1min":1.2130000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.6799999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.121}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:40.383 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.550+0000 7f922f59e700 1 Processor -- start 2023-11-17T06:33:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.550+0000 7f922f59e700 1 -- start start 2023-11-17T06:33:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922f59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f923015e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922f59e700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923015de40 con 0x7f92300ce7c0 2023-11-17T06:33:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922f59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92300cab40 con 0x7f92300ca310 2023-11-17T06:33:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922f59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923015ee40 con 0x7f92300cbb10 2023-11-17T06:33:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f9225d9b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f92300ce7c0 0x7f92300cbef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48278/0 (socket says 172.21.15.100:48278) 2023-11-17T06:33:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f9225d9b700 1 -- 172.21.15.100:0/4292085493 learned_addr learned my addr 172.21.15.100:0/4292085493 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922e59c700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f923015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548396650 0 0) 0x7f923015de40 con 0x7f92300ce7c0 2023-11-17T06:33:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f921c0035d0 con 0x7f92300ce7c0 2023-11-17T06:33:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179047425 0 0) 0x7f92300cab40 con 0x7f92300ca310 2023-11-17T06:33:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923015de40 con 0x7f92300ca310 2023-11-17T06:33:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 248631616 0 0) 0x7f921c0035d0 con 0x7f92300ce7c0 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 msgr2=0x7f923015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f923015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 >> v1:172.21.15.119:6789/0 conn(0x7f92300ca310 legacy=0x7f923015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300cae20 con 0x7f92300ce7c0 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922e59c700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f923015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7f92180019f0 con 0x7f92300ce7c0 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 >> v1:172.21.15.100:6789/0 conn(0x7f92300ce7c0 legacy=0x7f92300cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f921c003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c0041e0 0x7f921c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f921c004db0 0x7f921c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c00bbc0 con 0x7f921c004db0 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c00bd00 con 0x7f921c0041e0 2023-11-17T06:33:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.554+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c00bec0 con 0x7f92300cbb10 2023-11-17T06:33:40.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f921c004db0 0x7f921c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922e59c700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f921c003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 -- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 msgr2=0x7f921c003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:40.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f921c003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 -- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c0041e0 msgr2=0x7f921c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f9225d9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c0041e0 0x7f921c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c0041e0 0x7f921c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 -- 172.21.15.100:0/4292085493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200094b0 con 0x7f921c004db0 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922e59c700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92300cbb10 0x7f921c003c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f9225d9b700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f921c0041e0 0x7f921c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f921c004db0 0x7f921c005230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9228001960 tx=0x7f921c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499a670fc9600b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228001450 con 0x7f921c004db0 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280052f0 con 0x7f921c004db0 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922dd9b700 1 -- 172.21.15.100:0/4292085493 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280036a0 con 0x7f921c004db0 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 -- 172.21.15.100:0/4292085493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f921c004db0 msgr2=0x7f921c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 --2- 172.21.15.100:0/4292085493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f921c004db0 0x7f921c005230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9228001960 tx=0x7f921c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922ed9d700 1 -- 172.21.15.100:0/4292085493 reap_dead start 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 -- 172.21.15.100:0/4292085493 shutdown_connections 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 -- 172.21.15.100:0/4292085493 >> 172.21.15.100:0/4292085493 conn(0x7f923006a480 msgr2=0x7f923006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 -- 172.21.15.100:0/4292085493 shutdown_connections 2023-11-17T06:33:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.558+0000 7f922f59e700 1 -- 172.21.15.100:0/4292085493 wait complete. 2023-11-17T06:33:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.562+0000 7f922f59e700 1 Processor -- start 2023-11-17T06:33:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.562+0000 7f922f59e700 1 -- start start 2023-11-17T06:33:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.562+0000 7f922f59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f921c004db0 0x7f92300c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.562+0000 7f922f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923014be30 0x7f9230159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92301f4c80 con 0x7f92301598d0 2023-11-17T06:33:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92301f5ae0 con 0x7f923014be30 2023-11-17T06:33:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92301f7f10 con 0x7f921c004db0 2023-11-17T06:33:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59432/0 (socket says 172.21.15.100:59432) 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 -- 172.21.15.100:0/1631291212 learned_addr learned my addr 172.21.15.100:0/1631291212 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922e59c700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f921c004db0 0x7f92300c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f9225d9b700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923014be30 0x7f9230159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 -- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f921c004db0 msgr2=0x7f92300c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f921c004db0 0x7f92300c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 -- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923014be30 msgr2=0x7f9230159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923014be30 0x7f9230159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 -- 172.21.15.100:0/1631291212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300c51f0 con 0x7f92301598d0 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922ed9d700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9228007fd0 tx=0x7f92280012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228006c90 con 0x7f92301598d0 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9228006df0 con 0x7f92301598d0 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228007280 con 0x7f92301598d0 2023-11-17T06:33:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92301f4ed0 con 0x7f92301598d0 2023-11-17T06:33:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92301f5490 con 0x7f92301598d0 2023-11-17T06:33:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.566+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92301f5c90 con 0x7f92301598d0 2023-11-17T06:33:40.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.570+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92280073e0 con 0x7f92301598d0 2023-11-17T06:33:40.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.570+0000 7f92277fe700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 0x7f92100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:40.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.570+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9228084850 con 0x7f92301598d0 2023-11-17T06:33:40.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.570+0000 7f922e59c700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 0x7f92100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.574+0000 7f922e59c700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 0x7f92100689d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9230156340 tx=0x7f9220008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:40.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.578+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92301f5c90 con 0x7f92301598d0 2023-11-17T06:33:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.754+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f923015e0d0 con 0x7f92301598d0 2023-11-17T06:33:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.754+0000 7f92277fe700 1 -- 172.21.15.100:0/1631291212 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13276 (secure 0 0 0) 0x7f92280520d0 con 0x7f92301598d0 2023-11-17T06:33:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:40.761 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"85721606-40d2-46b5-8d45-5c90fa8b3283","created":"2023-11-17T06:28:28.949966+0000","modified":"2023-11-17T06:33:36.947351+0000","last_up_change":"2023-11-17T06:28:41.742148+0000","last_in_change":"2023-11-17T06:28:31.976739+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:28:43.341030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f700d1-b862-4a65-bf0c-e669adaadd53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6803","nonce":1609678627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6807","nonce":1609678627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6818","nonce":1609678627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1609678627},{"type":"v1","addr":"172.21.15.100:6811","nonce":1609678627}]},"public_addr":"172.21.15.100:6803/1609678627","cluster_addr":"172.21.15.100:6807/1609678627","heartbeat_back_addr":"172.21.15.100:6818/1609678627","heartbeat_front_addr":"172.21.15.100:6811/1609678627","state":["exists","up"]},{"osd":1,"uuid":"c176d34f-ad5f-4155-9773-b444ca4c9233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6808","nonce":897523512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6813","nonce":897523512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6823","nonce":897523512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":897523512},{"type":"v1","addr":"172.21.15.100:6819","nonce":897523512}]},"public_addr":"172.21.15.100:6808/897523512","cluster_addr":"172.21.15.100:6813/897523512","heartbeat_back_addr":"172.21.15.100:6823/897523512","heartbeat_front_addr":"172.21.15.100:6819/897523512","state":["exists","up"]},{"osd":2,"uuid":"b1287d99-b295-460b-83f7-9fbf8a228073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6825","nonce":177771602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6827","nonce":177771602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6831","nonce":177771602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":177771602},{"type":"v1","addr":"172.21.15.100:6829","nonce":177771602}]},"public_addr":"172.21.15.100:6825/177771602","cluster_addr":"172.21.15.100:6827/177771602","heartbeat_back_addr":"172.21.15.100:6831/177771602","heartbeat_front_addr":"172.21.15.100:6829/177771602","state":["exists","up"]},{"osd":3,"uuid":"96716903-24b6-4d40-9b89-0d43029059e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6802","nonce":2990712957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6810","nonce":2990712957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6822","nonce":2990712957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2990712957},{"type":"v1","addr":"172.21.15.100:6817","nonce":2990712957}]},"public_addr":"172.21.15.100:6802/2990712957","cluster_addr":"172.21.15.100:6810/2990712957","heartbeat_back_addr":"172.21.15.100:6822/2990712957","heartbeat_front_addr":"172.21.15.100:6817/2990712957","state":["exists","up"]},{"osd":4,"uuid":"20bae931-eff1-4366-a524-72d7306c91c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6825","nonce":3894860840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6827","nonce":3894860840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6831","nonce":3894860840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3894860840},{"type":"v1","addr":"172.21.15.119:6829","nonce":3894860840}]},"public_addr":"172.21.15.119:6825/3894860840","cluster_addr":"172.21.15.119:6827/3894860840","heartbeat_back_addr":"172.21.15.119:6831/3894860840","heartbeat_front_addr":"172.21.15.119:6829/3894860840","state":["exists","up"]},{"osd":5,"uuid":"6b296c1e-1def-438b-8636-afafc681a28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6813","nonce":2475678651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475678651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475678651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475678651},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475678651}]},"public_addr":"172.21.15.119:6813/2475678651","cluster_addr":"172.21.15.119:6819/2475678651","heartbeat_back_addr":"172.21.15.119:6823/2475678651","heartbeat_front_addr":"172.21.15.119:6821/2475678651","state":["exists","up"]},{"osd":6,"uuid":"fb421d73-4e05-4517-8d38-0fd4ac3ea4c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6801","nonce":1264916422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6803","nonce":1264916422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6807","nonce":1264916422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1264916422},{"type":"v1","addr":"172.21.15.119:6805","nonce":1264916422}]},"public_addr":"172.21.15.119:6801/1264916422","cluster_addr":"172.21.15.119:6803/1264916422","heartbeat_back_addr":"172.21.15.119:6807/1264916422","heartbeat_front_addr":"172.21.15.119:6805/1264916422","state":["exists","up"]},{"osd":7,"uuid":"4f0a5445-b221-4642-9ce9-385bf3d1dad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6809","nonce":609004044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6811","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6812","nonce":609004044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6818","nonce":609004044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":609004044},{"type":"v1","addr":"172.21.15.119:6815","nonce":609004044}]},"public_addr":"172.21.15.119:6809/609004044","cluster_addr":"172.21.15.119:6812/609004044","heartbeat_back_addr":"172.21.15.119:6818/609004044","heartbeat_front_addr":"172.21.15.119:6815/609004044","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.846675+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.649928+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.725735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.856665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.967944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.692186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.749914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:28:37.931117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6835/3740073099":"2023-11-18T06:33:10.144059+0000","172.21.15.100:6837/3260089866":"2023-11-18T06:33:33.927046+0000","172.21.15.100:6835/3260089866":"2023-11-18T06:33:33.927046+0000","172.21.15.119:6835/1192926084":"2023-11-18T06:31:29.231194+0000","172.21.15.119:6833/1192926084":"2023-11-18T06:31:29.231194+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:40.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 msgr2=0x7f92100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 0x7f92100689d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9230156340 tx=0x7f9220008040 comp rx=0 tx=0).stop 2023-11-17T06:33:40.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 msgr2=0x7f92301f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:40.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9228007fd0 tx=0x7f92280012d0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 shutdown_connections 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9210066510 0x7f92100689d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92301598d0 0x7f92301f70b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f923014be30 0x7f9230159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 --2- 172.21.15.100:0/1631291212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f921c004db0 0x7f92300c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 >> 172.21.15.100:0/1631291212 conn(0x7f923006a480 msgr2=0x7f923015ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 shutdown_connections 2023-11-17T06:33:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:40.758+0000 7f922f59e700 1 -- 172.21.15.100:0/1631291212 wait complete. 2023-11-17T06:33:41.789 INFO:tasks.ceph:Scrubbing osd.0 2023-11-17T06:33:41.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.962+0000 7fc6d168f700 1 Processor -- start 2023-11-17T06:33:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 -- start start 2023-11-17T06:33:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6cc160950 0x7fc6cc0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc160d30 con 0x7fc6cc0b6790 2023-11-17T06:33:41.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ce8f0 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6d168f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0d2110 con 0x7fc6cc160950 2023-11-17T06:33:41.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6ca7fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6ca7fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48254/0 (socket says 172.21.15.100:48254) 2023-11-17T06:33:41.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.966+0000 7fc6ca7fc700 1 -- 172.21.15.100:0/1867696580 learned_addr learned my addr 172.21.15.100:0/1867696580 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:41.974 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6caffd700 1 --2- 172.21.15.100:0/1867696580 >> v2:172.21.15.119:3300/0 conn(0x7fc6cc160950 0x7fc6cc0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6ca7fc700 1 -- 172.21.15.100:0/1867696580 >> v2:172.21.15.119:3300/0 conn(0x7fc6cc160950 msgr2=0x7fc6cc0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:41.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6ca7fc700 1 --2- 172.21.15.100:0/1867696580 >> v2:172.21.15.119:3300/0 conn(0x7fc6cc160950 0x7fc6cc0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6ca7fc700 1 -- 172.21.15.100:0/1867696580 >> v1:172.21.15.119:6789/0 conn(0x7fc6cc0b6790 legacy=0x7fc6cc0cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:41.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6ca7fc700 1 -- 172.21.15.100:0/1867696580 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0b2790 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6ca7fc700 1 --2- 172.21.15.100:0/1867696580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b5d20 tx=0x7fc6c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7a616b513cf92 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:41.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6c9ffb700 1 -- 172.21.15.100:0/1867696580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011830 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6c9ffb700 1 -- 172.21.15.100:0/1867696580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0011990 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6c9ffb700 1 -- 172.21.15.100:0/1867696580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011d20 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 -- 172.21.15.100:0/1867696580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b8f80 msgr2=0x7fc6cc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 --2- 172.21.15.100:0/1867696580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b5d20 tx=0x7fc6c0009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 -- 172.21.15.100:0/1867696580 shutdown_connections 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 --2- 172.21.15.100:0/1867696580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc0b6250 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 --2- 172.21.15.100:0/1867696580 >> v2:172.21.15.119:3300/0 conn(0x7fc6cc160950 0x7fc6cc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 -- 172.21.15.100:0/1867696580 >> 172.21.15.100:0/1867696580 conn(0x7fc6cc06acf0 msgr2=0x7fc6cc06b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:41.977 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 -- 172.21.15.100:0/1867696580 shutdown_connections 2023-11-17T06:33:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.970+0000 7fc6d168f700 1 -- 172.21.15.100:0/1867696580 wait complete. 2023-11-17T06:33:41.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.974+0000 7fc6d168f700 1 Processor -- start 2023-11-17T06:33:41.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.974+0000 7fc6d168f700 1 -- start start 2023-11-17T06:33:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 0x7fc6cc1f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6cc160950 0x7fc6cc0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b6c80 con 0x7fc6cc0b6790 2023-11-17T06:33:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1f3250 con 0x7fc6cc0b8f80 2023-11-17T06:33:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cc840 con 0x7fc6cc160950 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 0x7fc6cc1f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 0x7fc6cc1f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48256/0 (socket says 172.21.15.100:48256) 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 -- 172.21.15.100:0/4129791735 learned_addr learned my addr 172.21.15.100:0/4129791735 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6ca7fc700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6cb7fe700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6cc160950 0x7fc6cc0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 -- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6cc160950 msgr2=0x7fc6cc0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6cc160950 0x7fc6cc0cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 -- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6cc0b8f80 msgr2=0x7fc6cc1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6cc0b8f80 0x7fc6cc1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009570 con 0x7fc6cc0b6790 2023-11-17T06:33:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6caffd700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 0x7fc6cc1f2d10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e870 tx=0x7fc6bc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:41.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0095a0 con 0x7fc6cc0b6790 2023-11-17T06:33:41.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc013680 con 0x7fc6cc0b6790 2023-11-17T06:33:41.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0b6ed0 con 0x7fc6cc0b6790 2023-11-17T06:33:41.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0139f0 con 0x7fc6cc0b6790 2023-11-17T06:33:41.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.978+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0b7490 con 0x7fc6cc0b6790 2023-11-17T06:33:41.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.982+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6cc0ce610 con 0x7fc6cc0b6790 2023-11-17T06:33:41.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.982+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6bc013b50 con 0x7fc6cc0b6790 2023-11-17T06:33:41.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6b37fe700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc6b8066510 0x7fc6b80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc6bc083e10 con 0x7fc6cc0b6790 2023-11-17T06:33:41.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6b37fe700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7fc6b806c4b0 0x7fc6b806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:41.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6ca7fc700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc6b8066510 0x7fc6b80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6b806ef80 con 0x7fc6b806c4b0 2023-11-17T06:33:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6bc084260 con 0x7fc6cc0b6790 2023-11-17T06:33:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6cb7fe700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7fc6b806c4b0 0x7fc6b806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6ca7fc700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc6b8066510 0x7fc6b80689d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.986+0000 7fc6cb7fe700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7fc6b806c4b0 0x7fc6b806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:41.990+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== osd.0 v2:172.21.15.100:6801/1609678627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc6b806ef80 con 0x7fc6b806c4b0 2023-11-17T06:33:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 --> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6cc0ce330 con 0x7fc6b806c4b0 2023-11-17T06:33:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6b37fe700 1 -- 172.21.15.100:0/4129791735 <== osd.0 v2:172.21.15.100:6801/1609678627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc6c4001fc0 con 0x7fc6b806c4b0 2023-11-17T06:33:42.012 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:42.012 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:42.012 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7fc6b806c4b0 msgr2=0x7fc6b806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6801/1609678627,v1:172.21.15.100:6803/1609678627] conn(0x7fc6b806c4b0 0x7fc6b806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc6b8066510 msgr2=0x7fc6b80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc6b8066510 0x7fc6b80689d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c0008030 comp rx=0 tx=0).stop 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 msgr2=0x7fc6cc1f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 --2- 172.21.15.100:0/4129791735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6cc0b6790 0x7fc6cc1f2d10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e870 tx=0x7fc6bc00eb80 comp rx=0 tx=0).stop 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6cb7fe700 1 -- 172.21.15.100:0/4129791735 reap_dead start 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 shutdown_connections 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 >> 172.21.15.100:0/4129791735 conn(0x7fc6cc06acf0 msgr2=0x7fc6cc0b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 shutdown_connections 2023-11-17T06:33:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.006+0000 7fc6d168f700 1 -- 172.21.15.100:0/4129791735 wait complete. 2023-11-17T06:33:42.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-17T06:33:42.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.206+0000 7f841780f700 1 Processor -- start 2023-11-17T06:33:42.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.206+0000 7f841780f700 1 -- start start 2023-11-17T06:33:42.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 0x7f841015fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84100cc440 0x7f84100701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84101589b0 0x7f8410158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841015efb0 con 0x7f84100cc440 2023-11-17T06:33:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100720a0 con 0x7f84100cc060 2023-11-17T06:33:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f841780f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410072380 con 0x7f84101589b0 2023-11-17T06:33:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84100cc440 0x7f84100701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84100cc440 0x7f84100701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48272/0 (socket says 172.21.15.100:48272) 2023-11-17T06:33:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 -- 172.21.15.100:0/3587378345 learned_addr learned my addr 172.21.15.100:0/3587378345 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f84155ab700 1 --2- 172.21.15.100:0/3587378345 >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 0x7f841015fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8415dac700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84101589b0 0x7f8410158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 -- 172.21.15.100:0/3587378345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84101589b0 msgr2=0x7f8410158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84101589b0 0x7f8410158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 -- 172.21.15.100:0/3587378345 >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 msgr2=0x7f841015fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 --2- 172.21.15.100:0/3587378345 >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 0x7f841015fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f8414daa700 1 -- 172.21.15.100:0/3587378345 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841015f250 con 0x7f84100cc440 2023-11-17T06:33:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.210+0000 7f84155ab700 1 --2- 172.21.15.100:0/3587378345 >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 0x7f841015fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f8414daa700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc440 0x7f84100701f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f84100726a0 tx=0x7f8400009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1782403e72b8a73 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f8407fff700 1 -- 172.21.15.100:0/3587378345 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400011830 con 0x7f84100cc440 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f8407fff700 1 -- 172.21.15.100:0/3587378345 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400011990 con 0x7f84100cc440 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f8407fff700 1 -- 172.21.15.100:0/3587378345 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400011d20 con 0x7f84100cc440 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 -- 172.21.15.100:0/3587378345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc440 msgr2=0x7f84100701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc440 0x7f84100701f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f84100726a0 tx=0x7f8400009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 -- 172.21.15.100:0/3587378345 shutdown_connections 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84101589b0 0x7f8410158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 --2- 172.21.15.100:0/3587378345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc440 0x7f84100701f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 --2- 172.21.15.100:0/3587378345 >> v2:172.21.15.119:3300/0 conn(0x7f84100cc060 0x7f841015fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 -- 172.21.15.100:0/3587378345 >> 172.21.15.100:0/3587378345 conn(0x7f84100b0f30 msgr2=0x7f84100b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 -- 172.21.15.100:0/3587378345 shutdown_connections 2023-11-17T06:33:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.214+0000 7f841780f700 1 -- 172.21.15.100:0/3587378345 wait complete. 2023-11-17T06:33:42.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 Processor -- start 2023-11-17T06:33:42.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 -- start start 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84100cc440 0x7f84101f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 0x7f84101f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84101f4f20 con 0x7f84100cc060 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410152a30 con 0x7f84101589b0 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f841780f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410152d10 con 0x7f84100cc440 2023-11-17T06:33:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48274/0 (socket says 172.21.15.100:48274) 2023-11-17T06:33:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 -- 172.21.15.100:0/1879327875 learned_addr learned my addr 172.21.15.100:0/1879327875 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f8414daa700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84100cc440 0x7f84101f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f8415dac700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 0x7f84101f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 -- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84100cc440 msgr2=0x7f84101f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84100cc440 0x7f84101f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 -- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 msgr2=0x7f84101f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 0x7f84101f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f84155ab700 1 -- 172.21.15.100:0/1879327875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0094b0 con 0x7f84100cc060 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.218+0000 7f8415dac700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 0x7f84101f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f84155ab700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ebe0 tx=0x7f840c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c009790 con 0x7f84100cc060 2023-11-17T06:33:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c00c850 con 0x7f84100cc060 2023-11-17T06:33:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00cbe0 con 0x7f84100cc060 2023-11-17T06:33:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400009570 con 0x7f84100cc060 2023-11-17T06:33:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84101532d0 con 0x7f84100cc060 2023-11-17T06:33:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.222+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841004eea0 con 0x7f84100cc060 2023-11-17T06:33:42.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.226+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f840c00cd40 con 0x7f84100cc060 2023-11-17T06:33:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.226+0000 7f8405ffb700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.226+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f840c0844d0 con 0x7f84100cc060 2023-11-17T06:33:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.226+0000 7f8414daa700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.226+0000 7f8414daa700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 0x7f83f40689d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84100726a0 tx=0x7f8400008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.230+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f840c051b80 con 0x7f84100cc060 2023-11-17T06:33:42.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.406+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f84100b1d20 con 0x7f83f4066510 2023-11-17T06:33:42.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.406+0000 7f8405ffb700 1 -- 172.21.15.100:0/1879327875 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8400011b00 con 0x7f83f4066510 2023-11-17T06:33:42.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 msgr2=0x7f83f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 0x7f83f40689d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84100726a0 tx=0x7f8400008030 comp rx=0 tx=0).stop 2023-11-17T06:33:42.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 msgr2=0x7f84101523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ebe0 tx=0x7f840c00eef0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 shutdown_connections 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84101589b0 0x7f84101f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84100cc440 0x7f84101f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 --2- 172.21.15.100:0/1879327875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84100cc060 0x7f84101523a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 >> 172.21.15.100:0/1879327875 conn(0x7f84100b0f30 msgr2=0x7f84100700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 shutdown_connections 2023-11-17T06:33:42.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.410+0000 7f841780f700 1 -- 172.21.15.100:0/1879327875 wait complete. 2023-11-17T06:33:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2023-11-17T06:33:42.438 INFO:tasks.ceph:Scrubbing osd.1 2023-11-17T06:33:42.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:42.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.610+0000 7fd382bde700 1 Processor -- start 2023-11-17T06:33:42.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.610+0000 7fd382bde700 1 -- start start 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd382bde700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c15d470 0x7fd37c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd382bde700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 0x7fd37c0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd382bde700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0d2100 con 0x7fd37c0d15a0 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd382bde700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0d31d0 con 0x7fd37c15d470 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd382bde700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0d0d00 con 0x7fd37c0d0310 2023-11-17T06:33:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c15d470 0x7fd37c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c15d470 0x7fd37c0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48286/0 (socket says 172.21.15.100:48286) 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 -- 172.21.15.100:0/3224950829 learned_addr learned my addr 172.21.15.100:0/3224950829 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd37bfff700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 0x7fd37c0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 -- 172.21.15.100:0/3224950829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 msgr2=0x7fd37c0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 0x7fd37c0d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 -- 172.21.15.100:0/3224950829 >> v1:172.21.15.119:6789/0 conn(0x7fd37c0d15a0 legacy=0x7fd37c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd38097a700 1 -- 172.21.15.100:0/3224950829 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0d28c0 con 0x7fd37c15d470 2023-11-17T06:33:42.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.614+0000 7fd37bfff700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 0x7fd37c0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:42.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd38097a700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c0b6410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd370009910 tx=0x7fd370009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4234263552a174d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd37b7fe700 1 -- 172.21.15.100:0/3224950829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000ba60 con 0x7fd37c15d470 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd37b7fe700 1 -- 172.21.15.100:0/3224950829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37000bbc0 con 0x7fd37c15d470 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd37b7fe700 1 -- 172.21.15.100:0/3224950829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370009e60 con 0x7fd37c15d470 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 -- 172.21.15.100:0/3224950829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 msgr2=0x7fd37c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c0b6410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd370009910 tx=0x7fd370009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 -- 172.21.15.100:0/3224950829 shutdown_connections 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d0310 0x7fd37c0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 --2- 172.21.15.100:0/3224950829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c0b6410 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 -- 172.21.15.100:0/3224950829 >> 172.21.15.100:0/3224950829 conn(0x7fd37c073620 msgr2=0x7fd37c073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 -- 172.21.15.100:0/3224950829 shutdown_connections 2023-11-17T06:33:42.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.618+0000 7fd382bde700 1 -- 172.21.15.100:0/3224950829 wait complete. 2023-11-17T06:33:42.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 Processor -- start 2023-11-17T06:33:42.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 -- start start 2023-11-17T06:33:42.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd37c0d0310 0x7fd37c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d15a0 0x7fd37c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c9de0 con 0x7fd37c15d470 2023-11-17T06:33:42.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c8f30 con 0x7fd37c0d0310 2023-11-17T06:33:42.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd382bde700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c9160 con 0x7fd37c0d15a0 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48292/0 (socket says 172.21.15.100:48292) 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 -- 172.21.15.100:0/769042319 learned_addr learned my addr 172.21.15.100:0/769042319 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd37bfff700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d15a0 0x7fd37c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38097a700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd37c0d0310 0x7fd37c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 -- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d15a0 msgr2=0x7fd37c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd37c0d15a0 0x7fd37c0b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 -- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd37c0d0310 msgr2=0x7fd37c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.622+0000 7fd38117b700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd37c0d0310 0x7fd37c0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd38117b700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370009570 con 0x7fd37c15d470 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd38117b700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c15b280 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd37400caa0 tx=0x7fd37400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374003c20 con 0x7fd37c15d470 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374003d80 con 0x7fd37c15d470 2023-11-17T06:33:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0c9440 con 0x7fd37c15d470 2023-11-17T06:33:42.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400aa20 con 0x7fd37c15d470 2023-11-17T06:33:42.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c0c9a00 con 0x7fd37c15d470 2023-11-17T06:33:42.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.626+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd37c0d2b10 con 0x7fd37c15d470 2023-11-17T06:33:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd37400ab80 con 0x7fd37c15d470 2023-11-17T06:33:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd360066510 0x7fd3600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd3740838e0 con 0x7fd37c15d470 2023-11-17T06:33:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd38097a700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd360066510 0x7fd3600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fd36006c4b0 0x7fd36006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd36006ef80 con 0x7fd36006c4b0 2023-11-17T06:33:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3740882c0 con 0x7fd37c15d470 2023-11-17T06:33:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.630+0000 7fd37bfff700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fd36006c4b0 0x7fd36006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.634+0000 7fd38097a700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd360066510 0x7fd3600689d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd370000c00 tx=0x7fd370008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.634+0000 7fd37bfff700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fd36006c4b0 0x7fd36006e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.634+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== osd.1 v2:172.21.15.100:6804/897523512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd36006ef80 con 0x7fd36006c4b0 2023-11-17T06:33:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 --> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd37c0d2340 con 0x7fd36006c4b0 2023-11-17T06:33:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd3797fa700 1 -- 172.21.15.100:0/769042319 <== osd.1 v2:172.21.15.100:6804/897523512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd36800c9f0 con 0x7fd36006c4b0 2023-11-17T06:33:42.659 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:42.660 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:42.660 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:42.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fd36006c4b0 msgr2=0x7fd36006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6804/897523512,v1:172.21.15.100:6808/897523512] conn(0x7fd36006c4b0 0x7fd36006e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd360066510 msgr2=0x7fd3600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd360066510 0x7fd3600689d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd370000c00 tx=0x7fd370008030 comp rx=0 tx=0).stop 2023-11-17T06:33:42.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 msgr2=0x7fd37c15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 --2- 172.21.15.100:0/769042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c15d470 0x7fd37c15b280 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd37400caa0 tx=0x7fd37400cdb0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd38117b700 1 -- 172.21.15.100:0/769042319 reap_dead start 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 shutdown_connections 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 >> 172.21.15.100:0/769042319 conn(0x7fd37c073620 msgr2=0x7fd37c0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 shutdown_connections 2023-11-17T06:33:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.654+0000 7fd382bde700 1 -- 172.21.15.100:0/769042319 wait complete. 2023-11-17T06:33:42.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-17T06:33:42.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.854+0000 7fe900989700 1 Processor -- start 2023-11-17T06:33:42.861 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.854+0000 7fe900989700 1 -- start start 2023-11-17T06:33:42.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8fc15e900 0x7fe8fc1651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc15de40 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc0cab40 con 0x7fe8fc0ce7c0 2023-11-17T06:33:42.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0cae20 con 0x7fe8fc15e900 2023-11-17T06:33:42.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fb7fe700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe8fc0cbb10 0x7fe8fc0cbef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52766/0 (socket says 172.21.15.100:52766) 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fb7fe700 1 -- 172.21.15.100:0/3701649203 learned_addr learned my addr 172.21.15.100:0/3701649203 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fbfff700 1 --2- 172.21.15.100:0/3701649203 >> v2:172.21.15.100:3300/0 conn(0x7fe8fc15e900 0x7fe8fc1651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457305054 0 0) 0x7fe8fc15de40 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e80057e0 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594528589 0 0) 0x7fe8fc0cab40 con 0x7fe8fc0ce7c0 2023-11-17T06:33:42.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fbfff700 1 -- 172.21.15.100:0/3701649203 >> v1:172.21.15.119:6789/0 conn(0x7fe8fc0ce7c0 legacy=0x7fe8fc0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fbfff700 1 -- 172.21.15.100:0/3701649203 >> v1:172.21.15.100:6789/0 conn(0x7fe8fc0cbb10 legacy=0x7fe8fc0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fbfff700 1 -- 172.21.15.100:0/3701649203 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc15e100 con 0x7fe8fc15e900 2023-11-17T06:33:42.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8fbfff700 1 --2- 172.21.15.100:0/3701649203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc15e900 0x7fe8fc1651d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009d90 tx=0x7fe8f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb4f12c6dbb52bd server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400e070 con 0x7fe8fc15e900 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f400bb20 con 0x7fe8fc15e900 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe8faffd700 1 -- 172.21.15.100:0/3701649203 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400bed0 con 0x7fe8fc15e900 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 -- 172.21.15.100:0/3701649203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc15e900 msgr2=0x7fe8fc1651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.858+0000 7fe900989700 1 --2- 172.21.15.100:0/3701649203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc15e900 0x7fe8fc1651d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009d90 tx=0x7fe8f400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 -- 172.21.15.100:0/3701649203 shutdown_connections 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 --2- 172.21.15.100:0/3701649203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc15e900 0x7fe8fc1651d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 -- 172.21.15.100:0/3701649203 >> 172.21.15.100:0/3701649203 conn(0x7fe8fc06a480 msgr2=0x7fe8fc06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 -- 172.21.15.100:0/3701649203 shutdown_connections 2023-11-17T06:33:42.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 -- 172.21.15.100:0/3701649203 wait complete. 2023-11-17T06:33:42.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.862+0000 7fe900989700 1 Processor -- start 2023-11-17T06:33:42.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- start start 2023-11-17T06:33:42.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0ce7c0 0x7fe8fc154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 0x7fe8fc155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc147960 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc153c30 con 0x7fe8fc0ce7c0 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c7a10 con 0x7fe8fc15e900 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48298/0 (socket says 172.21.15.100:48298) 2023-11-17T06:33:42.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 -- 172.21.15.100:0/3047251370 learned_addr learned my addr 172.21.15.100:0/3047251370 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:42.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8f2ffd700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0ce7c0 0x7fe8fc154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fbfff700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 0x7fe8fc155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 -- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 msgr2=0x7fe8fc155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 0x7fe8fc155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 -- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0ce7c0 msgr2=0x7fe8fc154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0ce7c0 0x7fe8fc154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 -- 172.21.15.100:0/3047251370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4009a70 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fbfff700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 0x7fe8fc155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:42.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8fb7fe700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4f0 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.876 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec005d90 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0070d0 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec007440 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc0c6970 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.866+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc0c6f30 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.870+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc0ca7e0 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.870+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8ec0075a0 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.870+0000 7fe8f8ff9700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 0x7fe8dc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.874+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fe8ec083020 con 0x7fe8fc0cbb10 2023-11-17T06:33:42.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.874+0000 7fe8f2ffd700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 0x7fe8dc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.874+0000 7fe8f2ffd700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 0x7fe8dc0689d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000f60 tx=0x7fe8e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:42.878+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8ec0507a0 con 0x7fe8fc0cbb10 2023-11-17T06:33:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.054+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8fc15ed20 con 0x7fe8dc066510 2023-11-17T06:33:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.054+0000 7fe8f8ff9700 1 -- 172.21.15.100:0/3047251370 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe8e4001480 con 0x7fe8dc066510 2023-11-17T06:33:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 msgr2=0x7fe8dc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 0x7fe8dc0689d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000f60 tx=0x7fe8e4009040 comp rx=0 tx=0).stop 2023-11-17T06:33:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 msgr2=0x7fe8fc147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4f0 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 shutdown_connections 2023-11-17T06:33:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8fc15e900 0x7fe8fc155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0ce7c0 0x7fe8fc154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe8dc066510 0x7fe8dc0689d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 --2- 172.21.15.100:0/3047251370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8fc0cbb10 0x7fe8fc147420 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 >> 172.21.15.100:0/3047251370 conn(0x7fe8fc06a480 msgr2=0x7fe8fc0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 shutdown_connections 2023-11-17T06:33:43.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.058+0000 7fe900989700 1 -- 172.21.15.100:0/3047251370 wait complete. 2023-11-17T06:33:43.066 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2023-11-17T06:33:43.084 INFO:tasks.ceph:Scrubbing osd.2 2023-11-17T06:33:43.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:43.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 Processor -- start 2023-11-17T06:33:43.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 -- start start 2023-11-17T06:33:43.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8480b25e0 0x7fa8480d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8480d0110 0x7fa8480b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480ce8f0 con 0x7fa8480d0110 2023-11-17T06:33:43.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480b6280 con 0x7fa8480b25e0 2023-11-17T06:33:43.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480d2510 con 0x7fa8480d2910 2023-11-17T06:33:43.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa84659c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8480b25e0 0x7fa8480d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa846d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8480d0110 0x7fa8480b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:53158/0 (socket says 172.21.15.100:53158) 2023-11-17T06:33:43.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 -- 172.21.15.100:0/4145853161 learned_addr learned my addr 172.21.15.100:0/4145853161 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 -- 172.21.15.100:0/4145853161 >> v2:172.21.15.119:3300/0 conn(0x7fa8480b25e0 msgr2=0x7fa8480d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 --2- 172.21.15.100:0/4145853161 >> v2:172.21.15.119:3300/0 conn(0x7fa8480b25e0 0x7fa8480d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 -- 172.21.15.100:0/4145853161 >> v2:172.21.15.100:3300/0 conn(0x7fa8480d0110 msgr2=0x7fa8480b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 --2- 172.21.15.100:0/4145853161 >> v2:172.21.15.100:3300/0 conn(0x7fa8480d0110 0x7fa8480b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.262+0000 7fa845d9b700 1 -- 172.21.15.100:0/4145853161 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480d0540 con 0x7fa8480d2910 2023-11-17T06:33:43.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa845d9b700 1 --2- 172.21.15.100:0/4145853161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa84806c280 tx=0x7fa83c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ea3278db88f294 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84559a700 1 -- 172.21.15.100:0/4145853161 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011830 con 0x7fa8480d2910 2023-11-17T06:33:43.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84559a700 1 -- 172.21.15.100:0/4145853161 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c011990 con 0x7fa8480d2910 2023-11-17T06:33:43.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84559a700 1 -- 172.21.15.100:0/4145853161 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011d40 con 0x7fa8480d2910 2023-11-17T06:33:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 -- 172.21.15.100:0/4145853161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 msgr2=0x7fa8480cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 --2- 172.21.15.100:0/4145853161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa84806c280 tx=0x7fa83c009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 -- 172.21.15.100:0/4145853161 shutdown_connections 2023-11-17T06:33:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 --2- 172.21.15.100:0/4145853161 >> v2:172.21.15.100:3300/0 conn(0x7fa8480d0110 0x7fa8480b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 --2- 172.21.15.100:0/4145853161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480d2910 0x7fa8480cfbd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 --2- 172.21.15.100:0/4145853161 >> v2:172.21.15.119:3300/0 conn(0x7fa8480b25e0 0x7fa8480d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 -- 172.21.15.100:0/4145853161 >> 172.21.15.100:0/4145853161 conn(0x7fa84806ad70 msgr2=0x7fa84806b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 -- 172.21.15.100:0/4145853161 shutdown_connections 2023-11-17T06:33:43.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.266+0000 7fa84759e700 1 -- 172.21.15.100:0/4145853161 wait complete. 2023-11-17T06:33:43.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 Processor -- start 2023-11-17T06:33:43.275 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 -- start start 2023-11-17T06:33:43.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480b25e0 0x7fa848154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 0x7fa8480cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8480d2910 0x7fa8480b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480af920 con 0x7fa8480d0110 2023-11-17T06:33:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480aeda0 con 0x7fa8480d2910 2023-11-17T06:33:43.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480af080 con 0x7fa8480b25e0 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 0x7fa8480cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 0x7fa8480cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48312/0 (socket says 172.21.15.100:48312) 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa845d9b700 1 -- 172.21.15.100:0/949272843 learned_addr learned my addr 172.21.15.100:0/949272843 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa846d9d700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8480d2910 0x7fa8480b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.270+0000 7fa84659c700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480b25e0 0x7fa848154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 -- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480b25e0 msgr2=0x7fa848154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8480b25e0 0x7fa848154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 -- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8480d2910 msgr2=0x7fa8480b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8480d2910 0x7fa8480b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009570 con 0x7fa8480d0110 2023-11-17T06:33:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa846d9d700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8480d2910 0x7fa8480b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:43.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa845d9b700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 0x7fa8480cddc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c01a8f0 con 0x7fa8480d0110 2023-11-17T06:33:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c01e070 con 0x7fa8480d0110 2023-11-17T06:33:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480af360 con 0x7fa8480d0110 2023-11-17T06:33:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c01ac90 con 0x7fa8480d0110 2023-11-17T06:33:43.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480ad350 con 0x7fa8480d0110 2023-11-17T06:33:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.274+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8480d1c70 con 0x7fa8480d0110 2023-11-17T06:33:43.282 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa83c02d450 con 0x7fa8480d0110 2023-11-17T06:33:43.283 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa828066510 0x7fa8280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa83c084bb0 con 0x7fa8480d0110 2023-11-17T06:33:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa84659c700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa828066510 0x7fa8280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7fa82806c4b0 0x7fa82806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa82806ef80 con 0x7fa82806c4b0 2023-11-17T06:33:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa83c0892a0 con 0x7fa8480d0110 2023-11-17T06:33:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa846d9d700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7fa82806c4b0 0x7fa82806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.278+0000 7fa84659c700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa828066510 0x7fa8280689d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa838009a60 tx=0x7fa838008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.282+0000 7fa846d9d700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7fa82806c4b0 0x7fa82806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.282+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== osd.2 v2:172.21.15.100:6824/177771602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa82806ef80 con 0x7fa82806c4b0 2023-11-17T06:33:43.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 --> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8480d19d0 con 0x7fa82806c4b0 2023-11-17T06:33:43.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa836ffd700 1 -- 172.21.15.100:0/949272843 <== osd.2 v2:172.21.15.100:6824/177771602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa84000f040 con 0x7fa82806c4b0 2023-11-17T06:33:43.308 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:43.308 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:43.308 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7fa82806c4b0 msgr2=0x7fa82806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6824/177771602,v1:172.21.15.100:6825/177771602] conn(0x7fa82806c4b0 0x7fa82806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa828066510 msgr2=0x7fa8280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa828066510 0x7fa8280689d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa838009a60 tx=0x7fa838008040 comp rx=0 tx=0).stop 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 msgr2=0x7fa8480cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 --2- 172.21.15.100:0/949272843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8480d0110 0x7fa8480cddc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c004770 comp rx=0 tx=0).stop 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa846d9d700 1 -- 172.21.15.100:0/949272843 reap_dead start 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 shutdown_connections 2023-11-17T06:33:43.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 >> 172.21.15.100:0/949272843 conn(0x7fa84806ad70 msgr2=0x7fa8480b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 shutdown_connections 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.302+0000 7fa84759e700 1 -- 172.21.15.100:0/949272843 wait complete. 2023-11-17T06:33:43.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-17T06:33:43.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 Processor -- start 2023-11-17T06:33:43.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 -- start start 2023-11-17T06:33:43.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a415ca60 0x7fc8a415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a40cb620 con 0x7fc8a406bc20 2023-11-17T06:33:43.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a4155e10 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a94f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a4070390 con 0x7fc8a415ca60 2023-11-17T06:33:43.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48318/0 (socket says 172.21.15.100:48318) 2023-11-17T06:33:43.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/2335583707 learned_addr learned my addr 172.21.15.100:0/2335583707 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:43.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a37fe700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a415ca60 0x7fc8a415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/2335583707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a415ca60 msgr2=0x7fc8a415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a415ca60 0x7fc8a415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/2335583707 >> v1:172.21.15.119:6789/0 conn(0x7fc8a406bc20 legacy=0x7fc8a406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.518+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/2335583707 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40cc300 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a2ffd700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc894009910 tx=0x7fc894009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61a09c6368ad2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a1ffb700 1 -- 172.21.15.100:0/2335583707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011830 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a1ffb700 1 -- 172.21.15.100:0/2335583707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894011990 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a1ffb700 1 -- 172.21.15.100:0/2335583707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011d40 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 -- 172.21.15.100:0/2335583707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a40cb9e0 msgr2=0x7fc8a40cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc894009910 tx=0x7fc894009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 -- 172.21.15.100:0/2335583707 shutdown_connections 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a415ca60 0x7fc8a415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/2335583707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a40cb9e0 0x7fc8a40cbdc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 -- 172.21.15.100:0/2335583707 >> 172.21.15.100:0/2335583707 conn(0x7fc8a406a480 msgr2=0x7fc8a406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 -- 172.21.15.100:0/2335583707 shutdown_connections 2023-11-17T06:33:43.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.522+0000 7fc8a94f3700 1 -- 172.21.15.100:0/2335583707 wait complete. 2023-11-17T06:33:43.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 Processor -- start 2023-11-17T06:33:43.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 -- start start 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 0x7fc8a40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415ca60 0x7fc8a413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a415e1a0 con 0x7fc8a406bc20 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b1970 con 0x7fc8a415ca60 2023-11-17T06:33:43.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a94f3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b4600 con 0x7fc8a40cb9e0 2023-11-17T06:33:43.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48326/0 (socket says 172.21.15.100:48326) 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/993906264 learned_addr learned my addr 172.21.15.100:0/993906264 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a37fe700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415ca60 0x7fc8a413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a27fc700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 0x7fc8a40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 msgr2=0x7fc8a40c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 0x7fc8a40c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415ca60 msgr2=0x7fc8a413ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415ca60 0x7fc8a413ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a2ffd700 1 -- 172.21.15.100:0/993906264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894009570 con 0x7fc8a406bc20 2023-11-17T06:33:43.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.526+0000 7fc8a27fc700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 0x7fc8a40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:43.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc8a2ffd700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc8a415edf0 tx=0x7fc894004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894004510 con 0x7fc8a406bc20 2023-11-17T06:33:43.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89401e070 con 0x7fc8a406bc20 2023-11-17T06:33:43.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a40b42d0 con 0x7fc8a406bc20 2023-11-17T06:33:43.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894003900 con 0x7fc8a406bc20 2023-11-17T06:33:43.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a40b1ea0 con 0x7fc8a406bc20 2023-11-17T06:33:43.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.530+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a4067990 con 0x7fc8a406bc20 2023-11-17T06:33:43.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.534+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc894003a60 con 0x7fc8a406bc20 2023-11-17T06:33:43.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.534+0000 7fc88b7fe700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 0x7fc8900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.534+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc894084a80 con 0x7fc8a406bc20 2023-11-17T06:33:43.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.534+0000 7fc8a27fc700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 0x7fc8900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.534+0000 7fc8a27fc700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 0x7fc8900689d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40ca830 tx=0x7fc898009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.542+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc894052160 con 0x7fc8a406bc20 2023-11-17T06:33:43.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.706+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a406c430 con 0x7fc890066510 2023-11-17T06:33:43.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc88b7fe700 1 -- 172.21.15.100:0/993906264 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc898001470 con 0x7fc890066510 2023-11-17T06:33:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 msgr2=0x7fc8900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 0x7fc8900689d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40ca830 tx=0x7fc898009040 comp rx=0 tx=0).stop 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 msgr2=0x7fc8a415dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc8a415edf0 tx=0x7fc894004770 comp rx=0 tx=0).stop 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 shutdown_connections 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8a415ca60 0x7fc8a413ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8a40cb9e0 0x7fc8a40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc890066510 0x7fc8900689d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 --2- 172.21.15.100:0/993906264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8a406bc20 0x7fc8a415dc60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 >> 172.21.15.100:0/993906264 conn(0x7fc8a406a480 msgr2=0x7fc8a406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 shutdown_connections 2023-11-17T06:33:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.710+0000 7fc8a94f3700 1 -- 172.21.15.100:0/993906264 wait complete. 2023-11-17T06:33:43.718 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2023-11-17T06:33:43.740 INFO:tasks.ceph:Scrubbing osd.3 2023-11-17T06:33:43.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:43.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.914+0000 7fa9a64da700 1 Processor -- start 2023-11-17T06:33:43.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.914+0000 7fa9a64da700 1 -- start start 2023-11-17T06:33:43.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a64da700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa9a00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a64da700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9a00cfbd0 0x7fa9a00d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a64da700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0160d30 con 0x7fa9a00b8f80 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a64da700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00d0590 con 0x7fa9a00cfbd0 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a64da700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00ce8f0 con 0x7fa9a0160950 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a4cd7700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa9a00b8f80 0x7fa9a00b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52772/0 (socket says 172.21.15.100:52772) 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a4cd7700 1 -- 172.21.15.100:0/1864437504 learned_addr learned my addr 172.21.15.100:0/1864437504 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a54d8700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa9a00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.924 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa9a5cd9700 1 --2- 172.21.15.100:0/1864437504 >> v2:172.21.15.119:3300/0 conn(0x7fa9a00cfbd0 0x7fa9a00d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269925895 0 0) 0x7fa9a0160d30 con 0x7fa9a00b8f80 2023-11-17T06:33:43.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c0035d0 con 0x7fa9a00b8f80 2023-11-17T06:33:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174292669 0 0) 0x7fa98c0035d0 con 0x7fa9a00b8f80 2023-11-17T06:33:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 msgr2=0x7fa9a00b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa9a00b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 >> v2:172.21.15.119:3300/0 conn(0x7fa9a00cfbd0 msgr2=0x7fa9a00d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 --2- 172.21.15.100:0/1864437504 >> v2:172.21.15.119:3300/0 conn(0x7fa9a00cfbd0 0x7fa9a00d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00d2110 con 0x7fa9a00b8f80 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4112075071 0 0) 0x7fa990001670 con 0x7fa9a00b8f80 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 >> v1:172.21.15.100:6789/0 conn(0x7fa9a00b8f80 legacy=0x7fa9a00b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c003a20 0x7fa98c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa98c004870 0x7fa98c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa98c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00d0590 con 0x7fa98c003a20 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00ce8f0 con 0x7fa98c004870 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.918+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00ba30 con 0x7fa9a0160950 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa98c004870 0x7fa98c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a54d8700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c003a20 0x7fa98c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a5cd9700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa98c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 -- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 msgr2=0x7fa98c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a0160950 0x7fa98c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 -- 172.21.15.100:0/1864437504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c003a20 msgr2=0x7fa98c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c003a20 0x7fa98c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 -- 172.21.15.100:0/1864437504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0035d0 con 0x7fa98c004870 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa98c004870 0x7fa98c004cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c320 tx=0x7fa98c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d210a5653d7a009 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000ce60 con 0x7fa98c004870 2023-11-17T06:33:43.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990005980 con 0x7fa98c004870 2023-11-17T06:33:43.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa997fff700 1 -- 172.21.15.100:0/1864437504 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990005d10 con 0x7fa98c004870 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 -- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa98c004870 msgr2=0x7fa98c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 --2- 172.21.15.100:0/1864437504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa98c004870 0x7fa98c004cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c320 tx=0x7fa98c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a5cd9700 1 -- 172.21.15.100:0/1864437504 reap_dead start 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 -- 172.21.15.100:0/1864437504 shutdown_connections 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 -- 172.21.15.100:0/1864437504 >> 172.21.15.100:0/1864437504 conn(0x7fa9a006acf0 msgr2=0x7fa9a006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 -- 172.21.15.100:0/1864437504 shutdown_connections 2023-11-17T06:33:43.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.922+0000 7fa9a64da700 1 -- 172.21.15.100:0/1864437504 wait complete. 2023-11-17T06:33:43.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.926+0000 7fa9a64da700 1 Processor -- start 2023-11-17T06:33:43.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.926+0000 7fa9a64da700 1 -- start start 2023-11-17T06:33:43.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 0x7fa9a01556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a00cb460 0x7fa9a00ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a0157ab0 0x7fa9a00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00ca7d0 con 0x7fa98c004870 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00b4640 con 0x7fa9a0157ab0 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00cd0f0 con 0x7fa9a00cb460 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 0x7fa9a01556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 0x7fa9a01556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48336/0 (socket says 172.21.15.100:48336) 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 -- 172.21.15.100:0/786774293 learned_addr learned my addr 172.21.15.100:0/786774293 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a00cb460 0x7fa9a00ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a5cd9700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a0157ab0 0x7fa9a00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 -- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a00cb460 msgr2=0x7fa9a00ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9a00cb460 0x7fa9a00ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 -- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a0157ab0 msgr2=0x7fa9a00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a0157ab0 0x7fa9a00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00cb920 con 0x7fa98c004870 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a54d8700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 0x7fa9a01556f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0119b0 tx=0x7fa99c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c011e50 con 0x7fa98c004870 2023-11-17T06:33:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c00f8e0 con 0x7fa98c004870 2023-11-17T06:33:43.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00fc70 con 0x7fa98c004870 2023-11-17T06:33:43.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a00b3d10 con 0x7fa98c004870 2023-11-17T06:33:43.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.930+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a00b42d0 con 0x7fa98c004870 2023-11-17T06:33:43.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9a00ce330 con 0x7fa98c004870 2023-11-17T06:33:43.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa99c014440 con 0x7fa98c004870 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa984066540 0x7fa984068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa99c084160 con 0x7fa98c004870 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fa98406c4e0 0x7fa98406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa984066540 0x7fa984068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa98406efb0 con 0x7fa98406c4e0 2023-11-17T06:33:43.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa99c086740 con 0x7fa98c004870 2023-11-17T06:33:43.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.934+0000 7fa9a5cd9700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fa98406c4e0 0x7fa98406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.938+0000 7fa9a4cd7700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa984066540 0x7fa984068a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa990008fd0 tx=0x7fa99000a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.938+0000 7fa9a5cd9700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fa98406c4e0 0x7fa98406e900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.938+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== osd.3 v2:172.21.15.100:6800/2990712957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa98406efb0 con 0x7fa98406c4e0 2023-11-17T06:33:43.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.954+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 --> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa9a00b2790 con 0x7fa98406c4e0 2023-11-17T06:33:43.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa995ffb700 1 -- 172.21.15.100:0/786774293 <== osd.3 v2:172.21.15.100:6800/2990712957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa99800f040 con 0x7fa98406c4e0 2023-11-17T06:33:43.962 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:43.962 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:43.963 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fa98406c4e0 msgr2=0x7fa98406e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6800/2990712957,v1:172.21.15.100:6802/2990712957] conn(0x7fa98406c4e0 0x7fa98406e900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa984066540 msgr2=0x7fa984068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fa984066540 0x7fa984068a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa990008fd0 tx=0x7fa99000a000 comp rx=0 tx=0).stop 2023-11-17T06:33:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 msgr2=0x7fa9a01556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 --2- 172.21.15.100:0/786774293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa98c004870 0x7fa9a01556f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0119b0 tx=0x7fa99c011cc0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a5cd9700 1 -- 172.21.15.100:0/786774293 reap_dead start 2023-11-17T06:33:43.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 shutdown_connections 2023-11-17T06:33:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 >> 172.21.15.100:0/786774293 conn(0x7fa9a006acf0 msgr2=0x7fa9a00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 shutdown_connections 2023-11-17T06:33:43.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:43.958+0000 7fa9a64da700 1 -- 172.21.15.100:0/786774293 wait complete. 2023-11-17T06:33:43.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-17T06:33:44.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.162+0000 7f18688eb700 1 Processor -- start 2023-11-17T06:33:44.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.162+0000 7f18688eb700 1 -- start start 2023-11-17T06:33:44.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f18688eb700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18640c94f0 0x7f18640ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f18688eb700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1864161e70 con 0x7f18640cc0f0 2023-11-17T06:33:44.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f18688eb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1864161260 con 0x7f186415d460 2023-11-17T06:33:44.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f18688eb700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18640ae610 con 0x7f18640c94f0 2023-11-17T06:33:44.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f185a59c700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f18640cc0f0 0x7f18640ac9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52778/0 (socket says 172.21.15.100:52778) 2023-11-17T06:33:44.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f185a59c700 1 -- 172.21.15.100:0/3429777198 learned_addr learned my addr 172.21.15.100:0/3429777198 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:44.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186359e700 1 --2- 172.21.15.100:0/3429777198 >> v2:172.21.15.119:3300/0 conn(0x7f18640c94f0 0x7f18640ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496127724 0 0) 0x7f1864161e70 con 0x7f18640cc0f0 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18500035d0 con 0x7f18640cc0f0 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645545409 0 0) 0x7f1864161260 con 0x7f186415d460 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1864161e70 con 0x7f186415d460 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186359e700 1 -- 172.21.15.100:0/3429777198 >> v1:172.21.15.119:6789/0 conn(0x7f186415d460 legacy=0x7f18640cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186359e700 1 -- 172.21.15.100:0/3429777198 >> v1:172.21.15.100:6789/0 conn(0x7f18640cc0f0 legacy=0x7f18640ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010876941 0 0) 0x7f18500035d0 con 0x7f18640cc0f0 2023-11-17T06:33:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.166+0000 7f186359e700 1 -- 172.21.15.100:0/3429777198 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864161540 con 0x7f18640c94f0 2023-11-17T06:33:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f186359e700 1 --2- 172.21.15.100:0/3429777198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640c94f0 0x7f18640ae0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc890c5f4129e31 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c00e070 con 0x7f18640c94f0 2023-11-17T06:33:44.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c003a40 con 0x7f18640c94f0 2023-11-17T06:33:44.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f186259c700 1 -- 172.21.15.100:0/3429777198 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c001670 con 0x7f18640c94f0 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 -- 172.21.15.100:0/3429777198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640c94f0 msgr2=0x7f18640ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 --2- 172.21.15.100:0/3429777198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640c94f0 0x7f18640ae0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c00b330 comp rx=0 tx=0).stop 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 -- 172.21.15.100:0/3429777198 shutdown_connections 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 --2- 172.21.15.100:0/3429777198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640c94f0 0x7f18640ae0d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 -- 172.21.15.100:0/3429777198 >> 172.21.15.100:0/3429777198 conn(0x7f186406a480 msgr2=0x7f186406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 -- 172.21.15.100:0/3429777198 shutdown_connections 2023-11-17T06:33:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.170+0000 7f18688eb700 1 -- 172.21.15.100:0/3429777198 wait complete. 2023-11-17T06:33:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 Processor -- start 2023-11-17T06:33:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 -- start start 2023-11-17T06:33:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640cc0f0 0x7f186414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 0x7f18640c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864159060 con 0x7f18640c94f0 2023-11-17T06:33:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864159340 con 0x7f18640cc0f0 2023-11-17T06:33:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f18688eb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1864159620 con 0x7f186415d460 2023-11-17T06:33:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f1862d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f1862d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48352/0 (socket says 172.21.15.100:48352) 2023-11-17T06:33:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.174+0000 7f1862d9d700 1 -- 172.21.15.100:0/3044892241 learned_addr learned my addr 172.21.15.100:0/3044892241 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f186359e700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 0x7f18640c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f185a59c700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640cc0f0 0x7f186414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 -- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 msgr2=0x7f18640c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 0x7f18640c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 -- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640cc0f0 msgr2=0x7f186414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640cc0f0 0x7f186414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 -- 172.21.15.100:0/3044892241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009a70 con 0x7f18640c94f0 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f186359e700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 0x7f18640c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f1862d9d700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f185400c490 tx=0x7f185400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540052d0 con 0x7f18640c94f0 2023-11-17T06:33:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854005450 con 0x7f18640c94f0 2023-11-17T06:33:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186414d6a0 con 0x7f18640c94f0 2023-11-17T06:33:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540038e0 con 0x7f18640c94f0 2023-11-17T06:33:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18640c4180 con 0x7f18640c94f0 2023-11-17T06:33:44.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.178+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18641597e0 con 0x7f18640c94f0 2023-11-17T06:33:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.182+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1854003a40 con 0x7f18640c94f0 2023-11-17T06:33:44.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.182+0000 7f185bfff700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 0x7f18440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.186+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1854083190 con 0x7f18640c94f0 2023-11-17T06:33:44.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.186+0000 7f185a59c700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 0x7f18440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.186+0000 7f185a59c700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 0x7f18440689d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f186415aa80 tx=0x7f184c001be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.198 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.190+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18540507c0 con 0x7f18640c94f0 2023-11-17T06:33:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.366+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1864161b00 con 0x7f1844066510 2023-11-17T06:33:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.366+0000 7f185bfff700 1 -- 172.21.15.100:0/3044892241 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f184c001510 con 0x7f1844066510 2023-11-17T06:33:44.376 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 msgr2=0x7f18440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 0x7f18440689d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f186415aa80 tx=0x7f184c001be0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 msgr2=0x7f18640c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f185400c490 tx=0x7f185400c850 comp rx=0 tx=0).stop 2023-11-17T06:33:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 shutdown_connections 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f186415d460 0x7f18640c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640cc0f0 0x7f186414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1844066510 0x7f18440689d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 --2- 172.21.15.100:0/3044892241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18640c94f0 0x7f18640c2960 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 >> 172.21.15.100:0/3044892241 conn(0x7f186406a480 msgr2=0x7f18640cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 shutdown_connections 2023-11-17T06:33:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.370+0000 7f18688eb700 1 -- 172.21.15.100:0/3044892241 wait complete. 2023-11-17T06:33:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2023-11-17T06:33:44.396 INFO:tasks.ceph:Scrubbing osd.4 2023-11-17T06:33:44.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.566+0000 7fd48d5bf700 1 Processor -- start 2023-11-17T06:33:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.566+0000 7fd48d5bf700 1 -- start start 2023-11-17T06:33:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd48d5bf700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 0x7fd4880cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd48d5bf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 0x7fd48806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd48d5bf700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd488144860 con 0x7fd4880cd6e0 2023-11-17T06:33:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd48d5bf700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48806fd00 con 0x7fd488144480 2023-11-17T06:33:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd48d5bf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48806bdc0 con 0x7fd4880c9c40 2023-11-17T06:33:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 0x7fd48806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd486ffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 0x7fd4880cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd47e7fc700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd4880cd6e0 0x7fd4880c9530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:57208/0 (socket says 172.21.15.100:57208) 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd47e7fc700 1 -- 172.21.15.100:0/1894656314 learned_addr learned my addr 172.21.15.100:0/1894656314 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 -- 172.21.15.100:0/1894656314 >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 msgr2=0x7fd4880cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 --2- 172.21.15.100:0/1894656314 >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 0x7fd4880cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 -- 172.21.15.100:0/1894656314 >> v1:172.21.15.119:6789/0 conn(0x7fd4880cd6e0 legacy=0x7fd4880c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 -- 172.21.15.100:0/1894656314 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880cde50 con 0x7fd4880c9c40 2023-11-17T06:33:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd486ffd700 1 --2- 172.21.15.100:0/1894656314 >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 0x7fd4880cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.570+0000 7fd4877fe700 1 --2- 172.21.15.100:0/1894656314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 0x7fd48806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd480009d90 tx=0x7fd48000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a37a52ea59cc6a84 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd4867fc700 1 -- 172.21.15.100:0/1894656314 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000e070 con 0x7fd4880c9c40 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd4867fc700 1 -- 172.21.15.100:0/1894656314 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000bb20 con 0x7fd4880c9c40 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd4867fc700 1 -- 172.21.15.100:0/1894656314 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480012430 con 0x7fd4880c9c40 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- 172.21.15.100:0/1894656314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 msgr2=0x7fd48806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/1894656314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 0x7fd48806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd480009d90 tx=0x7fd48000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- 172.21.15.100:0/1894656314 shutdown_connections 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/1894656314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4880c9c40 0x7fd48806c5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/1894656314 >> v2:172.21.15.119:3300/0 conn(0x7fd488144480 0x7fd4880cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- 172.21.15.100:0/1894656314 >> 172.21.15.100:0/1894656314 conn(0x7fd4880ceee0 msgr2=0x7fd4880cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- 172.21.15.100:0/1894656314 shutdown_connections 2023-11-17T06:33:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- 172.21.15.100:0/1894656314 wait complete. 2023-11-17T06:33:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 Processor -- start 2023-11-17T06:33:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.574+0000 7fd48d5bf700 1 -- start start 2023-11-17T06:33:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 0x7fd4881f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4880cd6e0 0x7fd4880b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd488144480 0x7fd4880b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880b4420 con 0x7fd4880c9c40 2023-11-17T06:33:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48813fcb0 con 0x7fd4880cd6e0 2023-11-17T06:33:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880b37a0 con 0x7fd488144480 2023-11-17T06:33:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 0x7fd4881f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 0x7fd4881f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48368/0 (socket says 172.21.15.100:48368) 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 -- 172.21.15.100:0/547059036 learned_addr learned my addr 172.21.15.100:0/547059036 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd47e7fc700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4880cd6e0 0x7fd4880b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd4877fe700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd488144480 0x7fd4880b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 -- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd488144480 msgr2=0x7fd4880b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd488144480 0x7fd4880b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 -- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4880cd6e0 msgr2=0x7fd4880b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4880cd6e0 0x7fd4880b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780094b0 con 0x7fd4880c9c40 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd4877fe700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd488144480 0x7fd4880b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd47e7fc700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4880cd6e0 0x7fd4880b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd486ffd700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 0x7fd4881f6980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd47800ebe0 tx=0x7fd478009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800c910 con 0x7fd4880c9c40 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800ca70 con 0x7fd4880c9c40 2023-11-17T06:33:44.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480009a70 con 0x7fd4880c9c40 2023-11-17T06:33:44.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800ce00 con 0x7fd4880c9c40 2023-11-17T06:33:44.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.578+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880b3d60 con 0x7fd4880c9c40 2023-11-17T06:33:44.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.582+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd48806c080 con 0x7fd4880c9c40 2023-11-17T06:33:44.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.582+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd478013470 con 0x7fd4880c9c40 2023-11-17T06:33:44.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.582+0000 7fd47ffff700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd468066510 0x7fd4680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.582+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd478083d20 con 0x7fd4880c9c40 2023-11-17T06:33:44.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.582+0000 7fd47e7fc700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd468066510 0x7fd4680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd47ffff700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7fd46806c4b0 0x7fd46806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd46806ef80 con 0x7fd46806c4b0 2023-11-17T06:33:44.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4780863b0 con 0x7fd4880c9c40 2023-11-17T06:33:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd47e7fc700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd468066510 0x7fd4680689d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd470007fd0 tx=0x7fd470009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd4877fe700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7fd46806c4b0 0x7fd46806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd4877fe700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7fd46806c4b0 0x7fd46806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.586+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== osd.4 v2:172.21.15.119:6824/3894860840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd46806ef80 con 0x7fd46806c4b0 2023-11-17T06:33:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 --> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4880ce130 con 0x7fd46806c4b0 2023-11-17T06:33:44.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd47ffff700 1 -- 172.21.15.100:0/547059036 <== osd.4 v2:172.21.15.119:6824/3894860840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd480003c60 con 0x7fd46806c4b0 2023-11-17T06:33:44.611 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:44.612 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:44.612 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:44.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7fd46806c4b0 msgr2=0x7fd46806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.119:6824/3894860840,v1:172.21.15.119:6825/3894860840] conn(0x7fd46806c4b0 0x7fd46806e8d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd468066510 msgr2=0x7fd4680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fd468066510 0x7fd4680689d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd470007fd0 tx=0x7fd470009040 comp rx=0 tx=0).stop 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 msgr2=0x7fd4881f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 --2- 172.21.15.100:0/547059036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4880c9c40 0x7fd4881f6980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd47800ebe0 tx=0x7fd478009ed0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd4877fe700 1 -- 172.21.15.100:0/547059036 reap_dead start 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 shutdown_connections 2023-11-17T06:33:44.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 >> 172.21.15.100:0/547059036 conn(0x7fd4880ceee0 msgr2=0x7fd4881407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 shutdown_connections 2023-11-17T06:33:44.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.606+0000 7fd48d5bf700 1 -- 172.21.15.100:0/547059036 wait complete. 2023-11-17T06:33:44.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-17T06:33:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.798+0000 7fe3857e6700 1 Processor -- start 2023-11-17T06:33:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.798+0000 7fe3857e6700 1 -- start start 2023-11-17T06:33:44.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3800cb9e0 0x7fe3800cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 0x7fe38006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38015ca60 0x7fe38015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe380155e10 con 0x7fe38015ca60 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800cb620 con 0x7fe38006bc20 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe3857e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800cc300 con 0x7fe3800cb9e0 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38015ca60 0x7fe38015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38015ca60 0x7fe38015ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48382/0 (socket says 172.21.15.100:48382) 2023-11-17T06:33:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 -- 172.21.15.100:0/2206218286 learned_addr learned my addr 172.21.15.100:0/2206218286 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37ffff700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3800cb9e0 0x7fe3800cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37f7fe700 1 --2- 172.21.15.100:0/2206218286 >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 0x7fe38006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 -- 172.21.15.100:0/2206218286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3800cb9e0 msgr2=0x7fe3800cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3800cb9e0 0x7fe3800cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 -- 172.21.15.100:0/2206218286 >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 msgr2=0x7fe38006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 --2- 172.21.15.100:0/2206218286 >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 0x7fe38006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 -- 172.21.15.100:0/2206218286 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38006c150 con 0x7fe38015ca60 2023-11-17T06:33:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37f7fe700 1 --2- 172.21.15.100:0/2206218286 >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 0x7fe38006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe384fe5700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe38015ce60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3800ceba0 tx=0x7fe37800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2778da44c0a0d116 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37effd700 1 -- 172.21.15.100:0/2206218286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800e070 con 0x7fe38015ca60 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37effd700 1 -- 172.21.15.100:0/2206218286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800b9c0 con 0x7fe38015ca60 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.802+0000 7fe37effd700 1 -- 172.21.15.100:0/2206218286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800bd70 con 0x7fe38015ca60 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 -- 172.21.15.100:0/2206218286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 msgr2=0x7fe38015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe38015ce60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3800ceba0 tx=0x7fe37800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 -- 172.21.15.100:0/2206218286 shutdown_connections 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe38015ce60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 --2- 172.21.15.100:0/2206218286 >> v2:172.21.15.119:3300/0 conn(0x7fe38006bc20 0x7fe38006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 --2- 172.21.15.100:0/2206218286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3800cb9e0 0x7fe3800cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 -- 172.21.15.100:0/2206218286 >> 172.21.15.100:0/2206218286 conn(0x7fe38006a480 msgr2=0x7fe38006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 -- 172.21.15.100:0/2206218286 shutdown_connections 2023-11-17T06:33:44.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 -- 172.21.15.100:0/2206218286 wait complete. 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.806+0000 7fe3857e6700 1 Processor -- start 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 -- start start 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38006bc20 0x7fe3800700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3800cb9e0 0x7fe3801f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c7f80 con 0x7fe38015ca60 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c45f0 con 0x7fe3800cb9e0 2023-11-17T06:33:44.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe3857e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c48d0 con 0x7fe38006bc20 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe37ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38006bc20 0x7fe3800700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe37f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3800cb9e0 0x7fe3801f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48396/0 (socket says 172.21.15.100:48396) 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 -- 172.21.15.100:0/578855813 learned_addr learned my addr 172.21.15.100:0/578855813 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 -- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38006bc20 msgr2=0x7fe3800700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38006bc20 0x7fe3800700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 -- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3800cb9e0 msgr2=0x7fe3801f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3800cb9e0 0x7fe3801f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 -- 172.21.15.100:0/578855813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009b30 con 0x7fe38015ca60 2023-11-17T06:33:44.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe384fe5700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe378012000 tx=0x7fe378004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.810+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780099b0 con 0x7fe38015ca60 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378004250 con 0x7fe38015ca60 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378004600 con 0x7fe38015ca60 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800c4bb0 con 0x7fe38015ca60 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3800c5170 con 0x7fe38015ca60 2023-11-17T06:33:44.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380067990 con 0x7fe38015ca60 2023-11-17T06:33:44.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.814+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe378004760 con 0x7fe38015ca60 2023-11-17T06:33:44.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.818+0000 7fe37cff9700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 0x7fe36c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.818+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fe378085080 con 0x7fe38015ca60 2023-11-17T06:33:44.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.818+0000 7fe37ffff700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 0x7fe36c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.818+0000 7fe37ffff700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 0x7fe36c0689d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe370006b40 tx=0x7fe370008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.822+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe378052760 con 0x7fe38015ca60 2023-11-17T06:33:44.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.994+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe38006c710 con 0x7fe36c066510 2023-11-17T06:33:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.994+0000 7fe37cff9700 1 -- 172.21.15.100:0/578855813 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe3700076d0 con 0x7fe36c066510 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 msgr2=0x7fe36c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 0x7fe36c0689d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe370006b40 tx=0x7fe370008040 comp rx=0 tx=0).stop 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 msgr2=0x7fe3801f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe378012000 tx=0x7fe378004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 shutdown_connections 2023-11-17T06:33:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fe36c066510 0x7fe36c0689d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38015ca60 0x7fe3801f3090 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3800cb9e0 0x7fe3801f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 --2- 172.21.15.100:0/578855813 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38006bc20 0x7fe3800700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 >> 172.21.15.100:0/578855813 conn(0x7fe38006a480 msgr2=0x7fe38006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 shutdown_connections 2023-11-17T06:33:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:44.998+0000 7fe3857e6700 1 -- 172.21.15.100:0/578855813 wait complete. 2023-11-17T06:33:45.005 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2023-11-17T06:33:45.023 INFO:tasks.ceph:Scrubbing osd.5 2023-11-17T06:33:45.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:45.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 Processor -- start 2023-11-17T06:33:45.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 -- start start 2023-11-17T06:33:45.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e440aeaf0 0x7f9e440cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e4415a120 0x7f9e440cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4415a5b0 con 0x7f9e4406b2b0 2023-11-17T06:33:45.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440aeff0 con 0x7f9e4415a120 2023-11-17T06:33:45.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.190+0000 7f9e488c4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4415a7e0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e4415a120 0x7f9e440cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e4415a120 0x7f9e440cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48412/0 (socket says 172.21.15.100:48412) 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 -- 172.21.15.100:0/4101200887 learned_addr learned my addr 172.21.15.100:0/4101200887 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e39d9b700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e440aeaf0 0x7f9e440cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 -- 172.21.15.100:0/4101200887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e440aeaf0 msgr2=0x7f9e440cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e440aeaf0 0x7f9e440cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 -- 172.21.15.100:0/4101200887 >> v1:172.21.15.119:6789/0 conn(0x7f9e4406b2b0 legacy=0x7f9e4406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 -- 172.21.15.100:0/4101200887 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4415aac0 con 0x7f9e4415a120 2023-11-17T06:33:45.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e4415a120 0x7f9e440cd400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00bbb0 tx=0x7f9e3c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc50c1f1429a7942 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e41d9b700 1 -- 172.21.15.100:0/4101200887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00dd90 con 0x7f9e4415a120 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e41d9b700 1 -- 172.21.15.100:0/4101200887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c010470 con 0x7f9e4415a120 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e41d9b700 1 -- 172.21.15.100:0/4101200887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c010820 con 0x7f9e4415a120 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 -- 172.21.15.100:0/4101200887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e4415a120 msgr2=0x7f9e440cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e4415a120 0x7f9e440cd400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00bbb0 tx=0x7f9e3c00bec0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 -- 172.21.15.100:0/4101200887 shutdown_connections 2023-11-17T06:33:45.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e4415a120 0x7f9e440cd400 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 --2- 172.21.15.100:0/4101200887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e440aeaf0 0x7f9e440cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 -- 172.21.15.100:0/4101200887 >> 172.21.15.100:0/4101200887 conn(0x7f9e44070660 msgr2=0x7f9e44070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 -- 172.21.15.100:0/4101200887 shutdown_connections 2023-11-17T06:33:45.202 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.194+0000 7f9e488c4700 1 -- 172.21.15.100:0/4101200887 wait complete. 2023-11-17T06:33:45.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.198+0000 7f9e488c4700 1 Processor -- start 2023-11-17T06:33:45.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.198+0000 7f9e488c4700 1 -- start start 2023-11-17T06:33:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e4406b2b0 0x7f9e441fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 0x7f9e440cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e4415a120 0x7f9e44154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441e3510 con 0x7f9e440aeaf0 2023-11-17T06:33:45.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441fbd90 con 0x7f9e4406b2b0 2023-11-17T06:33:45.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441e3cb0 con 0x7f9e4415a120 2023-11-17T06:33:45.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 0x7f9e440cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 0x7f9e440cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48418/0 (socket says 172.21.15.100:48418) 2023-11-17T06:33:45.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 -- 172.21.15.100:0/3309115953 learned_addr learned my addr 172.21.15.100:0/3309115953 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e4259c700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e4406b2b0 0x7f9e441fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e4415a120 0x7f9e44154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 -- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e4415a120 msgr2=0x7f9e44154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e4415a120 0x7f9e44154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 -- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e4406b2b0 msgr2=0x7f9e441fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e4406b2b0 0x7f9e441fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c00b810 con 0x7f9e440aeaf0 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e4259c700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e4406b2b0 0x7f9e441fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e4415a120 0x7f9e44154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e39d9b700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 0x7f9e440cb590 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007ec0 tx=0x7f9e2c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00eea0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c014420 con 0x7f9e440aeaf0 2023-11-17T06:33:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0147d0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e441e36f0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440b24f0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.202+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e440ca780 con 0x7f9e440aeaf0 2023-11-17T06:33:45.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.206+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9e2c014930 con 0x7f9e440aeaf0 2023-11-17T06:33:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.206+0000 7f9e3b7fe700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9e24066510 0x7f9e240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.206+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9e2c084400 con 0x7f9e440aeaf0 2023-11-17T06:33:45.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.206+0000 7f9e4259c700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9e24066510 0x7f9e240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e3b7fe700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7f9e2406c4b0 0x7f9e2406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e2406ef80 con 0x7f9e2406c4b0 2023-11-17T06:33:45.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e2c086ac0 con 0x7f9e440aeaf0 2023-11-17T06:33:45.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7f9e2406c4b0 0x7f9e2406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e4259c700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9e24066510 0x7f9e240689d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f60 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e42d9d700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7f9e2406c4b0 0x7f9e2406e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.210+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== osd.5 v2:172.21.15.119:6810/2475678651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9e2406ef80 con 0x7f9e2406c4b0 2023-11-17T06:33:45.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.226+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 --> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e4415ada0 con 0x7f9e2406c4b0 2023-11-17T06:33:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e3b7fe700 1 -- 172.21.15.100:0/3309115953 <== osd.5 v2:172.21.15.119:6810/2475678651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9e3c00de30 con 0x7f9e2406c4b0 2023-11-17T06:33:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7f9e2406c4b0 msgr2=0x7f9e2406e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.119:6810/2475678651,v1:172.21.15.119:6813/2475678651] conn(0x7f9e2406c4b0 0x7f9e2406e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9e24066510 msgr2=0x7f9e240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9e24066510 0x7f9e240689d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f60 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 msgr2=0x7f9e440cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 --2- 172.21.15.100:0/3309115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e440aeaf0 0x7f9e440cb590 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007ec0 tx=0x7f9e2c00e3c0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e42d9d700 1 -- 172.21.15.100:0/3309115953 reap_dead start 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 shutdown_connections 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 >> 172.21.15.100:0/3309115953 conn(0x7f9e44070660 msgr2=0x7f9e4406d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 shutdown_connections 2023-11-17T06:33:45.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.230+0000 7f9e488c4700 1 -- 172.21.15.100:0/3309115953 wait complete. 2023-11-17T06:33:45.261 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 Processor -- start 2023-11-17T06:33:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 -- start start 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb2800cd760 0x7fb2800ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2800cf990 0x7fb2800cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800cb9e0 con 0x7fb2800caec0 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28015d910 con 0x7fb2800cf990 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb2857a4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800d0350 con 0x7fb2800cd760 2023-11-17T06:33:45.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.434+0000 7fb27e7fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2800cf990 0x7fb2800cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2800cf990 0x7fb2800cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48432/0 (socket says 172.21.15.100:48432) 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 -- 172.21.15.100:0/3990335818 learned_addr learned my addr 172.21.15.100:0/3990335818 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27ffff700 1 --1- 172.21.15.100:0/3990335818 >> v1:172.21.15.100:6789/0 conn(0x7fb2800caec0 0x7fb2800cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52786/0 (socket says 172.21.15.100:52786) 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27effd700 1 --2- 172.21.15.100:0/3990335818 >> v2:172.21.15.119:3300/0 conn(0x7fb2800cd760 0x7fb2800ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 -- 172.21.15.100:0/3990335818 >> v2:172.21.15.119:3300/0 conn(0x7fb2800cd760 msgr2=0x7fb2800ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 --2- 172.21.15.100:0/3990335818 >> v2:172.21.15.119:3300/0 conn(0x7fb2800cd760 0x7fb2800ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 -- 172.21.15.100:0/3990335818 >> v1:172.21.15.100:6789/0 conn(0x7fb2800caec0 legacy=0x7fb2800cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 -- 172.21.15.100:0/3990335818 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28015db20 con 0x7fb2800cf990 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27e7fc700 1 --2- 172.21.15.100:0/3990335818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800cfe10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb28006e540 tx=0x7fb274009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d9a7391b7e3338 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27dffb700 1 -- 172.21.15.100:0/3990335818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400b8a0 con 0x7fb2800cf990 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27dffb700 1 -- 172.21.15.100:0/3990335818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400ba00 con 0x7fb2800cf990 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb27dffb700 1 -- 172.21.15.100:0/3990335818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400bd90 con 0x7fb2800cf990 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 -- 172.21.15.100:0/3990335818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 msgr2=0x7fb2800cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 --2- 172.21.15.100:0/3990335818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800cfe10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb28006e540 tx=0x7fb274009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 -- 172.21.15.100:0/3990335818 shutdown_connections 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 --2- 172.21.15.100:0/3990335818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800cfe10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 --2- 172.21.15.100:0/3990335818 >> v2:172.21.15.119:3300/0 conn(0x7fb2800cd760 0x7fb2800ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 -- 172.21.15.100:0/3990335818 >> 172.21.15.100:0/3990335818 conn(0x7fb2800b2270 msgr2=0x7fb2800b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 -- 172.21.15.100:0/3990335818 shutdown_connections 2023-11-17T06:33:45.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.438+0000 7fb2857a4700 1 -- 172.21.15.100:0/3990335818 wait complete. 2023-11-17T06:33:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.442+0000 7fb2857a4700 1 Processor -- start 2023-11-17T06:33:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.442+0000 7fb2857a4700 1 -- start start 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2800caec0 0x7fb280159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2800cd760 0x7fb2800b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801f41b0 con 0x7fb2800cf990 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28015a400 con 0x7fb2800cd760 2023-11-17T06:33:45.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800b62a0 con 0x7fb2800caec0 2023-11-17T06:33:45.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48444/0 (socket says 172.21.15.100:48444) 2023-11-17T06:33:45.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 -- 172.21.15.100:0/2489911731 learned_addr learned my addr 172.21.15.100:0/2489911731 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:45.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27effd700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2800caec0 0x7fb280159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27e7fc700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2800cd760 0x7fb2800b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 -- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2800caec0 msgr2=0x7fb280159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.452 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2800caec0 0x7fb280159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 -- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2800cd760 msgr2=0x7fb2800b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2800cd760 0x7fb2800b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.453 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 -- 172.21.15.100:0/2489911731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009570 con 0x7fb2800cf990 2023-11-17T06:33:45.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb27ffff700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb27800cbc0 tx=0x7fb27800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800ab50 con 0x7fb2800cf990 2023-11-17T06:33:45.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800acb0 con 0x7fb2800cf990 2023-11-17T06:33:45.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2801f3530 con 0x7fb2800cf990 2023-11-17T06:33:45.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278007270 con 0x7fb2800cf990 2023-11-17T06:33:45.455 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.446+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2801f3af0 con 0x7fb2800cf990 2023-11-17T06:33:45.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.450+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28015d1f0 con 0x7fb2800cf990 2023-11-17T06:33:45.458 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.450+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb2780073d0 con 0x7fb2800cf990 2023-11-17T06:33:45.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.450+0000 7fb2677fe700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 0x7fb26c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.450+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb2780837f0 con 0x7fb2800cf990 2023-11-17T06:33:45.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.450+0000 7fb27effd700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 0x7fb26c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.454+0000 7fb27effd700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 0x7fb26c0689d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2800c9a10 tx=0x7fb270008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.462 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.458+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb278050ee0 con 0x7fb2800cf990 2023-11-17T06:33:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.630+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb28015e0e0 con 0x7fb26c066510 2023-11-17T06:33:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.630+0000 7fb2677fe700 1 -- 172.21.15.100:0/2489911731 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb270009df0 con 0x7fb26c066510 2023-11-17T06:33:45.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 msgr2=0x7fb26c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 0x7fb26c0689d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2800c9a10 tx=0x7fb270008040 comp rx=0 tx=0).stop 2023-11-17T06:33:45.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 msgr2=0x7fb2800c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb27800cbc0 tx=0x7fb27800cf80 comp rx=0 tx=0).stop 2023-11-17T06:33:45.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 shutdown_connections 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fb26c066510 0x7fb26c0689d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2800cf990 0x7fb2800c9a80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2800cd760 0x7fb2800b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 --2- 172.21.15.100:0/2489911731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2800caec0 0x7fb280159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 >> 172.21.15.100:0/2489911731 conn(0x7fb2800b2270 msgr2=0x7fb2800b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 shutdown_connections 2023-11-17T06:33:45.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.634+0000 7fb2857a4700 1 -- 172.21.15.100:0/2489911731 wait complete. 2023-11-17T06:33:45.643 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2023-11-17T06:33:45.663 INFO:tasks.ceph:Scrubbing osd.6 2023-11-17T06:33:45.664 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:45.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.838+0000 7f13996a8700 1 Processor -- start 2023-11-17T06:33:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.838+0000 7f13996a8700 1 -- start start 2023-11-17T06:33:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13996a8700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13940c22d0 0x7f13940cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13996a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 0x7f13940cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13996a8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13940c26b0 con 0x7f139406fb20 2023-11-17T06:33:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13996a8700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940703f0 con 0x7f13940c22d0 2023-11-17T06:33:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13996a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940c93e0 con 0x7f139406ffb0 2023-11-17T06:33:45.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13940c22d0 0x7f13940cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13937fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 0x7f13940cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f138a7fc700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f139406fb20 0x7f139406c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.100:57218/0 (socket says 172.21.15.100:57218) 2023-11-17T06:33:45.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f138a7fc700 1 -- 172.21.15.100:0/2914301860 learned_addr learned my addr 172.21.15.100:0/2914301860 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:45.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13927fc700 1 -- 172.21.15.100:0/2914301860 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155141845 0 0) 0x7f13940c26b0 con 0x7f139406fb20 2023-11-17T06:33:45.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13927fc700 1 -- 172.21.15.100:0/2914301860 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13740035d0 con 0x7f139406fb20 2023-11-17T06:33:45.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 -- 172.21.15.100:0/2914301860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 msgr2=0x7f13940cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 0x7f13940cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 -- 172.21.15.100:0/2914301860 >> v1:172.21.15.119:6789/0 conn(0x7f139406fb20 legacy=0x7f139406c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 -- 172.21.15.100:0/2914301860 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394161c00 con 0x7f13940c22d0 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f13937fe700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 0x7f13940cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.842+0000 7f1392ffd700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13940c22d0 0x7f13940cb080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f137c009850 tx=0x7f137c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b742f6283d54aa61 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13927fc700 1 -- 172.21.15.100:0/2914301860 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011830 con 0x7f13940c22d0 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13927fc700 1 -- 172.21.15.100:0/2914301860 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c011990 con 0x7f13940c22d0 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13927fc700 1 -- 172.21.15.100:0/2914301860 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011d40 con 0x7f13940c22d0 2023-11-17T06:33:45.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 -- 172.21.15.100:0/2914301860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13940c22d0 msgr2=0x7f13940cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13940c22d0 0x7f13940cb080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f137c009850 tx=0x7f137c009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:45.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 -- 172.21.15.100:0/2914301860 shutdown_connections 2023-11-17T06:33:45.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f139406ffb0 0x7f13940cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 --2- 172.21.15.100:0/2914301860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13940c22d0 0x7f13940cb080 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 -- 172.21.15.100:0/2914301860 >> 172.21.15.100:0/2914301860 conn(0x7f13940ced90 msgr2=0x7f13940cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 -- 172.21.15.100:0/2914301860 shutdown_connections 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.846+0000 7f13996a8700 1 -- 172.21.15.100:0/2914301860 wait complete. 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 Processor -- start 2023-11-17T06:33:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 -- start start 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139406fb20 0x7f13940c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 0x7f13940c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13940c22d0 0x7f13940c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940c2fe0 con 0x7f139406ffb0 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940c2960 con 0x7f139406fb20 2023-11-17T06:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13996a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13941ecb00 con 0x7f13940c22d0 2023-11-17T06:33:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 0x7f13940c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 0x7f13940c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48464/0 (socket says 172.21.15.100:48464) 2023-11-17T06:33:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 -- 172.21.15.100:0/832523518 learned_addr learned my addr 172.21.15.100:0/832523518 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f1392ffd700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139406fb20 0x7f13940c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13937fe700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13940c22d0 0x7f13940c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 -- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13940c22d0 msgr2=0x7f13940c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13940c22d0 0x7f13940c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 -- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139406fb20 msgr2=0x7f13940c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139406fb20 0x7f13940c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009a70 con 0x7f139406ffb0 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f1392ffd700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139406fb20 0x7f13940c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f13937fe700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13940c22d0 0x7f13940c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.850+0000 7f138a7fc700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 0x7f13940c4c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f138400c700 tx=0x7f138400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384005d90 con 0x7f139406ffb0 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13840070d0 con 0x7f139406ffb0 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384007480 con 0x7f139406ffb0 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0094b0 con 0x7f139406ffb0 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13941ecde0 con 0x7f139406ffb0 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13940c98d0 con 0x7f139406ffb0 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.854+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f13840075e0 con 0x7f139406ffb0 2023-11-17T06:33:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f138bfff700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1378066510 0x7f13780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f13840831e0 con 0x7f139406ffb0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f1392ffd700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1378066510 0x7f13780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f138bfff700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7f137806c4b0 0x7f137806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f137806ef80 con 0x7f137806c4b0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1384085870 con 0x7f139406ffb0 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f13937fe700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7f137806c4b0 0x7f137806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f1392ffd700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1378066510 0x7f13780689d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f137c0090b0 tx=0x7f137c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.858+0000 7f13937fe700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7f137806c4b0 0x7f137806e8d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.862+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== osd.6 v2:172.21.15.119:6800/1264916422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f137806ef80 con 0x7f137806c4b0 2023-11-17T06:33:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.878+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 --> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13940c95f0 con 0x7f137806c4b0 2023-11-17T06:33:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.878+0000 7f138bfff700 1 -- 172.21.15.100:0/832523518 <== osd.6 v2:172.21.15.119:6800/1264916422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f138c00f040 con 0x7f137806c4b0 2023-11-17T06:33:45.885 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:45.886 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:45.886 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:45.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7f137806c4b0 msgr2=0x7f137806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.119:6800/1264916422,v1:172.21.15.119:6801/1264916422] conn(0x7f137806c4b0 0x7f137806e8d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1378066510 msgr2=0x7f13780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f1378066510 0x7f13780689d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f137c0090b0 tx=0x7f137c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:45.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 msgr2=0x7f13940c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 --2- 172.21.15.100:0/832523518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139406ffb0 0x7f13940c4c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f138400c700 tx=0x7f138400cac0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13937fe700 1 -- 172.21.15.100:0/832523518 reap_dead start 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 shutdown_connections 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 >> 172.21.15.100:0/832523518 conn(0x7f13940ced90 msgr2=0x7f13940b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 shutdown_connections 2023-11-17T06:33:45.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:45.882+0000 7f13996a8700 1 -- 172.21.15.100:0/832523518 wait complete. 2023-11-17T06:33:45.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-17T06:33:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.086+0000 7f362273c700 1 Processor -- start 2023-11-17T06:33:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.086+0000 7f362273c700 1 -- start start 2023-11-17T06:33:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f362273c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f362273c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 0x7f361c0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f362273c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0b1720 con 0x7f361c15a100 2023-11-17T06:33:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f362273c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c15eb00 con 0x7f361c0cd7e0 2023-11-17T06:33:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f362273c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c070ca0 con 0x7f361c0b0da0 2023-11-17T06:33:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:53266/0 (socket says 172.21.15.100:53266) 2023-11-17T06:33:46.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 -- 172.21.15.100:0/4173781620 learned_addr learned my addr 172.21.15.100:0/4173781620 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:46.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3620cd9700 1 --2- 172.21.15.100:0/4173781620 >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 0x7f361c0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 -- 172.21.15.100:0/4173781620 >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 msgr2=0x7f361c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 --2- 172.21.15.100:0/4173781620 >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 0x7f361c0cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 -- 172.21.15.100:0/4173781620 >> v1:172.21.15.119:6789/0 conn(0x7f361c15a100 legacy=0x7f361c071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3613fff700 1 -- 172.21.15.100:0/4173781620 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c070f80 con 0x7f361c0b0da0 2023-11-17T06:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.090+0000 7f3620cd9700 1 --2- 172.21.15.100:0/4173781620 >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 0x7f361c0cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f3613fff700 1 --2- 172.21.15.100:0/4173781620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f360400bbb0 tx=0x7f360400bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad151ef6d6f61721 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f361b7fe700 1 -- 172.21.15.100:0/4173781620 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400dd30 con 0x7f361c0b0da0 2023-11-17T06:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f361b7fe700 1 -- 172.21.15.100:0/4173781620 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400de90 con 0x7f361c0b0da0 2023-11-17T06:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f361b7fe700 1 -- 172.21.15.100:0/4173781620 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604010690 con 0x7f361c0b0da0 2023-11-17T06:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 -- 172.21.15.100:0/4173781620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 msgr2=0x7f361c0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 --2- 172.21.15.100:0/4173781620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f360400bbb0 tx=0x7f360400bec0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 -- 172.21.15.100:0/4173781620 shutdown_connections 2023-11-17T06:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 --2- 172.21.15.100:0/4173781620 >> v2:172.21.15.119:3300/0 conn(0x7f361c0cd7e0 0x7f361c0cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 --2- 172.21.15.100:0/4173781620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c0b0da0 0x7f361c0b11e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 -- 172.21.15.100:0/4173781620 >> 172.21.15.100:0/4173781620 conn(0x7f361c06a480 msgr2=0x7f361c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 -- 172.21.15.100:0/4173781620 shutdown_connections 2023-11-17T06:33:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.094+0000 7f362273c700 1 -- 172.21.15.100:0/4173781620 wait complete. 2023-11-17T06:33:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 Processor -- start 2023-11-17T06:33:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- start start 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f361c0b0da0 0x7f361c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c15a100 0x7f361c0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c143020 con 0x7f361c0cd7e0 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1435a0 con 0x7f361c0b0da0 2023-11-17T06:33:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1569a0 con 0x7f361c15a100 2023-11-17T06:33:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48472/0 (socket says 172.21.15.100:48472) 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 -- 172.21.15.100:0/3569381075 learned_addr learned my addr 172.21.15.100:0/3569381075 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3620cd9700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c15a100 0x7f361c0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f361bfff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f361c0b0da0 0x7f361c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 -- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c15a100 msgr2=0x7f361c0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c15a100 0x7f361c0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 -- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f361c0b0da0 msgr2=0x7f361c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f361c0b0da0 0x7f361c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 -- 172.21.15.100:0/3569381075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009a70 con 0x7f361c0cd7e0 2023-11-17T06:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f3613fff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f360400d5d0 tx=0x7f3604004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360401d040 con 0x7f361c0cd7e0 2023-11-17T06:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604003bf0 con 0x7f361c0cd7e0 2023-11-17T06:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360400b810 con 0x7f361c0cd7e0 2023-11-17T06:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604010470 con 0x7f361c0cd7e0 2023-11-17T06:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.098+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c0c4650 con 0x7f361c0cd7e0 2023-11-17T06:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.102+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c04eea0 con 0x7f361c0cd7e0 2023-11-17T06:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.102+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3604019400 con 0x7f361c0cd7e0 2023-11-17T06:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.106+0000 7f36197fa700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 0x7f35fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.106+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f3604084fc0 con 0x7f361c0cd7e0 2023-11-17T06:33:46.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.106+0000 7f361bfff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 0x7f35fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.106+0000 7f361bfff700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 0x7f35fc0689d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c54e0 tx=0x7f360c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.114+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3604052680 con 0x7f361c0cd7e0 2023-11-17T06:33:46.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.286+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f361c15a4e0 con 0x7f35fc066510 2023-11-17T06:33:46.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.290+0000 7f36197fa700 1 -- 172.21.15.100:0/3569381075 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f360c001ca0 con 0x7f35fc066510 2023-11-17T06:33:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 msgr2=0x7f35fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 0x7f35fc0689d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c54e0 tx=0x7f360c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 msgr2=0x7f361c0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f360400d5d0 tx=0x7f3604004770 comp rx=0 tx=0).stop 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 shutdown_connections 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f361c15a100 0x7f361c0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f35fc066510 0x7f35fc0689d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f361c0cd7e0 0x7f361c0c3750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 --2- 172.21.15.100:0/3569381075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f361c0b0da0 0x7f361c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 >> 172.21.15.100:0/3569381075 conn(0x7f361c06a480 msgr2=0x7f361c0adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 shutdown_connections 2023-11-17T06:33:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.294+0000 7f362273c700 1 -- 172.21.15.100:0/3569381075 wait complete. 2023-11-17T06:33:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2023-11-17T06:33:46.319 INFO:tasks.ceph:Scrubbing osd.7 2023-11-17T06:33:46.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:33:46.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.498+0000 7f6ecccc1700 1 Processor -- start 2023-11-17T06:33:46.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.498+0000 7f6ecccc1700 1 -- start start 2023-11-17T06:33:46.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ecccc1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ecccc1700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ec80b8f80 0x7f6ec80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ecccc1700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec8160d30 con 0x7f6ec80b6790 2023-11-17T06:33:46.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ecccc1700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80ce8f0 con 0x7f6ec80b8f80 2023-11-17T06:33:46.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ecccc1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80d2110 con 0x7f6ec8160950 2023-11-17T06:33:46.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.100:53290/0 (socket says 172.21.15.100:53290) 2023-11-17T06:33:46.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 -- 172.21.15.100:0/2058079944 learned_addr learned my addr 172.21.15.100:0/2058079944 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:46.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec6ffd700 1 --2- 172.21.15.100:0/2058079944 >> v2:172.21.15.119:3300/0 conn(0x7f6ec80b8f80 0x7f6ec80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 -- 172.21.15.100:0/2058079944 >> v2:172.21.15.119:3300/0 conn(0x7f6ec80b8f80 msgr2=0x7f6ec80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:46.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 --2- 172.21.15.100:0/2058079944 >> v2:172.21.15.119:3300/0 conn(0x7f6ec80b8f80 0x7f6ec80b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 -- 172.21.15.100:0/2058079944 >> v1:172.21.15.119:6789/0 conn(0x7f6ec80b6790 legacy=0x7f6ec80cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 -- 172.21.15.100:0/2058079944 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80b2790 con 0x7f6ec8160950 2023-11-17T06:33:46.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec77fe700 1 --2- 172.21.15.100:0/2058079944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009910 tx=0x7f6eb8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20b341872e90086 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec67fc700 1 -- 172.21.15.100:0/2058079944 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8011830 con 0x7f6ec8160950 2023-11-17T06:33:46.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec67fc700 1 -- 172.21.15.100:0/2058079944 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8011990 con 0x7f6ec8160950 2023-11-17T06:33:46.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.502+0000 7f6ec67fc700 1 -- 172.21.15.100:0/2058079944 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8011d40 con 0x7f6ec8160950 2023-11-17T06:33:46.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 -- 172.21.15.100:0/2058079944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 msgr2=0x7f6ec80b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/2058079944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009910 tx=0x7f6eb8009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 -- 172.21.15.100:0/2058079944 shutdown_connections 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/2058079944 >> v2:172.21.15.119:3300/0 conn(0x7f6ec80b8f80 0x7f6ec80b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/2058079944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec8160950 0x7f6ec80b8a40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 -- 172.21.15.100:0/2058079944 >> 172.21.15.100:0/2058079944 conn(0x7f6ec806acf0 msgr2=0x7f6ec806b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 -- 172.21.15.100:0/2058079944 shutdown_connections 2023-11-17T06:33:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.506+0000 7f6ecccc1700 1 -- 172.21.15.100:0/2058079944 wait complete. 2023-11-17T06:33:46.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 Processor -- start 2023-11-17T06:33:46.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 -- start start 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 0x7f6ec80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec80b8f80 0x7f6ec80c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec8160950 0x7f6ec8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80cb760 con 0x7f6ec80b6790 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8155810 con 0x7f6ec8160950 2023-11-17T06:33:46.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ecccc1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8158400 con 0x7f6ec80b8f80 2023-11-17T06:33:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ec77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 0x7f6ec80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ec77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 0x7f6ec80caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48476/0 (socket says 172.21.15.100:48476) 2023-11-17T06:33:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ec77fe700 1 -- 172.21.15.100:0/4128408419 learned_addr learned my addr 172.21.15.100:0/4128408419 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ec6ffd700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec80b8f80 0x7f6ec80c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.510+0000 7f6ec7fff700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec8160950 0x7f6ec8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 -- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec80b8f80 msgr2=0x7f6ec80c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ec80b8f80 0x7f6ec80c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 -- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec8160950 msgr2=0x7f6ec8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ec8160950 0x7f6ec8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8009570 con 0x7f6ec80b6790 2023-11-17T06:33:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ec77fe700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 0x7f6ec80caca0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80d2250 tx=0x7f6eb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8004510 con 0x7f6ec80b6790 2023-11-17T06:33:46.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8157830 con 0x7f6ec80b6790 2023-11-17T06:33:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb801e070 con 0x7f6ec80b6790 2023-11-17T06:33:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8003900 con 0x7f6ec80b6790 2023-11-17T06:33:46.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8157db0 con 0x7f6ec80b6790 2023-11-17T06:33:46.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ec80ce610 con 0x7f6ec80b6790 2023-11-17T06:33:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.514+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6eb8003a60 con 0x7f6ec80b6790 2023-11-17T06:33:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6eaffff700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6eb4066510 0x7f6eb40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6eb8020070 con 0x7f6ec80b6790 2023-11-17T06:33:46.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6ec6ffd700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6eb4066510 0x7f6eb40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6eaffff700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6eb406c4b0 0x7f6eb406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6eb406ef80 con 0x7f6eb406c4b0 2023-11-17T06:33:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eb8085810 con 0x7f6ec80b6790 2023-11-17T06:33:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6ec7fff700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6eb406c4b0 0x7f6eb406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6ec6ffd700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6eb4066510 0x7f6eb40689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b4ae0 tx=0x7f6ebc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.518+0000 7f6ec7fff700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6eb406c4b0 0x7f6eb406e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.522+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== osd.7 v2:172.21.15.119:6808/609004044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6eb406ef80 con 0x7f6eb406c4b0 2023-11-17T06:33:46.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.538+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 --> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6ec80ce330 con 0x7f6eb406c4b0 2023-11-17T06:33:46.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6eaffff700 1 -- 172.21.15.100:0/4128408419 <== osd.7 v2:172.21.15.119:6808/609004044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6ec0001fc0 con 0x7f6eb406c4b0 2023-11-17T06:33:46.546 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-11-17T06:33:46.546 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:33:46.547 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-11-17T06:33:46.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6eb406c4b0 msgr2=0x7f6eb406e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.119:6808/609004044,v1:172.21.15.119:6809/609004044] conn(0x7f6eb406c4b0 0x7f6eb406e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6eb4066510 msgr2=0x7f6eb40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f6eb4066510 0x7f6eb40689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80b4ae0 tx=0x7f6ebc009240 comp rx=0 tx=0).stop 2023-11-17T06:33:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 msgr2=0x7f6ec80caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 --2- 172.21.15.100:0/4128408419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80b6790 0x7f6ec80caca0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80d2250 tx=0x7f6eb8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:46.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ec7fff700 1 -- 172.21.15.100:0/4128408419 reap_dead start 2023-11-17T06:33:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 shutdown_connections 2023-11-17T06:33:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 >> 172.21.15.100:0/4128408419 conn(0x7f6ec806acf0 msgr2=0x7f6ec80d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 shutdown_connections 2023-11-17T06:33:46.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.542+0000 7f6ecccc1700 1 -- 172.21.15.100:0/4128408419 wait complete. 2023-11-17T06:33:46.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-17T06:33:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.746+0000 7f97288c3700 1 Processor -- start 2023-11-17T06:33:46.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.746+0000 7f97288c3700 1 -- start start 2023-11-17T06:33:46.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9724160f40 0x7f97240d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240b04d0 con 0x7f97240d17e0 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240d0710 con 0x7f9724160b60 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97240d09f0 con 0x7f9724160f40 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972259c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9724160f40 0x7f97240d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972359e700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f97240d17e0 0x7f97240b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52790/0 (socket says 172.21.15.100:52790) 2023-11-17T06:33:46.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972359e700 1 -- 172.21.15.100:0/1646648572 learned_addr learned my addr 172.21.15.100:0/1646648572 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:33:46.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972259c700 1 -- 172.21.15.100:0/1646648572 >> v1:172.21.15.119:6789/0 conn(0x7f9724160b60 legacy=0x7f97240d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972259c700 1 -- 172.21.15.100:0/1646648572 >> v1:172.21.15.100:6789/0 conn(0x7f97240d17e0 legacy=0x7f97240b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972259c700 1 -- 172.21.15.100:0/1646648572 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240afe80 con 0x7f9724160f40 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f9721d9b700 1 -- 172.21.15.100:0/1646648572 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441601025 0 0) 0x7f97240b04d0 con 0x7f97240d17e0 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f972259c700 1 --2- 172.21.15.100:0/1646648572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160f40 0x7f97240d0080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9718009850 tx=0x7f9718009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7789c8240f6ce9c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f9721d9b700 1 -- 172.21.15.100:0/1646648572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718011830 con 0x7f9724160f40 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f9721d9b700 1 -- 172.21.15.100:0/1646648572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718011990 con 0x7f9724160f40 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f9721d9b700 1 -- 172.21.15.100:0/1646648572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718011d20 con 0x7f9724160f40 2023-11-17T06:33:46.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 -- 172.21.15.100:0/1646648572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160f40 msgr2=0x7f97240d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.750+0000 7f97288c3700 1 --2- 172.21.15.100:0/1646648572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160f40 0x7f97240d0080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9718009850 tx=0x7f9718009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 -- 172.21.15.100:0/1646648572 shutdown_connections 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 --2- 172.21.15.100:0/1646648572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160f40 0x7f97240d0080 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 -- 172.21.15.100:0/1646648572 >> 172.21.15.100:0/1646648572 conn(0x7f97240d31d0 msgr2=0x7f97240d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 -- 172.21.15.100:0/1646648572 shutdown_connections 2023-11-17T06:33:46.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 -- 172.21.15.100:0/1646648572 wait complete. 2023-11-17T06:33:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 Processor -- start 2023-11-17T06:33:46.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.754+0000 7f97288c3700 1 -- start start 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 0x7f9724152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 0x7f97240c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97240c7240 con 0x7f9724160b60 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972415ae80 con 0x7f97240cce40 2023-11-17T06:33:46.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972415b160 con 0x7f97240d17e0 2023-11-17T06:33:46.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48488/0 (socket says 172.21.15.100:48488) 2023-11-17T06:33:46.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 -- 172.21.15.100:0/1119344513 learned_addr learned my addr 172.21.15.100:0/1119344513 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:46.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972359e700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 0x7f97240c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f9722d9d700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 0x7f9724152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 -- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 msgr2=0x7f9724152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 0x7f9724152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 -- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 msgr2=0x7f97240c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 0x7f97240c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 -- 172.21.15.100:0/1119344513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180094b0 con 0x7f9724160b60 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972359e700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 0x7f97240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:46.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f9722d9d700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 0x7f9724152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f972259c700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9718000c00 tx=0x7f9718004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718003ad0 con 0x7f9724160b60 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971801e070 con 0x7f9724160b60 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972415b440 con 0x7f9724160b60 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718003e90 con 0x7f9724160b60 2023-11-17T06:33:46.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.758+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97240ca840 con 0x7f9724160b60 2023-11-17T06:33:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.762+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9724152b40 con 0x7f9724160b60 2023-11-17T06:33:46.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.762+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f971802d450 con 0x7f9724160b60 2023-11-17T06:33:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.762+0000 7f970b7fe700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 0x7f97100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.762+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9718084e00 con 0x7f9724160b60 2023-11-17T06:33:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.766+0000 7f9722d9d700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 0x7f97100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.766+0000 7f9722d9d700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 0x7f97100689d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9714000f60 tx=0x7f9714009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.770+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97180524d0 con 0x7f9724160b60 2023-11-17T06:33:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f97240b0160 con 0x7f9710066510 2023-11-17T06:33:46.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f970b7fe700 1 -- 172.21.15.100:0/1119344513 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9714001d70 con 0x7f9710066510 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 msgr2=0x7f97100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 0x7f97100689d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9714000f60 tx=0x7f9714009040 comp rx=0 tx=0).stop 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 msgr2=0x7f97240c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.942+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9718000c00 tx=0x7f9718004770 comp rx=0 tx=0).stop 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 shutdown_connections 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97240cce40 0x7f97240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f9710066510 0x7f97100689d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724160b60 0x7f97240c6d00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 --2- 172.21.15.100:0/1119344513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f97240d17e0 0x7f9724152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 >> 172.21.15.100:0/1119344513 conn(0x7f97240d31d0 msgr2=0x7f97240d35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 shutdown_connections 2023-11-17T06:33:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:46.946+0000 7f97288c3700 1 -- 172.21.15.100:0/1119344513 wait complete. 2023-11-17T06:33:46.952 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2023-11-17T06:33:46.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:47.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.142+0000 7f0cc5906700 1 Processor -- start 2023-11-17T06:33:47.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.142+0000 7f0cc5906700 1 -- start start 2023-11-17T06:33:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cc5906700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e1c0 0x7f0cc0141390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cc5906700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0cc015edd0 0x7f0cc00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cc5906700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc01418d0 con 0x7f0cc013e930 2023-11-17T06:33:47.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cc5906700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc006a650 con 0x7f0cc015edd0 2023-11-17T06:33:47.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cc5906700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc015f300 con 0x7f0cc013e1c0 2023-11-17T06:33:47.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0cc015edd0 0x7f0cc00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0cc015edd0 0x7f0cc00cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48494/0 (socket says 172.21.15.100:48494) 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 -- 172.21.15.100:0/2523655098 learned_addr learned my addr 172.21.15.100:0/2523655098 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cbeffd700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e1c0 0x7f0cc0141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 -- 172.21.15.100:0/2523655098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e1c0 msgr2=0x7f0cc0141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e1c0 0x7f0cc0141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 -- 172.21.15.100:0/2523655098 >> v1:172.21.15.119:6789/0 conn(0x7f0cc013e930 legacy=0x7f0cc0164150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 -- 172.21.15.100:0/2523655098 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc015f5e0 con 0x7f0cc015edd0 2023-11-17T06:33:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.146+0000 7f0cb7fff700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00cb8e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009910 tx=0x7f0ca8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7dd62e94fb0c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cbe7fc700 1 -- 172.21.15.100:0/2523655098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800ba60 con 0x7f0cc015edd0 2023-11-17T06:33:47.154 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cbe7fc700 1 -- 172.21.15.100:0/2523655098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca800bbc0 con 0x7f0cc015edd0 2023-11-17T06:33:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cbe7fc700 1 -- 172.21.15.100:0/2523655098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8009e60 con 0x7f0cc015edd0 2023-11-17T06:33:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- 172.21.15.100:0/2523655098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 msgr2=0x7f0cc00cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00cb8e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009910 tx=0x7f0ca8009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- 172.21.15.100:0/2523655098 shutdown_connections 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00cb8e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2523655098 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e1c0 0x7f0cc0141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- 172.21.15.100:0/2523655098 >> 172.21.15.100:0/2523655098 conn(0x7f0cc006d3e0 msgr2=0x7f0cc006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- 172.21.15.100:0/2523655098 shutdown_connections 2023-11-17T06:33:47.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- 172.21.15.100:0/2523655098 wait complete. 2023-11-17T06:33:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 Processor -- start 2023-11-17T06:33:47.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.150+0000 7f0cc5906700 1 -- start start 2023-11-17T06:33:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 0x7f0cc00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e930 0x7f0cc013c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0070a40 con 0x7f0cc015edd0 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc006fe30 con 0x7f0cc013e1c0 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0070110 con 0x7f0cc013e930 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48510/0 (socket says 172.21.15.100:48510) 2023-11-17T06:33:47.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 -- 172.21.15.100:0/2457131250 learned_addr learned my addr 172.21.15.100:0/2457131250 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:33:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbeffd700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 0x7f0cc00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cb7fff700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e930 0x7f0cc013c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 -- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e930 msgr2=0x7f0cc013c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.161 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e930 0x7f0cc013c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 -- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 msgr2=0x7f0cc00b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 0x7f0cc00b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 -- 172.21.15.100:0/2457131250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009570 con 0x7f0cc015edd0 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbeffd700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 0x7f0cc00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbf7fe700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800cb50 tx=0x7f0cb800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8003c20 con 0x7f0cc015edd0 2023-11-17T06:33:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8003d80 con 0x7f0cc015edd0 2023-11-17T06:33:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00703f0 con 0x7f0cc015edd0 2023-11-17T06:33:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800ab70 con 0x7f0cc015edd0 2023-11-17T06:33:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.154+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc01fb340 con 0x7f0cc015edd0 2023-11-17T06:33:47.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.158+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00b4440 con 0x7f0cc015edd0 2023-11-17T06:33:47.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.158+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0cb800acd0 con 0x7f0cc015edd0 2023-11-17T06:33:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.158+0000 7f0cbcff9700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 0x7f0ca00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.158+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0cb8083d10 con 0x7f0cc015edd0 2023-11-17T06:33:47.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.162+0000 7f0cbeffd700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 0x7f0ca00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.162+0000 7f0cbeffd700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 0x7f0ca00689d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0cc01fb710 tx=0x7f0cb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.166+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cb8089020 con 0x7f0cc015edd0 2023-11-17T06:33:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.342+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cc015fba0 con 0x7f0ca0066510 2023-11-17T06:33:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.346+0000 7f0cbcff9700 1 -- 172.21.15.100:0/2457131250 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48381 (secure 0 0 0) 0x7f0cb0007680 con 0x7f0ca0066510 2023-11-17T06:33:47.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:33:47.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 msgr2=0x7f0ca00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 0x7f0ca00689d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0cc01fb710 tx=0x7f0cb0008040 comp rx=0 tx=0).stop 2023-11-17T06:33:47.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 msgr2=0x7f0cc00b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800cb50 tx=0x7f0cb800cf10 comp rx=0 tx=0).stop 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 shutdown_connections 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0ca0066510 0x7f0ca00689d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc015edd0 0x7f0cc00b1e60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc013e930 0x7f0cc013c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 --2- 172.21.15.100:0/2457131250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc013e1c0 0x7f0cc00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 >> 172.21.15.100:0/2457131250 conn(0x7f0cc006d3e0 msgr2=0x7f0cc00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.350+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 shutdown_connections 2023-11-17T06:33:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:33:47.354+0000 7f0cc5906700 1 -- 172.21.15.100:0/2457131250 wait complete. 2023-11-17T06:33:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:33:47.380 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2023-11-17T06:33:45.349341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233480,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741240,"statfs":{"total":773094113280,"available":772855029760,"internally_reserved":0,"allocated":4923392,"data_stored":2677224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-190,"num_objects":-100,"num_object_clones":0,"num_object_copies":-200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-100,"num_whiteouts":0,"num_read":-1100,"num_read_kb":-500,"num_write":-600,"num_write_kb":-100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.400654"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-17T06:33:36.167301+0000","last_change":"2023-11-17T06:28:45.966672+0000","last_active":"2023-11-17T06:33:36.167301+0000","last_peered":"2023-11-17T06:33:36.167301+0000","last_clean":"2023-11-17T06:33:36.167301+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:33:36.167301+0000","last_undegraded":"2023-11-17T06:33:36.167301+0000","last_fullsized":"2023-11-17T06:33:36.167301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:28:43.773353+0000","last_clean_scrub_stamp":"2023-11-17T06:28:43.773353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:21:59.043826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.218,"15min":1.3440000000000001},"min":{"1min":0.75,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.532,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.2270000000000001,"15min":1.3740000000000001},"min":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.7130000000000001,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3009999999999999,"15min":1.4370000000000001},"min":{"1min":0.78400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.3460000000000001,"15min":1.5549999999999999},"min":{"1min":0.79600000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.675,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.28,"15min":1.379},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6140000000000001,"5min":1.919,"15min":1.919},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1799999999999999,"15min":1.2250000000000001},"min":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.409,"5min":1.835,"15min":1.835},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3899999999999999,"15min":1.5409999999999999},"min":{"1min":1.0489999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.639,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.397,"5min":1.4690000000000001,"15min":1.6220000000000001},"min":{"1min":1.075,"5min":0.496,"15min":0.496},"max":{"1min":1.7250000000000001,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.167,"15min":1.256},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.385,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.296,"15min":1.4119999999999999},"min":{"1min":0.77200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.548,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3680000000000001,"15min":1.4910000000000001},"min":{"1min":0.65200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.7210000000000001,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.341,"15min":1.415},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5529999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.4179999999999999,"15min":1.5309999999999999},"min":{"1min":0.66400000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5089999999999999,"5min":2.375,"15min":2.375},"last":1.02},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.411,"15min":1.4970000000000001},"min":{"1min":0.93600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7050000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.119,"15min":1.1160000000000001},"min":{"1min":0.65600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.554,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.401},{"interface":"front","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1719999999999999},"min":{"1min":0.77200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.492,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.466}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.571,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.286},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.256,"15min":1.292},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.7050000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1850000000000001,"15min":1.2170000000000001},"min":{"1min":0.95099999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2729999999999999,"15min":1.321},"min":{"1min":1.127,"5min":0.87,"15min":0.87},"max":{"1min":1.6120000000000001,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.294,"15min":1.3560000000000001},"min":{"1min":0.97999999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.546,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.248,"15min":1.3200000000000001},"min":{"1min":0.98799999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4239999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.175}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.252,"15min":1.3320000000000001},"min":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4570000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.133},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3360000000000001,"15min":1.4219999999999999},"min":{"1min":0.77200000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6459999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.641}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2290000000000001,"15min":1.274},"min":{"1min":0.88200000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.609,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.103},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":0.97599999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6459999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.204}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.472,"15min":1.532},"min":{"1min":1.085,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9430000000000001,"5min":2.548,"15min":2.548},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4339999999999999,"15min":1.494},"min":{"1min":1.0880000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.849,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.264}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.137,"15min":1.1339999999999999},"min":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5029999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.133},{"interface":"front","average":{"1min":1.125,"5min":1.228,"15min":1.327},"min":{"1min":0.78800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.5309999999999999,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":1.0669999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1899999999999999,"15min":1.232},"min":{"1min":0.73999999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4279999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2709999999999999,"15min":1.329},"min":{"1min":0.99199999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.53,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.012}]},{"osd":2,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2250000000000001,"15min":1.28},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6279999999999999,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.486},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.292,"15min":1.3839999999999999},"min":{"1min":0.86899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4650000000000001,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.1930000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.351,"15min":1.4390000000000001},"min":{"1min":0.94999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.538,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.405,"15min":1.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8480000000000001,"5min":3.48,"15min":3.48},"last":1.569}]},{"osd":4,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.3160000000000001,"15min":1.3620000000000001},"min":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.6599999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.306},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3999999999999999,"15min":1.5169999999999999},"min":{"1min":0.79800000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.752,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.228}]},{"osd":6,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.76700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.776,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.4630000000000001,"15min":1.5529999999999999},"min":{"1min":0.97799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8009999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.393}]},{"osd":7,"last update":"Fri Nov 17 06:32:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.514,"15min":1.6120000000000001},"min":{"1min":1.1499999999999999,"5min":0.748,"15min":0.748},"max":{"1min":1.8879999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.5669999999999999,"15min":1.649},"min":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.9139999999999999,"5min":3.355,"15min":3.355},"last":1.6890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.165,"15min":1.161},"min":{"1min":0.79600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6890000000000001,"5min":2.286,"15min":2.286},"last":1.052},{"interface":"front","average":{"1min":1.218,"5min":1.1699999999999999,"15min":1.21},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.589,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.498,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.194,"15min":1.1619999999999999},"min":{"1min":0.92700000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6160000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.393,"15min":1.619},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.45,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3799999999999999,"15min":1.5409999999999999},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.554,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.22,"15min":1.2170000000000001},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5429999999999999,"5min":2.399,"15min":2.399},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5189999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.359}]},{"osd":5,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.22,"15min":1.1779999999999999},"min":{"1min":0.85399999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.673,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.2450000000000001,"15min":1.27},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5820000000000001,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.0069999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.294,"15min":1.3660000000000001},"min":{"1min":0.745,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5449999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4079999999999999,"15min":1.468},"min":{"1min":0.98699999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.915,"5min":2.681,"15min":2.681},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Nov 17 06:32:57 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3,"15min":1.3440000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.484,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6240000000000001,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.4530000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1910000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.0049999999999999,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.0980000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.4570000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.125,"15min":1.163},"min":{"1min":0.69599999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3129999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.68300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4059999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.1339999999999999,"15min":1.218},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6240000000000001,"5min":1.907,"15min":1.907},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.329,"15min":1.427},"min":{"1min":0.97999999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.4850000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.343,"15min":1.425},"min":{"1min":0.89400000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6910000000000001,"5min":2.359,"15min":2.359},"last":1.119}]},{"osd":5,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3560000000000001,"15min":1.4259999999999999},"min":{"1min":1.014,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.587,"5min":2.375,"15min":2.375},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.373,"15min":1.4850000000000001},"min":{"1min":0.91200000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6279999999999999,"5min":2.202,"15min":2.202},"last":1.032}]},{"osd":6,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.413,"15min":1.492},"min":{"1min":1.0609999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.6060000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4219999999999999,"15min":1.5349999999999999},"min":{"1min":1.0149999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.667,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.5820000000000001},"min":{"1min":1.032,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.7070000000000001,"5min":2.431,"15min":2.431},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.415,"5min":1.4850000000000001,"15min":1.591},"min":{"1min":1.1379999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.7689999999999999,"5min":2.427,"15min":2.427},"last":1.052}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.073,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.90700000000000003,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82199999999999995}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.86299999999999999,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1910000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0680000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.133,"15min":1.1930000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4610000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":1.0189999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.637,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.343},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.22,"15min":1.282},"min":{"1min":0.94099999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3859999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.306,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.4119999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.399,"15min":1.4530000000000001},"min":{"1min":1.109,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":1.577,"5min":1.948,"15min":1.948},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.361,"15min":1.4299999999999999},"min":{"1min":1.008,"5min":0.874,"15min":0.874},"max":{"1min":1.5209999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.399,"5min":1.4239999999999999,"15min":1.506},"min":{"1min":1.0660000000000001,"5min":1.028,"15min":1.028},"max":{"1min":1.6479999999999999,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.131}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.413,"15min":1.4750000000000001},"min":{"1min":0.98299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5649999999999999,"5min":2.194,"15min":2.194},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5049999999999999,"15min":1.575},"min":{"1min":1.2490000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.702,"5min":2.464,"15min":2.464},"last":1.474}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0149999999999999,"15min":1.0109999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5389999999999999,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.64100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.466,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.83099999999999996}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.0509999999999999},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5329999999999999,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.089,"15min":1.111},"min":{"1min":0.78200000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6140000000000001,"5min":2.262,"15min":2.262},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.244,"15min":1.3049999999999999},"min":{"1min":0.85399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1950000000000001,"15min":1.3149999999999999},"min":{"1min":0.82699999999999996,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.745}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.343,"15min":1.3999999999999999},"min":{"1min":1.101,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.621,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.208,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.679,"5min":3.891,"15min":3.891},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3759999999999999,"15min":1.4259999999999999},"min":{"1min":1.0509999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4470000000000001,"15min":1.5549999999999999},"min":{"1min":1.097,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8440000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.212}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.536},"min":{"1min":1.153,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.835,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.5209999999999999,"15min":1.593},"min":{"1min":1.018,"5min":0.88,"15min":0.88},"max":{"1min":1.8759999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.107}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.546,"15min":1.6699999999999999},"min":{"1min":0.98599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.9159999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.337},{"interface":"front","average":{"1min":1.47,"5min":1.5349999999999999,"15min":1.615},"min":{"1min":1.2210000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.056,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.97399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.92300000000000004},"min":{"1min":0.68300000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1579999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.141,"15min":1.109},"min":{"1min":0.80900000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.417,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.95699999999999996},"min":{"1min":0.73699999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3049999999999999,"5min":1.905,"15min":1.905},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0609999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.5669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0820000000000001,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6299999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.629},{"interface":"front","average":{"1min":1.302,"5min":1.286,"15min":1.3360000000000001},"min":{"1min":1.0069999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7250000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.179}]},{"osd":4,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.292,"15min":1.254},"min":{"1min":1.054,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.494,"5min":2.504,"15min":2.504},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3220000000000001,"15min":1.3660000000000001},"min":{"1min":1.089,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5900000000000001,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.345}]},{"osd":5,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3859999999999999,"15min":1.425},"min":{"1min":1.0189999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5449999999999999,"5min":3.121,"15min":3.121},"last":1.109},{"interface":"front","average":{"1min":1.331,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":1.129,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6479999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.427,"15min":1.4870000000000001},"min":{"1min":1.1399999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.7070000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.383},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.6839999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.224}]},{"osd":7,"last update":"Fri Nov 17 06:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.482,"15min":1.528},"min":{"1min":1.1140000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.784,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4710000000000001,"15min":1.5049999999999999},"min":{"1min":1.2130000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.6799999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.4850000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:47.384 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-17T06:28:43.773353+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=43, tm_wday=4, tm_yday=321, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=17, tm_hour=6, tm_min=33, tm_sec=40, tm_wday=4, tm_yday=321, tm_isdst=0) 2023-11-17T06:33:47.385 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-17T06:34:01.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:01.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:07.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:34:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.558+0000 7ff6fd4d4700 1 Processor -- start 2023-11-17T06:34:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.558+0000 7ff6fd4d4700 1 -- start start 2023-11-17T06:34:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.558+0000 7ff6fd4d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6f815ca60 0x7ff6f815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80cb620 con 0x7ff6f806bc20 2023-11-17T06:34:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f8155e10 con 0x7ff6f815ca60 2023-11-17T06:34:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8070390 con 0x7ff6f80cb9e0 2023-11-17T06:34:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6f815ca60 0x7ff6f815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6f815ca60 0x7ff6f815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38830/0 (socket says 172.21.15.100:38830) 2023-11-17T06:34:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 -- 172.21.15.100:0/2206939002 learned_addr learned my addr 172.21.15.100:0/2206939002 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:34:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f6ffd700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 -- 172.21.15.100:0/2206939002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 msgr2=0x7ff6f80cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:07.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f80cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 -- 172.21.15.100:0/2206939002 >> v1:172.21.15.119:6789/0 conn(0x7ff6f806bc20 legacy=0x7ff6f806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 -- 172.21.15.100:0/2206939002 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80cc300 con 0x7ff6f815ca60 2023-11-17T06:34:07.568 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f77fe700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f815ce60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009e50 tx=0x7ff6f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e49d92b6b7b5ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f67fc700 1 -- 172.21.15.100:0/2206939002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000e070 con 0x7ff6f815ca60 2023-11-17T06:34:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f67fc700 1 -- 172.21.15.100:0/2206939002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000b9c0 con 0x7ff6f815ca60 2023-11-17T06:34:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6f67fc700 1 -- 172.21.15.100:0/2206939002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000bd70 con 0x7ff6f815ca60 2023-11-17T06:34:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/2206939002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 msgr2=0x7ff6f815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f815ce60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009e50 tx=0x7ff6f000b330 comp rx=0 tx=0).stop 2023-11-17T06:34:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/2206939002 shutdown_connections 2023-11-17T06:34:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f815ce60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/2206939002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f80cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/2206939002 >> 172.21.15.100:0/2206939002 conn(0x7ff6f806a480 msgr2=0x7ff6f806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/2206939002 shutdown_connections 2023-11-17T06:34:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.562+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/2206939002 wait complete. 2023-11-17T06:34:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.566+0000 7ff6fd4d4700 1 Processor -- start 2023-11-17T06:34:07.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.566+0000 7ff6fd4d4700 1 -- start start 2023-11-17T06:34:07.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6f806bc20 0x7ff6f8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c47a0 con 0x7ff6f815ca60 2023-11-17T06:34:07.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81452d0 con 0x7ff6f806bc20 2023-11-17T06:34:07.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c3840 con 0x7ff6f80cb9e0 2023-11-17T06:34:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38838/0 (socket says 172.21.15.100:38838) 2023-11-17T06:34:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 -- 172.21.15.100:0/819818696 learned_addr learned my addr 172.21.15.100:0/819818696 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:34:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6ee7fc700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f6ffd700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6f806bc20 0x7ff6f8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 -- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 msgr2=0x7ff6f8144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f8144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 -- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6f806bc20 msgr2=0x7ff6f8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6f806bc20 0x7ff6f8154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 -- 172.21.15.100:0/819818696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009b30 con 0x7ff6f815ca60 2023-11-17T06:34:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6f77fe700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0012000 tx=0x7ff6f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0004800 con 0x7ff6f815ca60 2023-11-17T06:34:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00092e0 con 0x7ff6f815ca60 2023-11-17T06:34:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f001c660 con 0x7ff6f815ca60 2023-11-17T06:34:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f80c3b20 con 0x7ff6f815ca60 2023-11-17T06:34:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.570+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80c40e0 con 0x7ff6f815ca60 2023-11-17T06:34:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.574+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f80c48e0 con 0x7ff6f815ca60 2023-11-17T06:34:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.574+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6f001c7c0 con 0x7ff6f815ca60 2023-11-17T06:34:07.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.574+0000 7ff6effff700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 0x7ff6dc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.578+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff6f00854f0 con 0x7ff6f815ca60 2023-11-17T06:34:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.578+0000 7ff6f6ffd700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 0x7ff6dc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.578+0000 7ff6f6ffd700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 0x7ff6dc0689d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8007a60 tx=0x7ff6e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:07.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.582+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6f80c48e0 con 0x7ff6f815ca60 2023-11-17T06:34:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.750+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 --> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6f806c430 con 0x7ff6dc066510 2023-11-17T06:34:07.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.754+0000 7ff6effff700 1 -- 172.21.15.100:0/819818696 <== mgr.4110 v2:172.21.15.100:6832/2885095167 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48152 (secure 0 0 0) 0x7ff6e8010740 con 0x7ff6dc066510 2023-11-17T06:34:07.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:34:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 msgr2=0x7ff6dc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 0x7ff6dc0689d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8007a60 tx=0x7ff6e8008040 comp rx=0 tx=0).stop 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 msgr2=0x7ff6f80c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0012000 tx=0x7ff6f0004af0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 shutdown_connections 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7ff6dc066510 0x7ff6dc0689d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f815ca60 0x7ff6f80c4bc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6f80cb9e0 0x7ff6f8144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 --2- 172.21.15.100:0/819818696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6f806bc20 0x7ff6f8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 >> 172.21.15.100:0/819818696 conn(0x7ff6f806a480 msgr2=0x7ff6f806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:07.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 shutdown_connections 2023-11-17T06:34:07.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.758+0000 7ff6fd4d4700 1 -- 172.21.15.100:0/819818696 wait complete. 2023-11-17T06:34:07.766 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-11-17T06:34:07.788 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-11-17T06:34:07.356928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233464,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741256,"statfs":{"total":773094113280,"available":772855046144,"internally_reserved":0,"allocated":4923392,"data_stored":2677224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003286"},"pg_stats":[{"pgid":"1.0","version":"40'119","reported_seq":194,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-17T06:33:51.833248+0000","last_change":"2023-11-17T06:33:51.833410+0000","last_active":"2023-11-17T06:33:51.833248+0000","last_peered":"2023-11-17T06:33:51.833248+0000","last_clean":"2023-11-17T06:33:51.833248+0000","last_became_active":"2023-11-17T06:28:45.965933+0000","last_became_peered":"2023-11-17T06:28:45.965933+0000","last_unstale":"2023-11-17T06:33:51.833248+0000","last_undegraded":"2023-11-17T06:33:51.833248+0000","last_fullsized":"2023-11-17T06:33:51.833248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'119","last_scrub_stamp":"2023-11-17T06:33:51.833077+0000","last_deep_scrub":"40'119","last_deep_scrub_stamp":"2023-11-17T06:33:51.833077+0000","last_clean_scrub_stamp":"2023-11-17T06:33:51.833077+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:34:51.236141+0000","scrub_duration":0.012411451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1519999999999999,"15min":1.3220000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.381,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.139,"5min":1.165,"15min":1.353},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.577,"5min":4.9610000000000003,"15min":4.9610000000000003},"last":1.4339999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.226,"15min":1.4119999999999999},"min":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.585,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":1.087},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.232,"15min":1.5169999999999999},"min":{"1min":0.70699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.431,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":1.008}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.234,"15min":1.3640000000000001},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4339999999999999,"5min":1.919,"15min":1.919},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.145,"15min":1.2130000000000001},"min":{"1min":0.81100000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4550000000000001,"5min":1.835,"15min":1.835},"last":1.155}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.3069999999999999,"15min":1.5129999999999999},"min":{"1min":0.82299999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6100000000000001,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.3839999999999999,"15min":1.5940000000000001},"min":{"1min":0.77800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.6559999999999999,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":1.335}]},{"osd":4,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1259999999999999,"15min":1.242},"min":{"1min":0.70199999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.534,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.3879999999999999},"min":{"1min":0.64600000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.698,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.298}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3,"15min":1.468},"min":{"1min":0.76500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.488,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.534},{"interface":"front","average":{"1min":1.226,"5min":1.296,"15min":1.3999999999999999},"min":{"1min":0.89500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5409999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.486}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.371,"15min":1.5149999999999999},"min":{"1min":1.02,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6140000000000001,"5min":2.375,"15min":2.375},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3759999999999999,"15min":1.4850000000000001},"min":{"1min":0.79000000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.8,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.5169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.123,"15min":1.117},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.448,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1639999999999999},"min":{"1min":0.66400000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.466,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.0089999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.159,"15min":1.171},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.288},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2190000000000001,"15min":1.2789999999999999},"min":{"1min":0.73099999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4810000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1539999999999999,"15min":1.2070000000000001},"min":{"1min":0.872,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.403,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.145},{"interface":"front","average":{"1min":1.232,"5min":1.2509999999999999,"15min":1.3140000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.643,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.373}]},{"osd":3,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2589999999999999,"15min":1.3440000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.494,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2150000000000001,"15min":1.3089999999999999},"min":{"1min":0.77800000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.581,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.333}]},{"osd":4,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.208,"15min":1.3169999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.849,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.458},{"interface":"front","average":{"1min":1.226,"5min":1.288,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.641,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.514}]},{"osd":5,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.202,"15min":1.2649999999999999},"min":{"1min":0.79800000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4750000000000001,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3660000000000001,"15min":1.454},"min":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.1400000000000001,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.552}]},{"osd":7,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4330000000000001,"15min":1.5189999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.72,"5min":2.548,"15min":2.548},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":0.94699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.792,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.581}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1659999999999999,"15min":1.306},"min":{"1min":0.81499999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.534,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1870000000000001,"15min":1.2310000000000001},"min":{"1min":0.90800000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5129999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.234,"15min":1.3160000000000001},"min":{"1min":0.75700000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6299999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.2609999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.2729999999999999},"min":{"1min":0.89900000000000002,"5min":0.877,"15min":0.877},"max":{"1min":1.712,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.244,"15min":1.3680000000000001},"min":{"1min":0.75800000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.643,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.123}]},{"osd":3,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3120000000000001,"15min":1.4259999999999999},"min":{"1min":0.876,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.542,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.3420000000000001,"15min":1.492},"min":{"1min":1.006,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.6080000000000001,"5min":3.48,"15min":3.48},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3080000000000001,"15min":1.3600000000000001},"min":{"1min":0.995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.6970000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.5},"min":{"1min":0.97699999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5660000000000001,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3320000000000001,"15min":1.448},"min":{"1min":0.94599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.869,"5min":3.2370000000000001,"15min":3.2370000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.423,"15min":1.54},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.746,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.194}]},{"osd":7,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4810000000000001,"15min":1.601},"min":{"1min":0.97999999999999998,"5min":0.748,"15min":0.748},"max":{"1min":1.7470000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.528,"15min":1.6359999999999999},"min":{"1min":1.236,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.7909999999999999,"5min":3.355,"15min":3.355},"last":1.4319999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6699999999999999,"5min":2.286,"15min":2.286},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.135,"15min":1.1990000000000001},"min":{"1min":0.73299999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3300000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.3149999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.778,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.472},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1859999999999999,"15min":1.1599999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.016,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.0069999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.282,"15min":1.5820000000000001},"min":{"1min":0.85199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7030000000000001,"5min":9.4499999999999993,"15min":9.4499999999999993},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.296,"15min":1.5129999999999999},"min":{"1min":0.92800000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.5109999999999999,"5min":9.2910000000000004,"15min":9.2910000000000004},"last":1.091}]},{"osd":3,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.22,"15min":1.2170000000000001},"min":{"1min":0.88300000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7270000000000001,"5min":2.399,"15min":2.399},"last":1.214},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2969999999999999,"15min":1.3120000000000001},"min":{"1min":0.93600000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.921,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.653}]},{"osd":5,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.234,"15min":1.1819999999999999},"min":{"1min":0.76600000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.474,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.228,"15min":1.264},"min":{"1min":0.82199999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.605,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.359},"min":{"1min":0.80200000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.76,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.381,"15min":1.4590000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.804,"5min":2.681,"15min":2.681},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:33:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.29,"15min":1.341},"min":{"1min":0.86699999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.591,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.409,"15min":1.4630000000000001},"min":{"1min":0.96099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.917,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.756}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82499999999999996,"15min":0.90100000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.026,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":1.0620000000000001},"min":{"1min":0.55500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.3480000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97599999999999998,"15min":1.0429999999999999},"min":{"1min":0.57299999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.2070000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.751},{"interface":"front","average":{"1min":1.046,"5min":1.0980000000000001,"15min":1.1539999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4339999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.153}]},{"osd":2,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.61199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3939999999999999,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.0900000000000001,"15min":1.2030000000000001},"min":{"1min":0.61399999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3819999999999999,"5min":1.907,"15min":1.907},"last":0.85799999999999998}]},{"osd":4,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.258,"15min":1.403},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.3180000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.329},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3,"15min":1.411},"min":{"1min":1.042,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.5129999999999999,"5min":2.359,"15min":2.359},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3029999999999999,"15min":1.4079999999999999},"min":{"1min":0.94799999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.4730000000000001,"5min":2.375,"15min":2.375},"last":1.252},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3069999999999999,"15min":1.4630000000000001},"min":{"1min":0.97199999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5720000000000001,"5min":2.202,"15min":2.202},"last":1.2350000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.363,"15min":1.4750000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.581,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":1.5129999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.522,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.351}]},{"osd":7,"last update":"Fri Nov 17 06:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.377,"15min":1.556},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.669,"5min":2.431,"15min":2.431},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.4259999999999999,"15min":1.5720000000000001},"min":{"1min":1.0349999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.6519999999999999,"5min":2.427,"15min":2.427},"last":1.391}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0660000000000001,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.88200000000000001,"15min":0.90800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1819999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.26,"5min":1.698,"15min":1.698},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98799999999999999,"15min":1.0649999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0669999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0600000000000001,"15min":1.0900000000000001},"min":{"1min":0.63100000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3300000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0920000000000001,"15min":1.179},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.45,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.236}]},{"osd":4,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.266,"15min":1.343},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.48,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.325},{"interface":"front","average":{"1min":1.135,"5min":1.1839999999999999,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.552,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.26}]},{"osd":5,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2569999999999999,"15min":1.383},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4390000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.341,"15min":1.4330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.536,"5min":1.948,"15min":1.948},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.306,"15min":1.4119999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7370000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.157},{"interface":"front","average":{"1min":1.246,"5min":1.363,"15min":1.4850000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7010000000000001,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.2}]},{"osd":7,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3680000000000001,"15min":1.46},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.974,"5min":2.194,"15min":2.194},"last":1.024},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.458,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.782,"5min":2.464,"15min":2.464},"last":1.2949999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":187061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.97399999999999998,"15min":0.998},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.482,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0249999999999999,"15min":1.008},"min":{"1min":0.69599999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.266,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.002}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.97199999999999998,"15min":1.038},"min":{"1min":0.54800000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.512,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.069,"15min":1.1040000000000001},"min":{"1min":0.81999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":2.262,"15min":2.262},"last":1.2769999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2090000000000001,"15min":1.2929999999999999},"min":{"1min":0.83699999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.472,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.1160000000000001,"15min":1.2889999999999999},"min":{"1min":0.625,"5min":0.505,"15min":0.505},"max":{"1min":1.274,"5min":3.7370000000000001,"15min":3.7370000000000001},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3089999999999999,"15min":1.389},"min":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.7989999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.3029999999999999,"15min":1.4159999999999999},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.839,"5min":3.891,"15min":3.891},"last":1.321}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3340000000000001,"15min":1.4119999999999999},"min":{"1min":0.93799999999999994,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.629,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.484},{"interface":"front","average":{"1min":1.321,"5min":1.389,"15min":1.5349999999999999},"min":{"1min":1.1040000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6240000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":1.395}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.407,"15min":1.5189999999999999},"min":{"1min":1.0089999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.597,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.456},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.456,"15min":1.5720000000000001},"min":{"1min":0.91000000000000003,"5min":0.88,"15min":0.88},"max":{"1min":1.9199999999999999,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":1.4179999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.48,"15min":1.6479999999999999},"min":{"1min":1.1739999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6799999999999999,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.512},{"interface":"front","average":{"1min":1.375,"5min":1.4790000000000001,"15min":1.597},"min":{"1min":0.97399999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.621,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.3600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1060864,"data_stored":777429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2749999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.119,"15min":1.1020000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6140000000000001,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.0369999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3680000000000001,"5min":1.905,"15min":1.905},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.524,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1240000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5840000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.2410000000000001,"15min":1.321},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5449999999999999,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1479999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2869999999999999,"15min":1.2529999999999999},"min":{"1min":0.874,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.522,"5min":2.504,"15min":2.504},"last":1.337},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2849999999999999,"15min":1.353},"min":{"1min":0.88300000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5129999999999999,"5min":3.3359999999999999,"15min":3.3359999999999999},"last":1.081}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.345,"15min":1.411},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.502,"5min":3.121,"15min":3.121},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.333,"15min":1.361},"min":{"1min":0.92700000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.522,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.254}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.383,"15min":1.472},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.603,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.3879999999999999,"15min":1.4370000000000001},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.895,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1990000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4390000000000001,"15min":1.5129999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.972,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.401},{"interface":"front","average":{"1min":1.298,"5min":1.4259999999999999,"15min":1.49},"min":{"1min":1.0509999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.633,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.2270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:34:07.791 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-17T06:34:07.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 Processor -- start 2023-11-17T06:34:07.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 -- start start 2023-11-17T06:34:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc0140adab0 0x7fc0140ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 0x7fc0140c2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01406bf40 con 0x7fc0140c2560 2023-11-17T06:34:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140c29f0 con 0x7fc0140adab0 2023-11-17T06:34:07.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc01ae63700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01406c220 con 0x7fc014165f00 2023-11-17T06:34:07.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc018bff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc0140adab0 0x7fc0140ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc018bff700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc0140adab0 0x7fc0140ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38840/0 (socket says 172.21.15.100:38840) 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.982+0000 7fc018bff700 1 -- 172.21.15.100:0/938683957 learned_addr learned my addr 172.21.15.100:0/938683957 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc00bfff700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 0x7fc0140c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc018bff700 1 -- 172.21.15.100:0/938683957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 msgr2=0x7fc0140c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc018bff700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 0x7fc0140c2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc018bff700 1 -- 172.21.15.100:0/938683957 >> v1:172.21.15.119:6789/0 conn(0x7fc0140c2560 legacy=0x7fc0140ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc018bff700 1 -- 172.21.15.100:0/938683957 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01406c500 con 0x7fc0140adab0 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc00bfff700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 0x7fc0140c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc018bff700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0140adab0 0x7fc0140ae530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc010009910 tx=0x7fc010009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3360a77a4fa4d0e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc00b7fe700 1 -- 172.21.15.100:0/938683957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000ba60 con 0x7fc0140adab0 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc00b7fe700 1 -- 172.21.15.100:0/938683957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01000bbc0 con 0x7fc0140adab0 2023-11-17T06:34:07.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc00b7fe700 1 -- 172.21.15.100:0/938683957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010009e60 con 0x7fc0140adab0 2023-11-17T06:34:07.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 -- 172.21.15.100:0/938683957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0140adab0 msgr2=0x7fc0140ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:07.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0140adab0 0x7fc0140ae530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc010009910 tx=0x7fc010009c20 comp rx=0 tx=0).stop 2023-11-17T06:34:07.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 -- 172.21.15.100:0/938683957 shutdown_connections 2023-11-17T06:34:07.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc014165f00 0x7fc0140c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 --2- 172.21.15.100:0/938683957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0140adab0 0x7fc0140ae530 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:07.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 -- 172.21.15.100:0/938683957 >> 172.21.15.100:0/938683957 conn(0x7fc0140cf050 msgr2=0x7fc0140cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:07.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 -- 172.21.15.100:0/938683957 shutdown_connections 2023-11-17T06:34:07.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.986+0000 7fc01ae63700 1 -- 172.21.15.100:0/938683957 wait complete. 2023-11-17T06:34:07.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 Processor -- start 2023-11-17T06:34:07.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 -- start start 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0140adab0 0x7fc014151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 0x7fc014099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140b0a80 con 0x7fc014165f00 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140af7c0 con 0x7fc0140c2560 2023-11-17T06:34:07.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc01ae63700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140b0430 con 0x7fc0140adab0 2023-11-17T06:34:07.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc019400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc019400700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38844/0 (socket says 172.21.15.100:38844) 2023-11-17T06:34:07.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc019400700 1 -- 172.21.15.100:0/2603266646 learned_addr learned my addr 172.21.15.100:0/2603266646 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:34:07.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc018bff700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0140adab0 0x7fc014151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:07.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.990+0000 7fc00bfff700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 0x7fc014099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 -- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0140adab0 msgr2=0x7fc014151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0140adab0 0x7fc014151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 -- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 msgr2=0x7fc014099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 0x7fc014099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 -- 172.21.15.100:0/2603266646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009570 con 0x7fc014165f00 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc00bfff700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 0x7fc014099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:08.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc019400700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00cc50 tx=0x7fc00c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c003c20 con 0x7fc014165f00 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c003d80 con 0x7fc014165f00 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00ab60 con 0x7fc014165f00 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140b0710 con 0x7fc014165f00 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc014099f90 con 0x7fc014165f00 2023-11-17T06:34:08.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0140b0bf0 con 0x7fc014165f00 2023-11-17T06:34:08.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.994+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc00c00acc0 con 0x7fc014165f00 2023-11-17T06:34:08.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.998+0000 7fc0097fa700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 0x7fc0000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.998+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc00c083c80 con 0x7fc014165f00 2023-11-17T06:34:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.998+0000 7fc018bff700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 0x7fc0000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.003 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:07.998+0000 7fc018bff700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 0x7fc0000689d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc010014040 tx=0x7fc010008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:08.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.002+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc00c051400 con 0x7fc014165f00 2023-11-17T06:34:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.182+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc01404eea0 con 0x7fc014165f00 2023-11-17T06:34:08.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.190+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc00c054a20 con 0x7fc014165f00 2023-11-17T06:34:08.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.190+0000 7fc0097fa700 1 -- 172.21.15.100:0/2603266646 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc00c051400 con 0x7fc014165f00 2023-11-17T06:34:08.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 msgr2=0x7fc0000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.199 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 0x7fc0000689d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc010014040 tx=0x7fc010008030 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 msgr2=0x7fc014070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00cc50 tx=0x7fc00c00cf60 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 shutdown_connections 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7fc000066510 0x7fc0000689d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc014165f00 0x7fc014070b90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0140c2560 0x7fc014099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 --2- 172.21.15.100:0/2603266646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0140adab0 0x7fc014151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.200 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 >> 172.21.15.100:0/2603266646 conn(0x7fc0140cf050 msgr2=0x7fc0140ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:08.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 shutdown_connections 2023-11-17T06:34:08.201 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.194+0000 7fc01ae63700 1 -- 172.21.15.100:0/2603266646 wait complete. 2023-11-17T06:34:08.221 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:34:08.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:34:08.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.394+0000 7f0cd5b9c700 1 Processor -- start 2023-11-17T06:34:08.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.394+0000 7f0cd5b9c700 1 -- start start 2023-11-17T06:34:08.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd5b9c700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0cd00cb9e0 0x7f0cd00cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd5b9c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0cd006bc20 0x7f0cd006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd5b9c700 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00cb620 con 0x7f0cd015ca60 2023-11-17T06:34:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd5b9c700 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd0155e10 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd5b9c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd00cc300 con 0x7f0cd006bc20 2023-11-17T06:34:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0cd00cb9e0 0x7f0cd00cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd539b700 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0cd015ca60 0x7f0cd015bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34190/0 (socket says 172.21.15.100:34190) 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd539b700 1 -- 172.21.15.100:0/1516898959 learned_addr learned my addr 172.21.15.100:0/1516898959 (peer_addr_for_me v1:172.21.15.100:0/0) 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cc7fff700 1 --2- 172.21.15.100:0/1516898959 >> v2:172.21.15.119:3300/0 conn(0x7f0cd006bc20 0x7f0cd006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 -- 172.21.15.100:0/1516898959 >> v2:172.21.15.119:3300/0 conn(0x7f0cd006bc20 msgr2=0x7f0cd006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 --2- 172.21.15.100:0/1516898959 >> v2:172.21.15.119:3300/0 conn(0x7f0cd006bc20 0x7f0cd006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 -- 172.21.15.100:0/1516898959 >> v1:172.21.15.100:6789/0 conn(0x7f0cd015ca60 legacy=0x7f0cd015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cc77fe700 1 -- 172.21.15.100:0/1516898959 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158792768 0 0) 0x7f0cd00cb620 con 0x7f0cd015ca60 2023-11-17T06:34:08.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 -- 172.21.15.100:0/1516898959 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd006c150 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cd4b9a700 1 --2- 172.21.15.100:0/1516898959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd00cbdc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00cc610 tx=0x7f0ccc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee65d0ef03853ee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:08.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cc77fe700 1 -- 172.21.15.100:0/1516898959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011830 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cc77fe700 1 -- 172.21.15.100:0/1516898959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0ccc011990 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.398+0000 7f0cc77fe700 1 -- 172.21.15.100:0/1516898959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011d40 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1516898959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 msgr2=0x7f0cd00cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1516898959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd00cbdc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00cc610 tx=0x7f0ccc009b30 comp rx=0 tx=0).stop 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1516898959 shutdown_connections 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1516898959 >> v2:172.21.15.119:3300/0 conn(0x7f0cd006bc20 0x7f0cd006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1516898959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd00cbdc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1516898959 >> 172.21.15.100:0/1516898959 conn(0x7f0cd006a480 msgr2=0x7f0cd006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:08.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1516898959 shutdown_connections 2023-11-17T06:34:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1516898959 wait complete. 2023-11-17T06:34:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 Processor -- start 2023-11-17T06:34:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.402+0000 7f0cd5b9c700 1 -- start start 2023-11-17T06:34:08.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd006bc20 0x7f0cd01ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 0x7f0cd015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.412 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01f8640 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01fbbe0 con 0x7f0cd006bc20 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01f7880 con 0x7f0cd015ca60 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38864/0 (socket says 172.21.15.100:38864) 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 -- 172.21.15.100:0/1877929115 learned_addr learned my addr 172.21.15.100:0/1877929115 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-11-17T06:34:08.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd4b9a700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd006bc20 0x7f0cd01ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd539b700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 0x7f0cd015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 -- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 msgr2=0x7f0cd015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 0x7f0cd015dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 -- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd006bc20 msgr2=0x7f0cd01ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd006bc20 0x7f0cd01ee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 -- 172.21.15.100:0/1877929115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0094b0 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd539b700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 0x7f0cd015dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:34:08.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc7fff700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e9a0 tx=0x7f0cc000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:08.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0009720 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cc000c850 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd01f7b60 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000cc00 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.406+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd01f8120 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd0067990 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0cc0013470 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cc57fa700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 0x7f0cbc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:08.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0cc0083e80 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cd4b9a700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 0x7f0cbc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:08.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.410+0000 7f0cd4b9a700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 0x7f0cbc0689d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0090b0 tx=0x7f0ccc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:08.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.418+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cc0051420 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.630+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cd00c5700 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.630+0000 7f0cc57fa700 1 -- 172.21.15.100:0/1877929115 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f0cc0021090 con 0x7f0cd00cb9e0 2023-11-17T06:34:08.639 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-11-17T06:34:08.640 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6834/1580608242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1580608242},{"type":"v1","addr":"172.21.15.119:6834","nonce":1580608242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3818355516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6833","nonce":3818355516},{"type":"v1","addr":"172.21.15.119:6835","nonce":3818355516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2836123236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2836123236},{"type":"v1","addr":"172.21.15.100:6836","nonce":2836123236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1839378474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1839378474},{"type":"v1","addr":"172.21.15.100:6837","nonce":1839378474}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2023-11-17T06:34:08.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 msgr2=0x7f0cbc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 0x7f0cbc0689d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0090b0 tx=0x7f0ccc008030 comp rx=0 tx=0).stop 2023-11-17T06:34:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 msgr2=0x7f0cd015d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e9a0 tx=0x7f0cc000ed60 comp rx=0 tx=0).stop 2023-11-17T06:34:08.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 shutdown_connections 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd015ca60 0x7f0cd015dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:6832/2885095167,v1:172.21.15.100:6833/2885095167] conn(0x7f0cbc066510 0x7f0cbc0689d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd00cb9e0 0x7f0cd015d680 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 --2- 172.21.15.100:0/1877929115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd006bc20 0x7f0cd01ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 >> 172.21.15.100:0/1877929115 conn(0x7f0cd006a480 msgr2=0x7f0cd006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 shutdown_connections 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:2023-11-17T06:34:08.634+0000 7f0cd5b9c700 1 -- 172.21.15.100:0/1877929115 wait complete. 2023-11-17T06:34:08.648 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 32 2023-11-17T06:34:08.661 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-17T06:34:08.662 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-17T06:34:08.662 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-17T06:34:08.662 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:08.681 INFO:tasks.ceph.mds.a:Stopped 2023-11-17T06:34:08.682 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-17T06:34:08.682 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:08.753 INFO:tasks.ceph.mds.c:Stopped 2023-11-17T06:34:08.753 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-17T06:34:08.753 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:08.775 INFO:tasks.ceph.mds.b:Stopped 2023-11-17T06:34:08.776 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-17T06:34:08.776 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:08.838 INFO:tasks.ceph.mds.d:Stopped 2023-11-17T06:34:08.839 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-17T06:34:08.839 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-17T06:34:08.839 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:12.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-17T06:34:14.941 INFO:tasks.ceph.osd.0:Stopped 2023-11-17T06:34:14.941 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-17T06:34:14.941 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:15.037 INFO:tasks.ceph.osd.1:Stopped 2023-11-17T06:34:15.037 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-17T06:34:15.037 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:18.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-17T06:34:18.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-17T06:34:21.139 INFO:tasks.ceph.osd.2:Stopped 2023-11-17T06:34:21.140 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-17T06:34:21.140 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:21.221 INFO:tasks.ceph.osd.3:Stopped 2023-11-17T06:34:21.222 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-17T06:34:21.222 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:21.301 INFO:tasks.ceph.osd.4:Stopped 2023-11-17T06:34:21.302 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-17T06:34:21.302 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:21.393 INFO:tasks.ceph.osd.5:Stopped 2023-11-17T06:34:21.393 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-17T06:34:21.393 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:21.484 INFO:tasks.ceph.osd.6:Stopped 2023-11-17T06:34:21.484 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-17T06:34:21.484 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:23.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-17T06:34:23.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-17T06:34:27.586 INFO:tasks.ceph.osd.7:Stopped 2023-11-17T06:34:27.586 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-17T06:34:27.587 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-17T06:34:27.587 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.658 INFO:tasks.ceph.mgr.y:Stopped 2023-11-17T06:34:27.658 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-17T06:34:27.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.715 INFO:tasks.ceph.mgr.x:Stopped 2023-11-17T06:34:27.715 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-17T06:34:27.716 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-17T06:34:27.716 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.755 INFO:tasks.ceph.mon.a:Stopped 2023-11-17T06:34:27.755 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-17T06:34:27.755 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.781 INFO:tasks.ceph.mon.b:Stopped 2023-11-17T06:34:27.782 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-17T06:34:27.782 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.865 INFO:tasks.ceph.mon.c:Stopped 2023-11-17T06:34:27.865 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-17T06:34:27.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2023-11-17T06:34:27.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:34:27.919 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-17T06:34:28.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:34:28.201 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-17T06:34:28.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:34:28.451 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-17T06:34:28.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:34:28.704 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-17T06:34:28.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-17T06:34:28.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:34:28.944 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-17T06:34:29.271 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:34:29.272 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-17T06:34:29.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:34:29.500 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-17T06:34:29.732 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:34:29.732 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-17T06:34:29.921 INFO:tasks.ceph:Archiving mon data... 2023-11-17T06:34:29.922 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/data/mon.a.tgz 2023-11-17T06:34:29.923 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-11-17T06:34:29.945 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.WvYG0fX5uy 2023-11-17T06:34:29.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WvYG0fX5uy 2023-11-17T06:34:30.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.WvYG0fX5uy 2023-11-17T06:34:30.206 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.WvYG0fX5uy is 351KB 2023-11-17T06:34:30.284 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.WvYG0fX5uy 2023-11-17T06:34:30.304 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/data/mon.b.tgz 2023-11-17T06:34:30.304 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-11-17T06:34:30.326 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.bF1JBYpVph 2023-11-17T06:34:30.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bF1JBYpVph 2023-11-17T06:34:30.518 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.bF1JBYpVph 2023-11-17T06:34:30.621 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.bF1JBYpVph is 462KB 2023-11-17T06:34:30.699 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.bF1JBYpVph 2023-11-17T06:34:30.719 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/data/mon.c.tgz 2023-11-17T06:34:30.719 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-11-17T06:34:30.777 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.NuQ8PpbBbW 2023-11-17T06:34:30.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NuQ8PpbBbW 2023-11-17T06:34:30.974 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.NuQ8PpbBbW 2023-11-17T06:34:31.073 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.NuQ8PpbBbW is 462KB 2023-11-17T06:34:31.154 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.NuQ8PpbBbW 2023-11-17T06:34:31.175 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-17T06:34:31.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-17T06:34:31.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-17T06:34:31.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.249 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-17T06:34:31.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-17T06:34:31.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-17T06:34:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-17T06:34:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-17T06:34:31.396 INFO:tasks.ceph:Archiving crash dumps... 2023-11-17T06:34:31.399 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi100/crash 2023-11-17T06:34:31.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-17T06:34:31.461 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi119/crash 2023-11-17T06:34:31.462 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-17T06:34:31.499 INFO:tasks.ceph:Shutting down logrotate 2023-11-17T06:34:31.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.652 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:31.685 INFO:tasks.ceph:Compressing logs... 2023-11-17T06:34:31.685 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-17T06:34:31.703 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-17T06:34:31.758 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48213.log 2023-11-17T06:34:31.760 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2023-11-17T06:34:31.762 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2023-11-17T06:34:31.764 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48213.log.gz 2023-11-17T06:34:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2023-11-17T06:34:31.765 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2023-11-17T06:34:31.765 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2023-11-17T06:34:31.767 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48186.log: /var/log/ceph/ceph-client.admin.45910.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2023-11-17T06:34:31.767 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2023-11-17T06:34:31.767 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2023-11-17T06:34:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45640.log 2023-11-17T06:34:31.769 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2023-11-17T06:34:31.770 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46252.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gzgzip 2023-11-17T06:34:31.770 INFO:teuthology.orchestra.run.smithi100.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48068.log 2023-11-17T06:34:31.771 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45640.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45640.log.gz 2023-11-17T06:34:31.772 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2023-11-17T06:34:31.773 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2023-11-17T06:34:31.774 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48068.log.gz 2023-11-17T06:34:31.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-17T06:34:31.775 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46099.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2023-11-17T06:34:31.775 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-17T06:34:31.776 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36611.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2023-11-17T06:34:31.776 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2023-11-17T06:34:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-17T06:34:31.777 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2023-11-17T06:34:31.779 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2023-11-17T06:34:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47474.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2023-11-17T06:34:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49480.log 2023-11-17T06:34:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-11-17T06:34:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2023-11-17T06:34:31.781 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-17T06:34:31.782 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36630.log 2023-11-17T06:34:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48550.log 2023-11-17T06:34:31.782 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49480.log.gz 2023-11-17T06:34:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44896.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2023-11-17T06:34:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2023-11-17T06:34:31.784 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2023-11-17T06:34:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48550.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48550.log.gz 2023-11-17T06:34:31.785 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2023-11-17T06:34:31.785 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36630.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36630.log.gz 2023-11-17T06:34:31.786 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2023-11-17T06:34:31.786 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-17T06:34:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43032.log 2023-11-17T06:34:31.787 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2023-11-17T06:34:31.787 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2023-11-17T06:34:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44955.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2023-11-17T06:34:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2023-11-17T06:34:31.788 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36657.log 2023-11-17T06:34:31.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46361.log 2023-11-17T06:34:31.789 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-17T06:34:31.790 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43032.log.gz 2023-11-17T06:34:31.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43599.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2023-11-17T06:34:31.791 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36657.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36657.log.gz 2023-11-17T06:34:31.791 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-17T06:34:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2023-11-17T06:34:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2023-11-17T06:34:31.792 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46361.log.gz 2023-11-17T06:34:31.793 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-17T06:34:31.794 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43464.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2023-11-17T06:34:31.794 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45991.log 2023-11-17T06:34:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-17T06:34:31.796 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2023-11-17T06:34:31.796 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47944.log 2023-11-17T06:34:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2023-11-17T06:34:31.798 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45991.log.gz 2023-11-17T06:34:31.799 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47944.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47944.log.gz 2023-11-17T06:34:31.799 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44815.log 2023-11-17T06:34:31.799 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41894.log 2023-11-17T06:34:31.799 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.6.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-17T06:34:31.800 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-17T06:34:31.800 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2023-11-17T06:34:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45964.log 2023-11-17T06:34:31.800 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2023-11-17T06:34:31.801 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36469.log 2023-11-17T06:34:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44815.log.gz 2023-11-17T06:34:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2023-11-17T06:34:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45964.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-17T06:34:31.803 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2023-11-17T06:34:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43302.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2023-11-17T06:34:31.804 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.3.41894.log: /var/log/ceph/ceph-client.admin.36522.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2023-11-17T06:34:31.804 INFO:teuthology.orchestra.run.smithi119.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.3.41894.log.gz 2023-11-17T06:34:31.804 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-17T06:34:31.805 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36576.log 2023-11-17T06:34:31.805 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36469.log.gz 2023-11-17T06:34:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2023-11-17T06:34:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44375.log 2023-11-17T06:34:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47115.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2023-11-17T06:34:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42191.log 2023-11-17T06:34:31.808 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36576.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.36576.log.gz--verbose 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:-- /var/log/ceph/ceph-osd.4.log 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36494.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2023-11-17T06:34:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41784.log 2023-11-17T06:34:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44375.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44375.log.gz 2023-11-17T06:34:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2023-11-17T06:34:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2023-11-17T06:34:31.815 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42191.log.gz 2023-11-17T06:34:31.815 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43015.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2023-11-17T06:34:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2023-11-17T06:34:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42357.log 2023-11-17T06:34:31.816 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2023-11-17T06:34:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45200.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2023-11-17T06:34:31.816 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42492.log 2023-11-17T06:34:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-17T06:34:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.1.41784.log: 90.9% -- replaced with /var/log/ceph/ceph-client.1.41784.log.gz 2023-11-17T06:34:31.819 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2023-11-17T06:34:31.820 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42357.log.gz 2023-11-17T06:34:31.820 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42492.log.gz 2023-11-17T06:34:31.820 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2023-11-17T06:34:31.820 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41955.log 2023-11-17T06:34:31.820 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2023-11-17T06:34:31.821 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2023-11-17T06:34:31.821 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45063.log 2023-11-17T06:34:31.822 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2023-11-17T06:34:31.822 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41955.log.gz 2023-11-17T06:34:31.822 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45063.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45063.log.gz 2023-11-17T06:34:31.823 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2023-11-17T06:34:31.824 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2023-11-17T06:34:31.824 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2023-11-17T06:34:31.825 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47721.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2023-11-17T06:34:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-17T06:34:31.827 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2023-11-17T06:34:31.828 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2023-11-17T06:34:31.829 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2023-11-17T06:34:31.830 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2023-11-17T06:34:31.831 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2023-11-17T06:34:31.831 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41989.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2023-11-17T06:34:31.832 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2023-11-17T06:34:31.833 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2023-11-17T06:34:31.833 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2023-11-17T06:34:31.834 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2023-11-17T06:34:31.834 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2023-11-17T06:34:31.836 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43809.log 2023-11-17T06:34:31.836 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2023-11-17T06:34:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2023-11-17T06:34:31.837 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46937.log 2023-11-17T06:34:31.839 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.43809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2023-11-17T06:34:31.840 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.46937.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43809.log.gz 2023-11-17T06:34:31.840 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2023-11-17T06:34:31.841 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2023-11-17T06:34:31.842 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2023-11-17T06:34:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44928.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2023-11-17T06:34:31.843 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2023-11-17T06:34:31.844 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49345.log 2023-11-17T06:34:31.845 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz 2023-11-17T06:34:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44159.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2023-11-17T06:34:31.846 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2023-11-17T06:34:31.847 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2023-11-17T06:34:31.847 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49345.log.gz 2023-11-17T06:34:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43031.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2023-11-17T06:34:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2023-11-17T06:34:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49318.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2023-11-17T06:34:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2023-11-17T06:34:31.852 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48408.log 2023-11-17T06:34:31.852 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2023-11-17T06:34:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43518.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2023-11-17T06:34:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48827.log 2023-11-17T06:34:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2023-11-17T06:34:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48408.log: /var/log/ceph/ceph-client.admin.48827.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48408.log.gz 2023-11-17T06:34:31.856 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48827.log.gz 2023-11-17T06:34:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2023-11-17T06:34:31.858 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 /var/log/ceph/ceph-client.admin.47061.log: --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2023-11-17T06:34:31.858 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45254.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2023-11-17T06:34:31.859 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2023-11-17T06:34:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44679.log 2023-11-17T06:34:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43545.log 2023-11-17T06:34:31.861 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43275.log: /var/log/ceph/ceph-client.admin.44679.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2023-11-17T06:34:31.862 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44679.log.gz 2023-11-17T06:34:31.862 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2023-11-17T06:34:31.863 INFO:teuthology.orchestra.run.smithi100.stderr:gzip /var/log/ceph/ceph-client.admin.43545.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-17T06:34:31.863 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43545.log.gz 2023-11-17T06:34:31.864 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47361.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2023-11-17T06:34:31.864 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42303.log 2023-11-17T06:34:31.865 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45009.log 2023-11-17T06:34:31.867 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42303.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42303.log.gz 2023-11-17T06:34:31.867 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2023-11-17T06:34:31.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49264.log 2023-11-17T06:34:31.869 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45009.log.gz 2023-11-17T06:34:31.869 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44591.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2023-11-17T06:34:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47968.log 2023-11-17T06:34:31.870 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42411.log 2023-11-17T06:34:31.871 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49264.log.gz 2023-11-17T06:34:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44760.log 2023-11-17T06:34:31.874 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2023-11-17T06:34:31.874 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42411.log.gz 2023-11-17T06:34:31.874 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.47968.log.gz 2023-11-17T06:34:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2023-11-17T06:34:31.876 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44760.log.gz 2023-11-17T06:34:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2023-11-17T06:34:31.877 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48323.log 2023-11-17T06:34:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2023-11-17T06:34:31.878 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2023-11-17T06:34:31.880 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.48323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2023-11-17T06:34:31.880 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-17T06:34:31.881 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46334.log 2023-11-17T06:34:31.882 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2023-11-17T06:34:31.883 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42601.log 2023-11-17T06:34:31.883 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2023-11-17T06:34:31.884 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2023-11-17T06:34:31.884 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46334.log.gz 2023-11-17T06:34:31.886 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44842.log 2023-11-17T06:34:31.886 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42601.log.gz 2023-11-17T06:34:31.887 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2023-11-17T06:34:31.887 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2023-11-17T06:34:31.889 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44348.log 2023-11-17T06:34:31.889 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44842.log.gz 2023-11-17T06:34:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45336.log 2023-11-17T06:34:31.890 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2023-11-17T06:34:31.892 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2023-11-17T06:34:31.892 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44348.log.gz 2023-11-17T06:34:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2023-11-17T06:34:31.893 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45336.log.gz 2023-11-17T06:34:31.895 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48093.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2023-11-17T06:34:31.895 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47408.log 2023-11-17T06:34:31.895 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.46937.log.gz 2023-11-17T06:34:31.896 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45856.log 2023-11-17T06:34:31.896 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2023-11-17T06:34:31.897 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2023-11-17T06:34:31.898 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47408.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47408.log.gz 2023-11-17T06:34:31.898 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45856.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45856.log.gz 2023-11-17T06:34:31.899 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-17T06:34:31.900 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2023-11-17T06:34:31.900 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz 2023-11-17T06:34:31.901 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-11-17T06:34:31.902 INFO:teuthology.orchestra.run.smithi100.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.48323.log.gz 2023-11-17T06:34:31.902 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-17T06:34:31.902 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47618.log 2023-11-17T06:34:31.903 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42519.log 2023-11-17T06:34:31.903 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-11-17T06:34:31.904 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45308.log 2023-11-17T06:34:31.906 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42519.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42519.log.gz 2023-11-17T06:34:31.906 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2023-11-17T06:34:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45308.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45308.log.gz 2023-11-17T06:34:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2023-11-17T06:34:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2023-11-17T06:34:31.909 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-17T06:34:31.909 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2023-11-17T06:34:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48577.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz-5 2023-11-17T06:34:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:--verbose -- /var/log/ceph/ceph-client.admin.46307.log 2023-11-17T06:34:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47169.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2023-11-17T06:34:31.912 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2023-11-17T06:34:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46072.log 2023-11-17T06:34:31.913 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2023-11-17T06:34:31.914 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46307.log.gz 2023-11-17T06:34:31.914 INFO:teuthology.orchestra.run.smithi100.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.47618.log.gz 2023-11-17T06:34:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46072.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46072.log.gz 2023-11-17T06:34:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2023-11-17T06:34:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49534.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2023-11-17T06:34:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2023-11-17T06:34:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36359.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2023-11-17T06:34:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2023-11-17T06:34:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46280.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2023-11-17T06:34:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2023-11-17T06:34:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43946.log 2023-11-17T06:34:31.920 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2023-11-17T06:34:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45937.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2023-11-17T06:34:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2023-11-17T06:34:31.922 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.2.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2023-11-17T06:34:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46827.log: 91.9% -- replaced with /var/log/ceph/ceph-client.2.43946.log.gz 2023-11-17T06:34:31.924 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2023-11-17T06:34:31.924 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2023-11-17T06:34:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43988.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2023-11-17T06:34:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2023-11-17T06:34:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47197.log 2023-11-17T06:34:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46717.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2023-11-17T06:34:31.927 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47224.log 2023-11-17T06:34:31.928 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2023-11-17T06:34:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47197.log: /var/log/ceph/ceph-client.admin.47224.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47197.log.gz 2023-11-17T06:34:31.930 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% 94.1% -- replaced with /var/log/ceph/ceph-client.admin.47224.log.gz -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2023-11-17T06:34:31.930 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-11-17T06:34:31.930 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42276.log 2023-11-17T06:34:31.931 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2023-11-17T06:34:31.931 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2023-11-17T06:34:31.932 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-17T06:34:31.932 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2023-11-17T06:34:31.932 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42276.log.gz 2023-11-17T06:34:31.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45721.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2023-11-17T06:34:31.933 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2023-11-17T06:34:31.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42592.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz--verbose 2023-11-17T06:34:31.934 INFO:teuthology.orchestra.run.smithi100.stderr:-- /var/log/ceph/ceph-client.admin.49237.log 2023-11-17T06:34:31.935 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44483.log 2023-11-17T06:34:31.936 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2023-11-17T06:34:31.936 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49048.log 2023-11-17T06:34:31.936 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2023-11-17T06:34:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2023-11-17T06:34:31.938 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44483.log.gz 2023-11-17T06:34:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49048.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49048.log.gz 2023-11-17T06:34:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2023-11-17T06:34:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2023-11-17T06:34:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48604.log: /var/log/ceph/ceph-client.admin.46690.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2023-11-17T06:34:31.942 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2023-11-17T06:34:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2023-11-17T06:34:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2023-11-17T06:34:31.944 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2023-11-17T06:34:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2023-11-17T06:34:31.945 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2023-11-17T06:34:31.951 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2023-11-17T06:34:31.951 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49075.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49102.log 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2023-11-17T06:34:31.952 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2023-11-17T06:34:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49102.log.gz 2023-11-17T06:34:31.953 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2023-11-17T06:34:31.954 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49453.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-17T06:34:31.954 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2023-11-17T06:34:31.955 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2023-11-17T06:34:31.956 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2023-11-17T06:34:31.957 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36488.log 2023-11-17T06:34:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2023-11-17T06:34:31.959 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2023-11-17T06:34:31.960 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46663.log 2023-11-17T06:34:31.960 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36488.log.gz 2023-11-17T06:34:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42815.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2023-11-17T06:34:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2023-11-17T06:34:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49210.log 2023-11-17T06:34:31.963 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2023-11-17T06:34:31.964 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2023-11-17T06:34:31.964 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2023-11-17T06:34:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2023-11-17T06:34:31.966 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gz 2023-11-17T06:34:31.967 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43020.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2023-11-17T06:34:31.967 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31506.log 2023-11-17T06:34:31.968 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2023-11-17T06:34:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2023-11-17T06:34:31.970 INFO:teuthology.orchestra.run.smithi119.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-17T06:34:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.31506.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31506.log.gz 2023-11-17T06:34:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47251.log 2023-11-17T06:34:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48381.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2023-11-17T06:34:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2023-11-17T06:34:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47251.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47251.log.gz 2023-11-17T06:34:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2023-11-17T06:34:31.975 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43018.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2023-11-17T06:34:31.975 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42438.log 2023-11-17T06:34:31.976 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47803.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2023-11-17T06:34:31.976 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2023-11-17T06:34:31.977 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42438.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42438.log.gz 2023-11-17T06:34:31.978 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48795.log 2023-11-17T06:34:31.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2023-11-17T06:34:31.979 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2023-11-17T06:34:31.980 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48795.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48795.log.gz 2023-11-17T06:34:31.980 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2023-11-17T06:34:31.982 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45090.log 2023-11-17T06:34:31.982 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2023-11-17T06:34:31.982 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45883.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2023-11-17T06:34:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2023-11-17T06:34:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2023-11-17T06:34:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45090.log: /var/log/ceph/ceph-client.admin.43437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45090.log.gz 2023-11-17T06:34:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2023-11-17T06:34:31.987 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2023-11-17T06:34:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2023-11-17T06:34:31.989 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2023-11-17T06:34:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47142.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2023-11-17T06:34:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2023-11-17T06:34:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47694.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.45802.log -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2023-11-17T06:34:31.990 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-11-17T06:34:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44869.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz 2023-11-17T06:34:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2023-11-17T06:34:31.992 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 88.3% 2023-11-17T06:34:31.992 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45802.log.gz 2023-11-17T06:34:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44618.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2023-11-17T06:34:31.994 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2023-11-17T06:34:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2023-11-17T06:34:31.995 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2023-11-17T06:34:31.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42593.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2023-11-17T06:34:31.996 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48768.log 2023-11-17T06:34:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2023-11-17T06:34:31.997 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48130.log 2023-11-17T06:34:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48768.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48768.log.gz 2023-11-17T06:34:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2023-11-17T06:34:31.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48130.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48130.log.gz 2023-11-17T06:34:32.000 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2023-11-17T06:34:32.001 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2023-11-17T06:34:32.001 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2023-11-17T06:34:32.002 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2023-11-17T06:34:32.003 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2023-11-17T06:34:32.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49507.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2023-11-17T06:34:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2023-11-17T06:34:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47911.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2023-11-17T06:34:32.005 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2023-11-17T06:34:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48949.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2023-11-17T06:34:32.007 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2023-11-17T06:34:32.007 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44294.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2023-11-17T06:34:32.009 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2023-11-17T06:34:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43356.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2023-11-17T06:34:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2023-11-17T06:34:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47552.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2023-11-17T06:34:32.010 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2023-11-17T06:34:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42816.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2023-11-17T06:34:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2023-11-17T06:34:32.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46744.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2023-11-17T06:34:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43033.log 2023-11-17T06:34:32.014 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49183.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2023-11-17T06:34:32.015 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-17T06:34:32.019 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46798.log 2023-11-17T06:34:32.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43033.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43033.log.gz 2023-11-17T06:34:32.019 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2023-11-17T06:34:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46798.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46798.log.gz 2023-11-17T06:34:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44982.log 2023-11-17T06:34:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47033.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2023-11-17T06:34:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2023-11-17T06:34:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44982.log.gz 2023-11-17T06:34:32.021 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2023-11-17T06:34:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42799.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2023-11-17T06:34:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2023-11-17T06:34:32.026 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42583.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2023-11-17T06:34:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2023-11-17T06:34:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48264.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2023-11-17T06:34:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49021.log 2023-11-17T06:34:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2023-11-17T06:34:32.028 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2023-11-17T06:34:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49021.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49021.log.gz 2023-11-17T06:34:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2023-11-17T06:34:32.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2023-11-17T06:34:32.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2023-11-17T06:34:32.034 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2023-11-17T06:34:32.035 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44105.log 2023-11-17T06:34:32.035 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45586.log 2023-11-17T06:34:32.035 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2023-11-17T06:34:32.035 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44105.log.gz 2023-11-17T06:34:32.036 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2023-11-17T06:34:32.036 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2023-11-17T06:34:32.036 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2023-11-17T06:34:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45036.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2023-11-17T06:34:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2023-11-17T06:34:32.037 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46198.log 2023-11-17T06:34:32.037 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2023-11-17T06:34:32.039 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-17T06:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43248.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46198.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46198.log.gz 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43329.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48868.log 2023-11-17T06:34:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46498.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48868.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48868.log.gz 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42465.log 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45748.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49567.log 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42465.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42465.log.gz 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2023-11-17T06:34:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49567.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46388.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43572.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42220.log 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45363.log 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42220.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-17T06:34:32.050 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42220.log.gz 2023-11-17T06:34:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2023-11-17T06:34:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45363.log.gz 2023-11-17T06:34:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46636.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gzgzip 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.42137.log 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44186.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42137.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42137.log.gz 2023-11-17T06:34:32.053 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2023-11-17T06:34:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2023-11-17T06:34:32.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2023-11-17T06:34:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2023-11-17T06:34:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45117.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2023-11-17T06:34:32.056 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2023-11-17T06:34:32.057 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2023-11-17T06:34:32.058 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2023-11-17T06:34:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42807.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2023-11-17T06:34:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48895.log 2023-11-17T06:34:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46442.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2023-11-17T06:34:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48687.log 2023-11-17T06:34:32.062 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2023-11-17T06:34:32.062 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48895.log.gz 2023-11-17T06:34:32.063 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48687.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48687.log.gz 2023-11-17T06:34:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42055.log 2023-11-17T06:34:32.065 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2023-11-17T06:34:32.065 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2023-11-17T06:34:32.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42055.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42055.log.gz 2023-11-17T06:34:32.067 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2023-11-17T06:34:32.068 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2023-11-17T06:34:32.068 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2023-11-17T06:34:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42330.log 2023-11-17T06:34:32.070 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2023-11-17T06:34:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2023-11-17T06:34:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2023-11-17T06:34:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49291.log 2023-11-17T06:34:32.073 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42330.log.gz 2023-11-17T06:34:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44788.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2023-11-17T06:34:32.075 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2023-11-17T06:34:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49291.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49291.log.gz 2023-11-17T06:34:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2023-11-17T06:34:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2023-11-17T06:34:32.078 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2023-11-17T06:34:32.079 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44537.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2023-11-17T06:34:32.079 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2023-11-17T06:34:32.080 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2023-11-17T06:34:32.080 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2023-11-17T06:34:32.082 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2023-11-17T06:34:32.082 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2023-11-17T06:34:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46878.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2023-11-17T06:34:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2023-11-17T06:34:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2023-11-17T06:34:32.085 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2023-11-17T06:34:32.085 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-17T06:34:32.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45694.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2023-11-17T06:34:32.086 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2023-11-17T06:34:32.088 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47748.log 2023-11-17T06:34:32.089 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2023-11-17T06:34:32.089 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2023-11-17T06:34:32.089 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2023-11-17T06:34:32.090 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47748.log: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-17T06:34:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47748.log.gz 2023-11-17T06:34:32.091 INFO:teuthology.orchestra.run.smithi100.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.44051.log 2023-11-17T06:34:32.091 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-17T06:34:32.092 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47884.log 2023-11-17T06:34:32.092 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2023-11-17T06:34:32.093 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2023-11-17T06:34:32.094 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44051.log.gz 2023-11-17T06:34:32.094 INFO:teuthology.orchestra.run.smithi119.stderr: 2023-11-17T06:34:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.355s 2023-11-17T06:34:32.095 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m1.478s 2023-11-17T06:34:32.095 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.210s 2023-11-17T06:34:32.096 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47884.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47884.log.gz 2023-11-17T06:34:32.096 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2023-11-17T06:34:32.097 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43851.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2023-11-17T06:34:32.097 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46608.log 2023-11-17T06:34:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-17T06:34:32.098 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2023-11-17T06:34:32.099 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49372.log 2023-11-17T06:34:32.099 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46608.log.gz 2023-11-17T06:34:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-11-17T06:34:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49372.log.gz 2023-11-17T06:34:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2023-11-17T06:34:32.104 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2023-11-17T06:34:32.106 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47501.log: /var/log/ceph/ceph-client.admin.48633.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-11-17T06:34:32.106 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2023-11-17T06:34:32.106 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46045.log 2023-11-17T06:34:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2023-11-17T06:34:32.108 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2023-11-17T06:34:32.109 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2023-11-17T06:34:32.109 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46045.log.gz 2023-11-17T06:34:32.111 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2023-11-17T06:34:32.111 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2023-11-17T06:34:32.112 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2023-11-17T06:34:32.112 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2023-11-17T06:34:32.113 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2023-11-17T06:34:32.114 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2023-11-17T06:34:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47383.log: gzip -5 89.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz/var/log/ceph/ceph-client.admin.45417.log 2023-11-17T06:34:32.115 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-11-17T06:34:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48523.log 2023-11-17T06:34:32.117 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2023-11-17T06:34:32.118 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45417.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2023-11-17T06:34:32.118 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46018.log 2023-11-17T06:34:32.120 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44652.log 2023-11-17T06:34:32.121 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48523.log.gz 2023-11-17T06:34:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2023-11-17T06:34:32.122 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46018.log.gz 2023-11-17T06:34:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44652.log.gz 2023-11-17T06:34:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45613.log 2023-11-17T06:34:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2023-11-17T06:34:32.126 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2023-11-17T06:34:32.127 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48922.log 2023-11-17T06:34:32.127 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45613.log.gz 2023-11-17T06:34:32.129 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44510.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz 2023-11-17T06:34:32.129 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2023-11-17T06:34:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2023-11-17T06:34:32.130 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48922.log.gz 2023-11-17T06:34:32.131 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2023-11-17T06:34:32.132 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2023-11-17T06:34:32.133 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2023-11-17T06:34:32.133 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2023-11-17T06:34:32.134 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42249.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-17T06:34:32.134 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2023-11-17T06:34:32.135 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2023-11-17T06:34:32.135 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2023-11-17T06:34:32.136 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47857.log 2023-11-17T06:34:32.138 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45505.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2023-11-17T06:34:32.138 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2023-11-17T06:34:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47857.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47857.log.gz 2023-11-17T06:34:32.140 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43221.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2023-11-17T06:34:32.151 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-17T06:34:32.214 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-17T06:34:32.280 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-17T06:34:32.321 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-17T06:34:32.323 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-11-17T06:34:32.324 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.612s 2023-11-17T06:34:32.324 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.484s 2023-11-17T06:34:32.324 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.662s 2023-11-17T06:34:32.325 INFO:tasks.ceph:Archiving logs... 2023-11-17T06:34:32.326 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi100/log 2023-11-17T06:34:32.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-17T06:34:32.762 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi119/log 2023-11-17T06:34:32.763 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-17T06:34:32.967 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-17T06:34:32.991 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-17T06:34:32.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-17T06:34:32.998 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-17T06:34:33.082 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-17T06:34:33.150 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-17T06:34:33.150 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:34:33.158 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:34:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:34:33.196 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2023-11-17T06:34:33.196 INFO:teuthology.orchestra.run.smithi100.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 377 0.107 -0.585 0.698 2023-11-17T06:34:33.196 INFO:teuthology.orchestra.run.smithi100.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.083 -0.158 1.087 2023-11-17T06:34:33.196 INFO:teuthology.orchestra.run.smithi100.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.081 -0.533 1.137 2023-11-17T06:34:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-17T06:34:33.204 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:34:33.204 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-11-17T06:34:33.204 INFO:teuthology.orchestra.run.smithi119.stdout:*hv01.front.sepi 44.4.53.2 2 u 53 64 377 0.120 -1.249 0.365 2023-11-17T06:34:33.204 INFO:teuthology.orchestra.run.smithi119.stdout:+hv02.front.sepi 63.231.80.2 3 u 49 64 377 0.121 -0.321 0.973 2023-11-17T06:34:33.204 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 52 64 377 0.119 0.136 0.385 2023-11-17T06:34:33.205 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-17T06:34:33.206 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-17T06:34:33.215 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-17T06:34:33.216 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-17T06:34:33.225 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-17T06:34:33.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-17T06:34:33.246 INFO:teuthology.task.internal:Duration was 1336.532637 seconds 2023-11-17T06:34:33.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-17T06:34:33.256 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-17T06:34:33.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-17T06:34:33.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-17T06:34:33.407 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-17T06:34:33.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2023-11-17T06:34:33.408 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-17T06:34:33.444 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-11-17T06:34:33.444 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-17T06:34:33.483 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-17T06:34:33.483 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-17T06:34:33.495 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-17T06:34:33.587 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-17T06:34:33.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-17T06:34:33.597 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-17T06:34:33.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-17T06:34:33.716 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-17T06:34:33.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-17T06:34:33.750 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-17T06:34:33.798 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-17T06:34:33.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:33.815 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:33.843 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2023-11-17T06:34:33.874 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-11-17T06:34:33.911 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:33.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:34:33.937 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:33.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:34:33.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-17T06:34:33.992 INFO:teuthology.task.internal:Transferring archived files... 2023-11-17T06:34:33.993 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi100 2023-11-17T06:34:33.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-17T06:34:34.041 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339/remote/smithi119 2023-11-17T06:34:34.041 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-17T06:34:34.083 INFO:teuthology.task.internal:Removing archive directory... 2023-11-17T06:34:34.084 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-17T06:34:34.090 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-17T06:34:34.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-17T06:34:34.163 INFO:teuthology.task.internal:Not uploading archives. 2023-11-17T06:34:34.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-17T06:34:34.180 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-17T06:34:34.181 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-17T06:34:34.189 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-17T06:34:34.205 INFO:teuthology.orchestra.run.smithi100.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 17 06:34 /home/ubuntu/cephtest 2023-11-17T06:34:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 17 06:34 /home/ubuntu/cephtest 2023-11-17T06:34:34.226 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-17T06:34:34.239 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-17T06:34:34.266 INFO:teuthology.nuke:Checking targets against current locks 2023-11-17T06:34:34.291 DEBUG:teuthology.nuke:shortname: smithi100 2023-11-17T06:34:34.292 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:34:34.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:01:36.373854', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-17T06:34:34.315 DEBUG:teuthology.nuke:shortname: smithi119 2023-11-17T06:34:34.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:34:34.335 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:01:36.372375', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-17T06:34:34.366 INFO:teuthology.orchestra.console.smithi100:Power off 2023-11-17T06:34:34.366 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T06:34:34.390 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-11-17T06:34:34.390 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:34.407 INFO:teuthology.orchestra.console.smithi119:Power off 2023-11-17T06:34:34.407 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T06:34:34.419 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-11-17T06:34:34.432 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-11-17T06:34:34.432 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:34.455 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-17T06:34:38.420 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:38.456 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:38.531 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-11-17T06:34:38.567 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-11-17T06:34:42.534 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:42.569 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:42.645 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-11-17T06:34:42.679 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-11-17T06:34:42.779 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-11-17T06:34:46.646 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:46.757 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-11-17T06:34:46.858 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-11-17T06:34:46.963 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} duration: 1336.532636642456 failure_reason: 'Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default mon.a-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 mon.b-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=05735319635d42a1a96199ec8b28a9fa status: fail success: false 2023-11-17T06:34:46.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T06:34:47.033 INFO:teuthology.run:FAIL